SUCEED - WinVinaya Consulting Methodology
Sensitize
- Educate the Organization and its employees on the need of the exercise
- Enable the stakeholders to understand the need of the hour keeping in mind the organization, market and customer needs
Understand
- Execute an As-Is analysis
- Understand stakeholder needs
- Understand what works well and what needs improvement
- Identify the collective capability of the organization
Consolidate
- Consolidate stakeholder needs, organization capability and document findings
- Facilitate organization/stakeholders to arrive at the goal
Catalogue
- Build a list of tasks to perform
- Prepare a catalogue of documented process, working process, process needing modifications
Evaluate
- Identify standards for alignment
- Prepare a gap analysis covering the organization systems and procedures and individual capabilities/skills
Enhance
- Enhance the systems and procedures to suit the needs
- Identify tools/training that could enable in skill upgrade
- Build a robust Talent enablement methodology that can scale based on needs
- Execute Pilot(s)
Deploy
- Roll out process
- Validate implementation results, make course corrections as appropriate
PERFECT - WinVinaya Assessment & Improvement Methodology
Prepare
- Kickoff assessment and inform the employees and stakeholders the background behind this assessment & the outcome
- Seek their support in being transparent and providing the right and factual information
Elicit
- Execute an As-Is analysis through Questionnaire, interviews and document reviews.
- Understand stakeholder needs
- Understand what works well and what needs improvement
- Identify the collective capability of the organization
Review
- Consolidate stakeholder needs, organization capability and document findings
- Facilitate organization / stakeholders to arrive at the goal
Finalize
- Identify standards for alignment
- Prepare a Test Assessment report covering the organization systems, Tools and procedures and individual capabilities/skills
Enhance
- Enhance the systems, tools and procedures to suit the needs
- Identify tools/training that could enable in skill upgrade
- Build a robust Talent enablement methodology that can scale based on needs
- Execute Pilot(s)
Communicate
- Roll out process, systems and tools as appropriate to the entire organization
- Assist organization in following the revised process, systems and tools
Track
- Track progress of the revised process,
- Make tweaks/changes to suit the needs and enable achievement of goals
WinVinaya’s Agile Test Maturity Model
Level 1
Level 2
Level 3
Level 4
Technical Excellence
Skill development & Knowledge Sharing
- Test trainings are planned and executed
- Documents are shared in a common place for knowledge sharing
- Assessment of skills happen (primarily focused on immediate delivery needs)
- Portals/Tools to share knowledge available
- Structured programs are available in the department to groom test specialists, test leads
- Future skill requirements are documented
- The effectiveness of skill development is measured
- Goals are set for skill development across immediate, future needs
- Goals, plans are created and monitored
Test Plan & Design
- Test approach covers functional testing
- Black box testing techniques (ex: equivalence partitioning,..) done
- Plan covers non-functional testing as well
- Tools are used for efficient test design (ex: AllPairs, …)
- Goals set for early defect detection
- Model based test design
- Plan covers defect prevention
- More test cases based on enhanced risk
- Re-use of test artifacts across projects
Delivery Excellence
Early Defect Detection
- Basic Agile training
- Build Verification Testing
- Continuous Integration Testing
- TDD/ ATDD training
- Code reviews focused on functionality
- Code coverage 40% to 60%
- Code reviews include non-functional test
- Automated reviews through tools
- Code coverage is 60% to 80%
- Intense architecture, design reviews
- Reviews aligned to product risk
- Code coverage > 80%
Test Automation
- Automated smoke tests
- Focus on regression test automation
- Utilizes test automation framework
- Test automation goals cover % of test case automation. Goals are regularly monitored
- Automation within iteration
- Automation across layers (UI, Middle)
- Frameworks cover different configs
- Goals cover effort savings
- Focus is on integration, E2E automation
- Goals cover development effort optimization.
Non-Functional Testing
- Performance Testing, Installation Testing are planned & executed
- Security testing is planned & executed
- Performance models cover different loads, scalability
- Performance profiling is done
- For mobiles – usage of memory, battery, network data, compatibility testing
- Validation of performance models against production done
- RCCA done for Non Functional defects
Test Environment
- Dedicated environment available for functional testing
- Test data created for functional testing
- Dedicated & adequate environment available for non-functional testing Portals/Tools are available for sharing
- Build, Deployment into the environments are automated, monitored
- Effectiveness of test environment in terms of availability, scalability measured
- Optimized environments through IAAS, Cloud services
Test Enabler Excellence
Information Radiators
- Test execution trends, defect trends monitored and actioned
- Build Verification Pass/Fail Trends
- Leading metrics like code coverage, technical debt are measured, monitored
- % of test cases automated
- Trends of RCCA of external defects
- Dashboard across department
- Effort savings of test automation
- Trends of RCCA of internal defects
- Analysis of dashboard across depts
- Schedule Savings, Quality Improvement through Test Automation
- Dashboards shared with stakeholders
Defect Mgmt
- Defects Radiated
- Defects are monitored for closure
- Defects are traceable to test cases
- Early defect detection are logged
- RCCA of external defects done
- RCCA of internal defects done
- Actions to detect defects early – created and monitored, across department
- Automatic monitoring of production for potential defects
- Effectiveness of RCCA – measured