TCS Testing Service Capabilities
Agenda
Overview of TCS Testing Services
Testing Service Engagements for Leading Shipping Company
TCS Technology Practices and Focus on Testing
Technology Consulting
Java Technologies Migration & Reengineering Performance Engineering Microsoft Technologies
Mobile Computing
SCM/SRM
System Integration
Solution Delivery Model Industry Domain Knowledge Think
Assessment Advisory Strategy Process Redesign Architecture
Build
Solution Implementation System Integration
Operate
Maintain Infrastructure Provide Outsourcing Services
Technology
People & Processes
Infrastructure
3
PeopleSoft
BI / KM
Testing
Oracle
CRM
ATC
SAP
EAI
TCS Testing Service Practice An Enabler
Testing Practice Charter
Act as a repository of knowledge on test processes and tools Track technology advancements in the testing area Help define/refine methodology and techniques for Testing engagements Offer services and consulting on testing Offer training related to test process and tools Help set up Test Center of Excellence / Test Organization
Service Offerings
Consulting Test Strategy Definition Test Process Consulting Functional Tests System (Integration) Testing Regression Testing Regression Test Bed Creation & Maintenance Non functional Testing Performance, Volume, Stress, Load Test Automation
Benefits
Achieve time to market Cost reduction Improve Test Effectiveness Independent Test Organization
Capabilities
900+ engineers in active engagements Over 45 ongoing engagements Third party tools experience In-house R&D on testing tools developer oriented Work closely with other Centers of Excellence for Industry and Product experiences CSQA, CSTE Certifications
Institutionalized capabilities for meeting all the testing needs of clients
4
TCS Testing Methodology
Unit Testing Test Coverage
Test Coverage Analyser Traceability Matrix
Templates
Test Plan - IEEE Test Case/Script Traceability Matrix Status Report
System Testing
Test Case/Script Management
Test Scenarios Requirements Coverage
Check Lists
Review Checklist
Systems Integration
Defect Management
Tools for defect tracking and monitoring Defect Analysis
Metrics
Test Progress Defect Status
Performance Testing
Regression Testing UAT
Test Automation
Automation framework GUI and Test Harnesses Currency of test scripts
Test Effectiveness
Test Efficiency
Training
Product Training Testing Training Project Induction
Test Estimation
Build Empirical Model
Strong time-tested Testing Methodology and Process Assets
5
Engagement Models Suited to Specific Client Needs
Collaborative
Client handles Test strategy, Planning & Primary design. TCS mainly involved in Test design and execution
Independent Validation& Verification (IV&V)
Independent third party testing
Used for single release of application/product
Quality Assurance Center of Excellence (QACoE)
One stop shop for all types of testing. Strategic Value Adds
Flexible Engagement Models Customized to Client needs
6
Testing Approach - Phases
Start Up
Understand Scope/Size Define testing activities, deliverables / KT plan Firm up roles/responsibilities Identify Offshore 1-2 Weeks
Knowledge Transition
Learn Business/Technology aspects of Application Understand existing Testing process/procedures/tools used Begin setting up offshore 2-3 Months Duration varies depending on application complexity
Service Phase
Test scenario/case prepare /update Test Execution Test Result Analysis/Recording Internal/External review
Ongoing
Team Composition Portfolio of Skills
Typical TCS Testing Team has complementary set of skills:
Domain knowledge in Transportation Services Project Management experience Testing experience using industry standard tools
Business
Shipping Logistics
Technology
UNIX/SQL GUI J2EE
Core Team For Project
Process Tools
Quality Center Test Methodologies Test Management Test Design Test Execution Test Reporting
Engagements in Testing A Snapshot
Client Transportation British Airways, UK P&O Ned Lloyd, UK NYK Line, Japan Banking and Finance Barclays Lehman Brothers, USA Deutsche Bank Merrill Lynch Bank of America, USA Functional, Regression Functional, Regression User Acceptance Testing Regression Testing, Functional, UAT Functional, Performance Collaborative QA CoE Collaborative QA CoE QA CoE Consulting User Acceptance Testing Functional, Regression IV&V Collaborative Service Offerings Engagement Model
American Express
First Union National Bank Royal Bank of Scotland
Functional, Performance
Functional, Test Automation Stress / Load Testing
QA CoE
IV&V IV&V
Others (Health Care, Retail, Telecom) GE Medical Systems, USA Best Buy Verizon, USA QWest Functional, Performance Functional, Performance Functional Functional QA CoE QA CoE IV&V QA CoE
Extensive experience in providing Testing Services
9
Agenda
Overview of TCS Testing Services
Testing Service Engagements for Leading Shipping Company
10
Testing Services for Leading Shipping Company
Scope of Testing
Unit Testing, System Testing, Integration Testing, Regression Testing, Functional Testing
Knowledge Repository
Domain Knowledge Testing Experience Project Management
Engagement Process
Initial Systems Study: Overall understanding of size, complexity and testing requirements of applications within the scope of work Duration and plan for knowledge transition Staffing requirements (numbers, skills) for initial period (knowledge transition, test bed creation) and service phase
11
Testing Services for Leading Shipping Company (continued)
Engagement Process (continued)
Onsite Business Analysts (BA) Responsibilities / Activities: Understand business and technical aspects Participation in Requirements meeting Preparation of Estimates Preparation of Test Cases / Test Data with help of User team Co-ordination with Users, Developers and offshore team Supporting Users during UAT and Production Launch Offshore Activities: Team building Understanding of Requirements / Test Cases Preparation of Test Cases / Scripts Test Cases Execution Defect Logging and Verification Tracking Defects to closure Test Result Analysis and Recording Test Status Reporting Supporting Users during UAT and Production Launch
12
Testing Services for Leading Shipping Company (continued)
Pre-engagement Scenario
No formal testing processes and QA Organization
Testing performed as ad hoc activity by a number of Onshore Consultants
Manual Testing processes resulting in:
Error-prone software Unpredictable software quality Labor-intensive testing Escalation of costs
13
Testing Services for Leading Shipping Company (continued)
Activities
Horizon Enablers
Measures and Metrics
Set up Test environment and Tools at offshore Identify resources and establish offshore testing team Offshore transition of Testing activities Conduct Testing from offshore for selected applications Initiate process assurance activities for testing
Proven onsite-offshore processes for planning, execution and control Templates and guidelines for test plans, test scripts Training materials for testing processes Process documents in knowledge repository Offshore Testing using CITRIX
Onsite-offshore team ratio Cost savings in $ Number of Defects in System Testing vs UAT
Harvest Cost Savings
Deliverables: Customized templates, Testing Documents, Best Practices and Lessons Learned Leverage TCS CMMi Level 5 practices for testing Process Quality Assurance to verify compliance 30 % Cost reduction due to offshore transition 24 * 7 Production Support Coverage
Benefits
14
Testing Services for Leading Shipping Company (continued) Objective
Successful UAT and Production Launch of large releases Improve Process and Product Quality
Environment
J2EE, Gemstone, Small Talk, Sybase
Methodology followed
Process Framework Definition Knowledge Transition at onsite and offshore Offshore Activities
Test Design Test Execution
Test Tools
Mercury Quality Center
Size
The subject releases are Global Launch across 16 countries 4 at onsite, 16 at offshore during peak
Results
Majority of the defects identified during System Testing 30 % Defect reduction in UAT Phase Smooth Production Launch
15
Testing Services for Leading Shipping Company (continued)
Test Planning
Business Requirements Specification and SRS Reviews Define Testing Objectives & Scope Define Testing Phases, Activities, Responsibilities Identify Tools, Techniques and Practices
Test Bed Prep
Design Test Cases Create Test Data and Test Scripts
Unit level testing
Carry out unit level testing to detect bottlenecks
Integration & Functional Testing
Test against Baseline Update and Refine Baseline
Test application systems (System) and its integration Build Baseline Test Bed
Regression Testing Acceptance Test
Retrofitting of changes
Final run of Regression Test
Performance Testing is carried out in parallel to any functional testing activity
16
Testing Services for Leading Shipping Company (continued)
Testing Model
Project Planning Prioritization Management
Client QA Office
TCS Onsite Test Coordinator Business expertise Liaison with Client teams Manage onsite team
TCS Offshore Test Manager Resource Planning Team management Coordination with onsite
Impart knowledge Release Planning Test Plan documentation
Core Team
Client Application Liaisons TCS Onsite Testing Team Business expertise Take up testing of new applications Build knowledge, test bed Transition testing to offshore TCS Offshore Testing Team Test execution Report metrics Certify releases TCS Testing Service Practice Provide testing Best Practices: Methodology, frameworks Provide training on process and tools Assist in identification of testing resources
17
Testing Services for Leading Shipping Company (continued)
Best Practices from the Engagement
Optimal onsite-offshore team split based on application complexity Onsite team with domain knowledge and coordination experience Careful test planning and resource planning as applications are moved into testing pipeline Provision of adequate application and infrastructure support Application documentation helps in knowledge management Cross-training of resources across applications to create backup
18
THANK YOU
19
