Requirements Quality Analysis:
A successful case study in the Railway industry
CSD&M’16 José Fuentes (The REUSE Company)
Paris. December 13-14, 2016 Hugo-Guillermo Chalé-Góngora (Alstom)
Requirements Quality Analysis - A successful case study
Contents
Introduction
The impact of poor quality in our projects
Requirements Quality Analysis
Practical case study
Goals, inputs and expected outputs
Tools benchmark
The PoC Process
PoC results
2
Requirements Quality Analysis - A successful case study
Introduction
José M. Fuentes
[email protected]
+34 912 17 25 96
@ReuseCompany
3
Requirements Quality Analysis - A successful case study
The REUSE Company (TRC)
Knowledge Centric Systems Engineering
The REUSE Company is specialized in the application of Innovative technologies
Semantic Analysis Technologies to a wide range of applied to
industries (Aerospace, Defense, Automotive, Railway, Energy…)
Knowledge Reuse
Our main focus is on System/Software Reuse,Traceability
TRC main Customers
and Quality.The integration of tools and technology from The
REUSE Company facilitates the representation, analysis and
exploitation of knowledge allowing for a knowledge-centric
systems engineering approach.
Our mission is to promote system/software and knowledge
reuse within any organization, by offering processes, methods,
tools and services that make it possible. We offer technology
that is fully integrated within the organization's production
chain.
4
Requirements Quality Analysis - A successful case study
The impact of poor quality projects
5
Requirements Quality Analysis - A successful case study
Why Requirements Quality Analysis?
Doing the right thing right (verification)
http://www.theguardian.com/world/2014/may/21/french-railway-operator-sncf-orders-trains-too-big
http://elpais.com/elpais/2015/02/04/inenglish/1423052376_326956.html
6
Requirements Quality Analysis - A successful case study
Why Requirements Quality Analysis?
95%
Commited Costs
85%
Cumulative percentage
70%
500-1000x Operations
through
Lifecylce Cost
Disposal
20-100x
3-6x
Production
and test 100%
Development 50%
Concept Design
8% 15% 20%
Time
Source : INCOSE SE Handbook V4.0. 2015
7
Requirements Quality Analysis - A successful case study
Systems and Requirements Engineering life-cycles
Elicitation Analysis Specification Validation
clarify close gaps
rewrite
re-evaluate
confirm and correct
Source: Karl Wiegers
8
Requirements Quality Analysis - A successful case study
Systems and Requirements Engineering life-cycles
CONOPS
Requirements
Validation
Stakeholders Product
Requirements Product Verification
Requirements
Verification System
Requirements
Requirements
Verification System
System System Verification
Design
Equipment
Requirements
Requirements Equipment Equipment
Verification Design Equipment
Verification
Design
Validation
Design
Verification
9
Requirements Quality Analysis - A successful case study
Quick Proof of Concept on Requirements Quality Improvement
OBJECTIVES
The impact of poor quality in our projects
Perform correctness, completeness and consistency analyses of requirements (individually and
collectively) to improve the quality of requirements specifications
Assess the computer-aided requirements authoring feature to accelerate the learning curve of new
practitioners (or improve the capability of current practitioners) in requirements development
GOAL
Exonerate engineers from format concerns (structure) and allow them to concentrate on content
(essence of requirements): technical data useful for design
Relieve engineers from repetitive and error-prone tasks
Allow time for collaboration and creativity
Improve the common understanding of the problem
10
Requirements Quality Analysis - A successful case study
Also, a mean to improve current practices
External audits results
“… Requirements Characterization is not complete: Derived/uncovered requirements justification,
Contribution, Categories (technical vs non-technical), V&V Methods…
…V&V Plan is not complete: Verification activities, or agreed alternate practices (waivers) and
associated deliverables…”
CMMI for Development
Requirement Development process area – SG 3 Analyze and Validate Requirements
“… Analyze requirements to determine whether they satisfy the of higher level requirements.
Analyze requirements to ensure that they are complete, feasible, realizable, and verifiable…”
Verification process area – SG 2 Perform Peer Reviews
“… Establish and maintain checklists to ensure that the work products are reviewed
consistently...
Rules of construction , Completeness, Correctness…”
11
Requirements Quality Analysis - A successful case study
Requirements Quality Analysis tool - Benchmark
Tool Acronym Vendor
DESIRe DES HOOD
Lexior LEX Cortim
Qualicen QCEN Qualicen
QVscribe QVS QRA
Requirements Assistant RA Sirius Requirements
Requirements Quality Suite RQS The REUSE Company
Semios SEM Prometil
12
Requirements Quality Analysis - A successful case study
RQS – Requirements Quality Suite
The Requirements Quality Suite (RQS) intends to tackle requirements quality
management by offering a set of tools and processes
Automatic measurement of requirements quality metric
Support to Requirements Authoring
RQS models requirements quality metrics using the CCC approach (Correctness,
Consistency and Completeness)
Requirements Quality Analyzer
(RQA): to setup, check and manage the
quality of a requirements specification
Requirement Authoring Tool (RAT):
to assist authors while they are creating or
editing requirements
Knowledge Manager (KM): to manage
knowledge around a requirements
specification: the ontology it is based on,
the structure of the requirements to be
used in the project, the communication
between authors and domain architects
13
Requirements Quality Analysis - A successful case study
Requirements quality metrics: CCC Approach
CCC – Correctness, Consistency and Completeness
Correctness
Individual requirements
Requirements
quality
Sets of requirements Consistency Completeness Sets of requirements
14
Requirements Quality Analysis - A successful case study
Proof of Concepts: Work Methodology
One-Week One-Week Two-Week Two-Week
Workshop Use Case definition Requirements Quality Knowledge Base
Analysis Elaboration
RQS Tools Requirements Organizational Documents Analysis: Quality Rules Requirements Requirements Reuse Writing Good
Training Quality Knowledge Standards, Glossaries and Definition Quality Improvement: Organizational Requirements for
Analysis System Documents Analysis Rephrasing Know-How Alstom: Patterns
and Rules
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6
2 Alstom Engineers 2 Alstom Engineers 2 Alstom Engineers 2 Alstom Engineers
2 TRC Consultant 2 TRC Consultant 2 TRC Consultant 2 TRC Consultant
16
Requirements Quality Analysis - A successful case study
Proof of Concepts: Work Process
Alstom Original Alstom Original Alstom Original Organization Alstom Original Organization Alstom
Reqs. Specification Reqs. Specification Reqs. Specification KB V1 Reqs. Specification KB V1 Quality Results
SPECIFICATION Final Quality
Default Quality Assessment Quality Metrics UPDATE Results
INCOSE Quality Assessment with
And Alstom White Belt
TRC Knowledge
ISO29148
Alstom Improved Alstom
INCOSE + TRC Alstom Alstom Reqs. Knowledge Base
Quality Results Knowledge Base Quality Results Specification V2
V1
19
Requirements Quality Analysis - A successful case study
Conclusion and main achievements
20
Margarita Salas, 16 2nd Floor
Innovation Center http://www.reusecompany.com
LEGATEC Technology Park
28919 Leganés – Madrid
SPAIN – EU @ReuseCompany
Tel: (+34) 912 17 25 96
Fax: (+34) 916 80 98 26
[email protected]
