MSA Training PPT 14-07-2020 PDF
MSA Training PPT 14-07-2020 PDF
MEASUREMENT
SYSTEM
ANALYSIS
CONTENTS
Section 1:-
MSA -- Introduction
a) Measurement, b) Measurement System, c) Measurement System Analysis
Properties of a good measurement system
Location error / Precision error
Effect of measurement system error on measurement decision
Precision error -- a) Repeatability b) Reproducibility
How to calculate GRR
Location error --- a) Bias b) Linearity c) Stability
How to calculate bias and decision making
Section 2:-
MSA - Attribute
Probability Method
Kappa Method
INTRODUCTION
• The quality of the product depends in part on the quality
of process.
Product
Quality
Ability of Process
Control
Ability to Measure
Combination of –
Operations
Procedures
Gauges and other equipments
Personnel
Environmental and
assumption etc.
MEASUREMENT SYSTEM ANALYSIS
• Study of effect of Measurement system on
measurement result and
• Accuracy
• Precision
DISCRIMINATION
Ability of measuring the smallest difference
Example :
• Process variation : 3.93~4.06 mm
• Equipment : Vernier Caliper L. C. (0.02mm)
• Group of readings : 3.94, 3.96, 3.98, 4.00, 4.02,4.04, 4.06
• Data categories :7
WHAT IS THE MEANING OF “UNDER
STATISTICAL CONTROL” ?
Variability is caused due to two reasons …..
1. Natural or Inherent called COMMON CAUSES
2. Sudden or Special called ASSIGNABLE
CAUSES
What is Precision :
“Closeness” of repeated readings to each other
ACCURACY AND PRECISION
With the center of the target taken to be the true
value of the characteristic being measured and by
the rifle shots representing the measured values,
there are four combinations of accuracy and
precision as depicted in the following slides.
INACCURATE AND IMPRECISE
ACCURATE AND IMPRECISE
PRECISE BUT INACCURATE
ACCURATE AND PRECISE
IF MEASUREMENT SYSTEM HAS ACCURACY ERROR /
LOCATION ERROR
Location
shifted
It will create LOCATION error in result of measurement
ACCURACY ERROR / LOCATION ERROR
1b. Calling a bad part as good part (called type –II error)
LSL USL
EFFECT OF MEASUREMENT SYSTEM ERROR ON
MEASUREMENT DECISION
2b. Calling a special cause as common cause (called type –II error)
Location Spread
Bias Repeatability
Linearity Reproducibility
Stability
SUMMARY
• Types of measurement system error
• Equipment is calibrated
• Adequate discrimination
Appraiser A C B
Reproducibility
GAGE REPEATABILITY & REPRODUCIBILITY (GRR)
Appraiser A C B
R&R – STUDY
Three Methods
1. Range Method
2. X Bar –R method
3. ANOVA method (preferable in case of appropriate computer
programme)
R&R – AVERAGE AND RANGE METHOD
- Conducting the study
1) Selection of sample: n > 10 parts depending on size,
measurement time / cost etc (representing process variation).
2) Identification : 1 to n (not visible to the appraisers).
- Location marking (easily visible & identifiable by the appraisers).
- Selection of appraiser (k): 2-3 routine appraisers
- Selection of Measuring equipment : Calibrated routine
equipment
- Deciding number of trials ( r ): 2-3
- Data collection :
- Using data collection sheet
- Under normal measurement condition
- in random order
- using blind measurement process
R&R – DATA COLLECTION
Oper TRIAL AVER RO-
PART
No. W
-ator A-GE
No.
1 2 3 4 5 6 7 8 9 10
48.060 48.055 48.054 48.065 48.064 48.056 48.063 48.064 48.065 48.066
A 1 . 1
48.061 48.056 48.055 48.065 48.063 48.055 48.060 48.066 48.062 48.063
2 2
3 3
AVERAGE Xa bar
4
RANGE Ra bar
5
48.060 48.057 48.053 48.065 48.052 48.055 48.063 48.064 48.065 48.063
B 1 6
48.060 48.056 48.056 48.065 48.053 48.054 48.060 48.065 48.065 48.063
2 7
3 8
AVERAGE Xb bar
9
RANGE Rb bar
10
R&R – AVERAGE AND RANGE METHOD
Data Collection
- Enter appraiser A result (Ist trial) in row 1.
- Repeat the cycle (2nd trial) & enter data in rows 2 and 7.
- If three trials are needed, repeat the cycle and enter data in row 3
and 8.
R&R – GRAPHICAL ANALYSIS (MANUAL)
1) For appraiser A, calculate average (X bar) & range ( R ) for each
part and enter in rows 4 & 5 respectively.
2) Do the same for appraiser B and enter results in rows 9 and 10.
3) For appraiser A, calculate average (Xa bar) of all the averages
(row 4) and average (Ra bar) of all the ranges (row 5) and enter in
data sheet.
4) Calculate Xb bar and Rb bar for appraiser B and enter the results
in data sheet.
5) Calculate average of all the observations (rows 4 & 9) of each part
and enter result in row 11.
6) Calculate Part range (Rp) = Difference of Max. and Min. of 11
and enter in data sheet (right most row 11).
R&R – CALCULATION
Oper TRI AVER RO-
AL
PART
-ator A-GE W
No.
No.
1 2 3 4 5 6 7 8 9 10
48.060 48.055 48.054. 48.06 48.064 48.056 48.063 48.064 48.065 48.066
A 1 5 1
48.061 48.056 48.055 48.06 48.063 48.055 48.06 48.066 48.062 48.063
2 5 2
3 3
AVERAGE 48.061 48.056 48.055 48.06 48.064 48.056 48.062 48.065 48.064 48.065 Xa bar =
5 48.0609 4
RANGE 0.001 0.001 0.001 0.000 0.001 0.001 0.003 0.002 0.003 0.003 Ra bar =
0.0016 5
48.06 48.057 48.053 48.06 48.052 48.055 48.063 48.064 48.065 48.063
B 1 5 6
48.06 48.056 48.056 48.06 48.053 48.054 48.06 48.065 48.065 48.063
2 5 7
3 8
AVERAGE 48.060 48.057 48.055 48.06 48.053 48.055 48.062 48.065 48.065 48.063 Xb bar =
5 48.0597 9
RANGE 0.000 0.001 0.003 0.000 0.001 0.001 0.003 0.001 0.000 0.000 Rb bar =
0.001 10
Oper- TRIAL AVE. RO-
PART
ator No. W
1 2 3 4 5 6 7 8 9 10 No.
1 48.060 48.055 48.054 48.065 48.06 48.056 48.063 48.064 48.065 48.06 1
A . 4 6
2 48.061 48.056 48.055 48.065 48.06 48.055 48.06 48.066 48.062 48.06 2
3 3
3 3
AVERAGE 48.061 48.056 48.055 48.065 48.06 48.056 48.062 48.065 48.064 48.06 Xa bar = 4
4 5 48.0609
RANGE 0.001 0.001 0.001 0.000 0.001 0.001 0.003 0.002 0.003 0.003 Ra bar = 5
0.0016
1 48.06 48.057 48.053 48.065 48.05 48.055 48.063 48.064 48.065 48.06 6
B 2 3
2 48.06 48.056 48.056 48.065 48.05 48.054 48.06 48.065 48.065 48.06 7
3 3
3 8
AVERAGE 48.060 48.057 48.055 48.065 48.05 48.055 48.062 48.065 48.065 48.06 Xb bar = 9
3 3 48.0597
RANGE 0.000 0.001 0.003 0.000 0.001 0.001 0.003 0.001 0.000 0.000 Rb bar = 10
0.001
PART AVERAGE 48.060 48.056 48.055 48.065 48.05 48.055 48.062 48.065 48.064 48.06 Rp=0.011 11
(Xp bar) 8 4
X bar Diff = Max. of (Xa bar, Xb bar) – Min. (Xa bar, Xb bar) X bar Diff = 13
0.0012
D4 = 3.27 for 2 trials & 2.58 for 3 trials UCLr = D4 X R bar 0.0043 14
Appraiser A Appriaser B
0.005 0.005
UCL UCL
0.004 0.004
Range
Range
0.003 0.003
0.002
0.002
CL CL
0.001 0.001
0
0
LCL LCL
1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10
Part Part
D4 = 3.27 for 2 trials & 2.58 for 3 trials, UCLr = D4 X R double bar = 3.27 X 0.0013 = 0.004251
AVERAGE CHARTS
Appriaser A Appraiser B
48.07 48.07
48.065 48.065
UCL UCL
Average
Average
48.06 48.06
48.055 LCL 48.055 LCL
48.05 48.05
48.045 48.045
1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10
Part Part
n 2 3 4 5 6 7 8 9 10
K3 .7071 .5231 .4467 .4030 .3742 .3534 .3375 .3249 .3146
-
- Total Variation(TV) = (GRR)2 + ( PV)2
NUMERICAL ANALYSIS
Calculate % variation and ndc as follows
- ndc > = 5
Inference : % R & R = 41.2% and ndc = 3.12. Hence
it is not acceptable and MS needs improvement
How to estimate process behaviour ?
Shape
Location
Spread
Spread - Range
The difference between the largest and
the smallest of a set of numbers.hed from
another. When the number of categories is
2, the data can be divided into two groups
, say high and low. When then number of
categories is 3, the data can divided into 3
groups, say low, middle and high. A value
of 5 or more denotes an acceptable
measurement system.
TV calculation – Different Approaches
Priority order :
1. PV approach
2. Surrogate process variation approach
3. Pp/ Ppk approach
4. Specification tolerance approach
TV calculation – PV Approach
TV = (GRR)2 + (PV)2
PV = (TV)2 - (GRR)2
PV = (TV)2 - (GRR)2
TV calculation –
Tolerance Approach
TV = USL - LSL
6
PV = (TV)2 - (GRR)2
BIAS
Reference value
Observed Average
-Difference between the observed average Value
Bias
Of measurements and the true value
(reference value)
Observed Average
Value
DETERMINING BIAS
1. Obtain sample and determine reference value
2. Collect data
3. Determine Bias
4. Plot bias histogram
5. Compute Average bias
6. Compute Repeatability Standard deviation
7. Determine acceptability of repeatability
8. Determine t statistic for bias
9. Compute bias Confidence Interval and decision making
Step 1: Obtain REFERENCE SAMPLE SELECTION
Key Consideration
• Should be sufficiently stable during study for the
characteristics being evaluated
Priority order
-Sample piece else
-Production part else
-Similar other component else
-Metrology standard
Step 1 : DETERMINING REFERENCE VALUE
• Identify measurement location
- To the extent possible to minimize the effect of within
part variation
• Measure the part for n>_ 10 times
-In standard room / tool room
-With a measurement equipment of better accuracy
-Using standard measurement method
Reference Value (x) = Average of measured value
Step -2 : DATA COLLECTION
• Under routine measurement condition
Trials True Value Observed
Value
F
r
e 2
q
u
e
1
n
c
y
0
-0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4
Bias
biasi
bias
4 6.00 5.9 -0.1
5 6.00 6.0 0.0
i 1 n 6
7
6.00
6.00
6.1
6.0
0.1
0.0
8 6.00 6.1 0.1
9 6.00 6.4 0.4
10 6.00 6.3 0.3
11 6.00 6.0 0.0
12 6.00 6.1 0.1
13 6.00 6.2 0.2
14 6.00 5.6 -0.4
15 6.00 6.0 0.0
( xi x) 2
0.6293
EV r i 1
0.2120
n 1 14
Trials True Value Observed Bias Xi Avg. Bias X – Avg. Sq
Value (X)
1 6.00 5.8 -0.20 0.0067 -0.2067 0.0427
2 6.00 5.7 -0.30 0.0067 -0.3067 0.0940
3 6.00 5.9 -0.10 0.0067 -0.1067 0.0114
4 6.00 5.9 -0.10 0.0067 -0.1067 0.0114
5 6.00 6.0 0 0.0067 -0.0067 0.0000
6 6.00 6.1 0.10 0.0067 0.0933 0.0087
7 6.00 6.0 0 0.0067 -0.0067 0.0000
8 6.00 6.1 0.10 0.0067 0.0933 0.0087
9 6.00 6.4 0.40 0.0067 0.3933 0.1547
10 6.00 6.3 0.30 0.0067 0.2933 0.0860
11 6.00 6.0 0 0.0067 -0.0067 0.0000
12 6.00 6.1 0.10 0.0067 0.0933 0.0087
13 6.00 6.2 0.20 0.0067 0.1933 0.0374
14 6.00 5.6 -0.40 0.0067 -0.4067 0.1654
15 6.00 6.0 0 0.0067 -0.0067 0.0000
Sum (X) 90.1000 Sum = 0.6293
Avg. (X) 6.0067 Sigma r 0.2120
7. Determine acceptability of Repeatability
EV r
% EV 100 100
TV TV
1000.0848 8.48%
0.2120
%EV 100
2.5
8. Determine Bias standard error
r
b
n
.2120
b 0.0547
15
9. Determine Confidence Limit
Alpha-two- 0.05
tails
Sample Size DF
Bias is acceptable
-1
Reference Value
LINEARITY STEPS
Determine Process Range
Calculate Bias
Take decision
Example of linearity
Sample No. 1 2 3 4 5
Reference 2 4 6 8 10
Example 1 : Value
Observed Value 2.492 4.125 6.025 7.708 9.383
• Data collection :
• Decision
Measurement system is stable & accetable if no out of
control condition is observed other wise not stable and
needs improvement.
Example - Stability
To determine if the stability of a new measurement
instrument is acceptable, the process team selected a part
near the middle of the range of the production process.
Determine the reference value which is 6.01. Measured this
part 5 times once a shift (20 subgroups). After all the data
were collected, X bar & R charts were developed.
X bar chart for stability
6.2
6.1
6.021
6
5.9
5.8
LCL=5.746
5.7
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
R chart for stability
0.5
0.4779
LCL=0
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Control Chart Analysis for Stability
Analysis of the control charts indicates that the
measurement process is stable since there are no obvious
special cause effects visible.
MSA - ATTRIBUTE
MEASUREMENT
SYSTEM
ANALYSIS
MSA Study for attribute data
Conclusion :-
Conclusion :-
1 B B B B B B B
2 G G B G B B G
3 B B B B B B B
4 G B G G B G B
5 B B B B B B B
6 B B G B B B B
7 G G B G G G G
8 B B G B B B B
9 B B B B B B B
10 G G G B B G G
11 G B G G G G G
12 B B B B B B B
13 G G G G G G G
14 B B B B B B B
15 G G G G G G G
16 G B G G G G G
17 B B B B B B B
18 B B G B B G B
19 B B G G G G G
20 G G G G G G G
B means Bad There are 11 times where A-1 and B-1 = B, there are
G means Good 8 times where A-2 and B-2 = B, and there are 10
times where A-3 and B-3 = B. Total agreement = 29
Kappa Method (Between Appraiser A and B)
Appraiser A Appraiser B
No. of Parts True Status
Trial 1 Trial 2 Trial 3 Trial 1 Trial 2 Trial 3
1 B B B B B B B
2 G G B G B B G
3 B B B B B B B
4 G B G G B G B
5 B B B B B B B
6 B B G B B B B
7 G G B G G G G
8 B B G B B B B
9 B B B B B B B
10 G G G B B G G
11 G B G G G G G
12 B B B B B B B
13 G G G G G G G
14 B B B B B B B
15 G G G G G G G
16 G B G G G G G
17 B B B B B B B
18 B B G B B G B
19 B B G G G G G
20 G G G G G G G
B means Bad There are 4 times where A-1 and B-1 = G, there are 9
G means Good times where A-2 and B-2 = G, and there are 8 times
where A-3 and B-3 = G. Total agreement = 21
Kappa Method (Between Appraiser A and B)
Appraiser A Appraiser B
No. of Parts True Status
Trial 1 Trial 2 Trial 3 Trial 1 Trial 2 Trial 3
1 B B B B B B B
2 G G B G B B G
3 B B B B B B B
4 G B G G B G B
5 B B B B B B B
6 B B G B B B B
7 G G B G G G G
8 B B G B B B B
9 B B B B B B B
10 G G G B B G G
11 G B G G G G G
12 B B B B B B B
13 G G G G G G G
14 B B B B B B B
15 G G G G G G G
16 G B G G G G G
17 B B B B B B B
18 B B G B B G B
19 B B G G G G G
20 G G G G G G G
Kappa A B
A - .659
B .659 -
Kappa more than 0.75 : Good Agreement
Less than 0.40 : Poor Agreement
Kappa Method (Between Appraiser A and B)
Total Count 33 27 60
Expected Count
Kappa A
Ref. .628
Kappa more than 0.75 : Good Agreement
Less than 0.40 : Poor Agreement
Kappa Method (Between True status and Appraiser A)
True Status
Total
(B)Bad (G)Good
(B) Count 29 5 34
15.3
18.7 Correct Type 1 error
A Appraiser Bad Expected Count
Decision Producers Risk
Count 4 22 26
14.3 11.7
(G) Good Type 2 error
Expected Count
Consumers Risk
Correct Decision
Count 33 27 60
Total
Expected Count
Kappa B
Ref. .696
Kappa more than 0.75 : Good Agreement
Less than 0.40 : Poor Agreement
Attribute Measurement System Study (By kappa
Method) Between True Status & Appraiser B
Inference between True Status & Appraiser
B :-