Laboratory Validation of Analytical Methods

Prepared by Hock Eng, Khoo

Definitions
Validation is the process of demonstrating or confirming the performance characteristics of a method of analysis. A process of evaluating method performance and demonstrating that it meets a particular requirement. Validation applies to a specific operator, laboratory, and equipment utilizing the method over a reasonable concentration range and period of time.

Why Method Validation?

To minimize analytical and instrumental errors To give reliable and reproducible results in accordance with the given specifications of the test method To ensure the quality of the test results To meet accreditation requirement Objective evidence for defense against challenges To be assured of the correctness of results

When Method Validation Not Required?

Standard methods on condition that used within their scope of applicability (e.g. matrices, ranges, etc) without modifications (including QA plan and reporting) Otherwise, required

Ask yourself
What analytes should be detected? What are the expected concentration levels? What are the sample matrices? Are there interfering substances expected, and, if so, should they be detected and quantified? Are there any specific legislative or regulatory requirements? Should information be qualitative or quantitative? What are the required detection and quantitation limits? What is the expected concentration range? What precision and accuracy is expected? How robust should the method be? Which type of equipment should be used? Is the method for one specific instrument, or should it be used by all instruments of the same type? Will the method be used in one specific laboratory or should it be applicable in all laboratories at one side or around the globe? What skills do the anticipated users of the method have?

Before start to validate a method

Parameters for Method Validation

Accuracy Precision Specificity Limit of detection Limit of quantitation Linearity and range Ruggedness Robustness

Strategy for Method Validation

1. Develop a validation protocol, an operating procedure or a validation master plan for the validation. 2. For a specific validation project define owners and responsibilities. 3. Develop a validation project plan. 4. Define the application, purpose and scope of the method. 5. Define the performance parameters and acceptance criteria. 6. Define validation experiments.
Source: LabCompliance (2007). Validation of Analytical Methods and Procedures: Tutorial. http://www.labcompliance.com/tutorial/methods/default.aspx?sm=d_d

Strategy for Method Validation

7. Verify relevant performance characteristics of equipment. 8. Qualify materials, e.g. standards and reagents for purity, accurate amounts and sufficient stability. 9. Perform pre-validation experiments. 10. Adjust method parameters or/and acceptance criteria if necessary. 11. Perform full internal (and external) validation experiments. 12. Develop standard operational protocols (SOPs) for executing the method in the routine. 13. Define criteria for revalidation. 14. Define type and frequency of system suitability tests and/or analytical quality control (AQC) checks for the routine. 15. Document validation experiments and results in the validation report.

Strategy for Method Validation

Major compounds quantitative Limit of detection Limit of quantitation Linearity Range Precision Major compounds qualitative Traces quantitative Traces qualitative

Accuracy
Specificity Ruggedness

Method validation tools

Linear-data plotter can be used with data from a linearity experiment to assess the reportable range of a method. provides a plot of the average of a group of replicate test results on the y-axis versus the assigned value (in % or concentration units) on the x-axis. SD Calculator can be with data from a replication experiment to calculate the mean, standard deviation (SD or smeas), and coefficient of variation (CV). a histogram display of the data is also available.

Method validation tools

Paired-data Calculator can be used with data from a comparison of methods experiment to calculate linear regression statistics (slope, y-intercept, and standard deviation about the regression line, sy/x), and the correlation coefficient (r, Pearson product moment correlation coefficient); ttest statistics (average difference between two methods or biasmeas; SDdiff, standard deviation of the differences between the two methods). can also be used to provide a "comparison plot" that shows the test method results on the y-axis versus the comparative method results on the x-axis, as well as a "difference plot" that displays the difference between the test minus comparative results on the yaxis versus the comparative method result on the xaxis.

Sampling

Sample preparation

Analysis Calibration

Data evaluation
Reporting

Sampling
Analysis starts with sampling
For trace analysis: sampling becomes a major source of error Differs from matrix to matrix

Sampling Method
When, where and how to collect samples Sample transportation to laboratory Sampling equipment Sample containers Sample-treatment procedures (drying, mixing, etc. prior to measurements) Sub-sampling procedures Storage during sampling

Sampling Method

To obtain a representative sample Types of sampling car or bin sampling stratified sampling random sampling 2 steps sampling interval sampling

Problems during sampling and storage of samples

Losses from volatilization Decomposition by means of: temperature UV irradiation microbial activity chemical reactions with oxygen, sample container, etc.

ISTA Validation Process

1. 2. ISTA method validation is a five-step process: Test method selection and/or development. Validation through either multi-laboratory characterization of the test method performance, peer verification of the test method, or verification of performance claims for the test method. Review of data. Approval of the test method by the relevant ISTA Technical Committee, publication in ISTA Method Validation Reports and preparation of a Rules proposal for the test method. Final acceptance by the ISTA voting members and publication of the test method in the ISTA Rules.

3. 4.

5.

Source: Hampton, J. (2005), ISTA Method Validation, Issues of Technical Common Interest, Seed Testing International No. 130, p. 22, October 2005 http://www.seedtest.org/upload/cms/user/130_p22.pdf

Accuracy
To determine the closeness of the test results obtained to the true value of the standard used
To measure the systemic error of the analysis

Accuracy

Method used: Purchase standard from the supplier with a known tolerance given or standard recommended by a particular reference method. Working standard can be used as a standard addition (spiked analysis). Perform the method with more than 2 determinations at low, middle and high concentrations.

Accuracy Method used: For methods using an instrument with a known standard calibration curve, selection of the range can be made. For methods without the above, the range can be selected from a knowledge of the concentration of samples analyzed. Based on the results obtained, calculate the average of the standard values obtained and compare them with recommended values (Table 1) or Compare the result obtained with certified reference material (CRM).

Accuracy
Table 1: Acceptable Recovery Percentages
Analyte (%) 100 10 1 0.1 0.01 0.001 0.0001 0.00001 0.000001 0.0000001 Unit 100% 10% 1% 0.1% 100 ppm 10 ppm 1 ppm 100 ppb 10 ppb 1 ppb Mean Recovery (%) 98-102 98-102 97-103 95-105 90-107 80-110 80-110 80-110 60-115 40-120

Source: AOAC (2002). AOAC Requirements for Single Laboratory Validation of Chemical Methods. DRAFT 2002-11-07, \AOACI\eCam\SingleLab_Validation_47.doc. http://www.aoac.org/Ag_Materials/additives/aoac_slv.pdf.

Precision
To determine the degree of agreement within the test results for a particular sample. This is a measurement of the random errors of an analysis. 3 types of precision measurement
(1) Repeatability (one single operator, single laboratory, short time span) (2) Intermediate precision (internal reproducibility: between operators, single laboratory) (3) Reproducibility (proficiency testing/collaborative studies between laboratories)

Precision

Repeatability (one single operator, single laboratory, short time span). Refers to the degree of agreement of results when conditions are maintained as constant as possible. Select one sample for every matrix and perform replication for each matrix within the same day. If resources permit, run the same sample for 3 different days (within 7 days). Calculate the standard deviation (SD) and relative standard deviation (RSD) for each matrix. Compare the precision results with the RSD% in Table 2.

Precision Intermediate precision (internal reproducibility: between operators, single laboratory). To evaluate the degree of agreement between different operators for a particular sample. Measure the random errors inherent when different analysts perform the same analysis with the same sample. Use 2-tailed F-test to determine whether there is any significant difference in the results between the precisions of two operators. Calculate the sample variance for each operator. Calculate the precision for each operator according to the types of samples and compare the RSD(%).

Precision

Reproducibility (proficiency testing/collaborative studies between laboratories). Only applicable when resources are available. The blind sample(s) will be analyzed at least three times by using the routine method and/or other standard methods. Calculate the average value of the replicates and SD if more than three replicates are performed. Compare the results obtained from other laboratories in terms of the z-score, mean valeu and median once these results are made available.

Precision Table 1: Acceptable Recovery Percentages

Analyte (%) 100 10 1 0.1 0.01 Unit 100% 10% 1% 0.1% 100 ppm RSDr (%) 1 1.5 2 3 4 RSDR (%) 2 3 4 6 8

0.001
0.0001 0.000001

10 ppm (g/g)
1 ppm 10 ppb (g/kg)

6
8 15

11
16 32

AOAC (2002). AOAC Requirements for Single Laboratory Validation of Chemical Methods. DRAFT 2002-11-07, \AOACI\eCam\Single-Lab_Validation_47.doc. http://www.aoac.org/Ag_Materials/additives/aoac_slv.pdf.

Precision

The value of RSD% can be calculated from HORRAT formula: RSDr = C0.15 (Repeatability) RSDR = 2C0.15 (Reproducibility) HORRAT = RSD (found)/RSD (calculated) Acceptable values for this ratio are typically 0.5 to 2.

Limit of Detection
It is the smallest amount or concentration of an analyte that can be estimated with acceptable reliability. An alternative definition of the limit of detection and limit of determination is based upon the variability of the blank. The blank value plus three times the standard deviation of the blank is taken as the detection limit and the blank value plus 10 times the standard deviation of the blank is taken as the determination limit. The detection limit is only useful for control of undesirable impurities that are specified as not more than a specified low level and for low-level contaminants. Limits of detection and determination are unnecessary for composition specifications although the statistical problem of whether or not a limit is violated is the same near zero as it is at a finite value.

Instrument Detection Limit

To determine the lowest concentration of analyte in a sample that can be detected. It is important for trace analysis. Perform several determinations and calculate the SD of the blank LOD = x + 3 SD (x = average blank reading) or Perform several determinations at the lowest acceptable concentration using a standard sample (fortified blank sample) and calculate the SD. LOD = x + 3 SD (x = average sample blank reading)

Method Detection Limit

It is based on a sample, which have gone through the entire sample preparation prior to analysis. Method detection limit is approximately 4 instrument detection limit. Perform several determinations each at low, middle and high range concentrations using a sample. Calculate SD at each limit. Plot SD against concentration of the analytes. Extrapolate the graph until the y-axis is reached. At zero concentration, record the SD0. Method detection limit = 3 SD0 It is unique for a particle sample matrix.

Signal to Noise Ratio

Source: LabCompliance (2007). Validation of Analytical Methods and Procedures: Tutorial. http://www.labcompliance.com/tutorial/methods/default.aspx?sm=d_d

Source: International Conference on Harmonization (ICH) of Technical Requirements for the Registration of Pharmaceuticals for Human Use, Validation of analytical procedures: Methodology, adopted in 1996, Geneva

Specificity/Selectivity
The terms selectivity and specificity are often used interchangeably. To determine the purity of the peak area in chromatogram. Difficult to ascertain whether the peaks within a sample chromatogram are pure or consist of more than one compound. The analyst should know how many compounds are in the sample or whether procedures for detecting impure peaks should be used.

Examples of pure and impure HPLC peaks

Source: LabCompliance (2007). Validation of Analytical Methods and Procedures: Tutorial. http://www.labcompliance.com/tutorial/methods/default.aspx?sm=d_d

Linearity
To determine the degree of variance about the calibration curve Perform several determinations using a standard sample at low, middle and high range. Calculate the SD of each concentration group. Calculate the best-fit line of the calibration curve and the correlation coefficient (r2) of the curve. Use the F-test to determine the significant difference in variance of the curve for each concentration group.

Ruggedness
Ruggedness is defined by U.S. Pharmacoepia as the degree of reproducibility of results obtained under a variety of conditions, such as different laboratories, analysts, instruments, environmental conditions, operators and materials. Ruggedness is a measure of reproducibility of test results under normal, expected operational conditions from laboratory to laboratory and from analyst to analyst. Ruggedness is determined by the analysis of aliquots from homogeneous lots in different laboratories. Refer to the examples of Ruggedness Trial in the AOAC Requirements for Single Laboratory Validation of Chemical Methods (DRAFT 2002-11-07).

Robustness
Robustness examine the effect that operational parameters have on the analysis results. These parameters are pH, flow rate, column temperature, injection volume, detection wavelength or mobile phase composition. If the influence of the parameter is within a previously specified tolerance, the parameter is said to be within the methods robustness range. Obtaining data on these effects helps to assess whether a method needs to be revalidated when one or more parameters are changed, for example, to compensate for column performance over time. It is recommended to consider the evaluation of a methods robustness during the development phase, and any results that are critical for the method should be documented.

Sources
ISTA guide: http://www.seedtest.org/upload/cms/user/130_p22.pdf EURACHEM guide: http://www.farmacia.ufmg.br/lato/eurachem%20guide% 20validation%20(1).pdf AOAC guide: http://www.aoac.org/Ag_Materials/additives/aoac_slv.p df Other guide: http://www.labcompliance.de/documents/FDA/FDAOthers/Laboratory/f-505-method-validation-draft.pdf