We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byMillicent Holmes
Modified about 1 year ago
William R. Porter R4P3 Pharmaceutics Abbott Laboratories, Abbott Park, IL Uncertain Standards with Standard Uncertainties
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Background In 2007, the USP Reference Standards Expert Committee Subcommittee on Certified Reference Standards issued a Stimuli article in Pharmaceutical Forum that proposed establishing procedures for upgrading USP reference materials (RMs) so that they may be labeled as Certified Reference Materials (CRMs) according to ISO 9001 and requirements. The most notable change would be the assignment of specified uncertainties to RMs. The concept, widely recognized in the universe of other standards- setting organizations as a necessary and proper procedure for the certification of reference standards, is a foreign concept in the world of pharmacopoeial testing and measurement. The ostensible motive for this recommendation is to bring USP into compliance with ISO requirements for Reference Standards.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Standard Uncertainties The concept of uncertainty in measurement is an old one. In the 1963 National Bureau of Standards Handbook 91 Experimental Statistics, author Mary Gibbons Natrella devoted an entire chapter (Chapter 23) on “Expression of the Uncertainties of Final Results.” –This chapter clearly differentiates estimates of systematic error from estimates of imprecision and establishes that BOTH sources of error must be included in a statement of uncertainty. Numerous textbooks on Analytical Chemistry stress that a numerical result, stated without an associated estimate of its uncertainty, is of no utility. Prior to 1980, uncertainties were classified as due to either “random” errors or “systematic” bias, as exemplified in Natrella’s detailed exposition.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Outdated and Impractical Splitting of Measurement Deviations In the old way of treating uncertainties, efforts are made to estimate sources of bias and a correction is applied to the result. Whatever systematic errors that cannot be accounted for and then lumped in with the errors arising from random variation. Type B errors are difficult to estimate. Type B errors were not even reported!
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Standard Uncertainties: The New Way The concept of uncertainty has changed over time. In 1980, the Comité International des Poids et Mesures (CIPM) recommended reclassifying estimates of uncertainty into two categories: –A: Uncertainty estimates determined using statistical methods on the basis of repeated measurements, and –B: Uncertainty estimates determined using other means. These concepts replace the older notions of “random” and “systematic” error. –Some components of “systematic” error introduce variation that rightly should be combined with statistical estimates of variation obtained from assessment of precision. –Other components of “systematic” error can be estimated as central tendencies that can be applied as corrections to the measured value.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Modern and Practical Way of Dealing with Measurement Uncertainties Measurement uncertainty describes a range of possible values. The classical concept of “error” describes the difference between the measured value and the “true” value. The goal of uncertainty estimation is to construct boundaries within which the “true” value is likely to lie, taking into account both uncertainties arising from random as well as systematic deviations.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Determining Measurement Uncertainty Non-Statistically Many systematic sources of uncertainty cannot be estimated from repeated measurements. Possible sources of information: Previous measurement data Experience with the sample and the measurement technique being used e.g., control charts for similar processes e.g., historical data for other products using similar or identical components Information quoted by the manufacturer of the instrument or equipment used e.g., design specifications & tolerances Data based on calibrations or certificates e.g., an assigned uncertanty for a CRM e.g., stated tolerance for ASTM calibrated volumetric glassware Uncertainties taken from manuals e.g., stated tolerances for device, such as an electronic pipettor
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Calculation of the Measurement Uncertainty A multi-step process is used… Specify the measurand. Identify uncertainty sources. Quantify uncertainty components. Convert to standard uncertainties –Treat as if they were standard deviations for statistically-evaluated processes. –Triangular and rectangular distributions are used instead of Gaussian distributions. Triangular distributions are used for processes with target values and tolerance limits, e.g., volumetric dilutions. Rectangular distributions are used for processes with only tolerance limits, e.g., weighing on a digital balance. Calculate combined uncertainty.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott Identification of Sources of Uncertainty Requires a Detailed Process Map All unit operations must be identified, with inputs and outputs. A mathematical model of the process, incorporating all inputs, is required. Any relationship to Lean Six Sigma process improvement strategies is NOT coincidental. It’s the same DMAIC (Define- Measure-Analyze-Improve- Control) process. Ishikawa Fishbone Diagram
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott ISO Guide 98: Guide to Expression of Uncertainty in Measurement The ISO Guide provides the legal basis for the new scheme for uncertainty estimation. It’s not easy to read, nor does it give much practical guidance. USP cites this guide as the proposed authority for implementing the assignment of uncertainties to USP reference standards, if USP adopts this concept.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott QUAM 2000 The EURACHEM/CITAC guide, “Quantifying Uncertainty in Chemical Measurement” provides highly detailed instructions on how to perform a step-by-step evaluation of measurement uncertainty according to the 1980 CIPM recommendations. Available online at: This is the “practical guide” to uncertainty estimation, and is far more detailed than the NIST guide. It implements ISO Guide 98. Training materials are available in: M Rösslein, B Wampfler, Training Concepts and Teaching Materials in B. Neidhart, W. Wegscheider (Eds.) Quality in Chemical Measurements. (ISBN ). –PowerPoint slides are available!
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott So, How Does This Affect USP? The USP states: A dosage form shall be formulated with the intent to provide 100 percent of the quantity of each ingredient declared on the label. The tolerances and limits stated in the Definitions in the monographs for Pharmacopeial articles allow for analytical error, for unavoidable variations in manufacturing and compounding, and for deterioration to an extent considered acceptable under practical condition. Generally, Reference Standards used in assays are labeled with three significant figures and standards used in limit tests with two significant figures. Reference Standards having multiple applications in different methodologies may require separate assay-specific assignments. The assigned value is labeled without any associated uncertainty. Proposed change!
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott What Will Change? Under the proposal published in PF, the USP labeling of reference standards would include both a “standard uncertainty” and an “expanded uncertainty” assignment in the Certificate of Analysis that will accompany the potency factor. Certified Content Value:Standard Uncertainty ± Expanded Uncertainty ±
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott What Does All This Mean? “Standard Uncertainties” function in the same manner as “standard errors” in propagation-of-error calculations using root-mean- square variance calculations. The USP subcommittee proposes to use “3 sigma” limits for “Expanded Uncertainties.” y = p+q-r+... y = p q...
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott How Does This Affect Monograph Limits? Examples are cited in the PF article (Table 2): “Certified” Value (mg/mg) Total Expanded Uncertainty (mg/mg) Monograph Acceptance Criteria Uncertainty as Percentage of Monograph Assay Range CRM %–102.0%3% CRM %–102.0%3% CRM %–102.0%10% CRM %–102.0%2% CRM –1030 µg/mg13%
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott What About In-house Standards? The fun begins… Nothing in the current proposal precludes the establishment of in- house reference standards. Pharmaceutical companies already do this for biologics, which use WHO CRMs that have stated uncertainties. –Usually, the uncertainty of the CRM exceeds the added uncertainty of the in-house standard, so that, although the total combined uncertainty (in-house + WHO CRM) is greater than the uncertainty of the WHO CRM alone, the percentage increase in the standard uncertainty is generally small. –The standard uncertainty of a CRM includes contributions from interlaboratory differences in precision as well as interlaboratory differences in systematic deviations (bias). –For small molecules, expanded uncertainties of CRMs will likely contribute only a minor source of overall (process + measurement + calibration) uncertainty.
Midwest Biopharmaceutical Statistics Workshop, Muncie IN, May 18-20, © 2009 Abbott What Impact Will This Have? For starters, pharmaceutical company personnel will need training on the modern concept of uncertainty estimation. Training materials are available. Workflow analysis of analytical procedures will be required. –Lean Six Sigma opportunity. Documentation will need to be revised. $$$, time estimates are needed.
THE INTERNATIONAL HARMONISED PROTOCOL FOR THE PROFICIENCY TESTING OF (CHEMICAL) ANALYTICAL LABORATORIES INTERNATIONAL UNION OF PURE AND APPLIED CHEMISTRY.
INDUSTRIAL HYGIENE QUALITY CONTROL FOR SAMPLING AND LAB ANALYSIS UNIVERSITY OF HOUSTON - CLEAR LAKE.
Sampling and monitoring the environment Marian Scott Sept 2006.
An Introduction to Quality Assurance in Analytical Science Dr Irene Mueller-Harvey Mr Richard Baker Mr Brian Woodget.
Validation | Slide 1 of 39 August 2006 Validation Supplementary Training Modules on Good Manufacturing Practice WHO Technical Report Series, No. 937, 2006.
Beyond the Basics Jaleh Gholami MD,MPH, PhD candidate Beyond the Basics Jaleh Gholami MD,MPH, PhD candidate.
Module 6: QC Basic Rules and Charts Analysis, Charts and Interpretation of Rules.
Sampling and monitoring the environment-I Marian Scott Sept 2007.
McGraw-Hill/Irwin © The McGraw-Hill Companies 2010 Audit Sampling: An Overview and Application to Tests of Controls Chapter Eight.
Sampling Design & Procedure. Population The aggregate of the all the elements, sharing some common set of characteristics that comprises the universe.
PLANNING THE AUDIT Individual audits must be properly planned to ensure: Appropriate and sufficient evidence is obtained to support the auditors opinion;
Sampling and monitoring the environment Marian Scott March 2009.
1 Benefits Transfer and Meta Analysis Professor Anil Markandya Department of Economics and International Development University of Bath
Sampling and monitoring the environment-I Marian Scott August 2008.
ISO/DIS 9001:2008 versus ISO 9001:2000 August 2008 CER Business Line - Peter Bonnaerens.
Work measurement Part II of Work Study. 2 Introduction Work measurement is the application of techniques designed to establish the time for a qualified.
Last weeks question What is a DEVIATION IQ? In your answer, explain how the deviation IQ differs from the IQ as defined by Stern. What is the advantage.
INDUSTRIAL HYGIENE - PRINCIPLES AND INSTRUMENTATION FOR CALIBRATING AIR SAMPLING EQUIPMENT UNIVERSITY OF HOUSTON - CLEAR LAKE.
Lecture 20 Missing Data and random effect modelling.
An Introduction to Life Cycle Engineering & Costing for Innovative Infrastructure ISIS Educational Module 7: Produced by ISIS Canada.
Course round-up subtitle- Statistical model building Marian Scott University of Glasgow Glasgow, Aug 2012.
Slide 1 Training Session : ITU-T Recommendation L.1420 ITU GREEN STANDARDS WEEK 17–21 September 2012 Paris, France.
Direct Time study: Selecting and timing the job First step in time study is to select the job to be studied. There is always a reason why a particular.
Tsimillis, K.: Accreditation or Certification for Laboratories?© Springer-Verlag Berlin Heidelberg 2003 In: Wenclawiak, Koch, Hadjicostas (eds.) Quality.
Uncertainty and sensitivity analysis- model and measurements Marian Scott and Ron Smith and Clive Anderson University of Glasgow/CEH/University of Sheffield.
Overview of the ANSI/ISA S88.01 Batch Control Standard © 1996.
1 Statistical sampling principles for the environment Marian Scott August 2013.
Learning Objectives 6.1 Explain the importance of mission, vision, and value statement and how they set the foundation for the planning process. 6.2 Describe.
The External Auditors Perspective and use of Internal Audit Brent Currey Live Seminar 9:00am – 4:30pm October 12, 2011 Relationships backed by performance.
© 2016 SlidePlayer.com Inc. All rights reserved.