Biological Variation Data: Time for Development of Standards? Dr William A Bartlett, On behalf of the Biological Variation Working Group, European Federation.

Slides:



Advertisements
Similar presentations
Knowledge and Understanding of the UK and the Wider World.
Advertisements

Ontology Assessment – Proposed Framework and Methodology.
Ninewells Hospital & Medical School
How would you explain the smoking paradox. Smokers fair better after an infarction in hospital than non-smokers. This apparently disagrees with the view.
User verification of performance Zahra Khatami/Robert Hill BHR University Hospitals/Sheffield Teaching Hospitals Focus 2013.
Sample size estimation
David S. Jones School of Pharmacy.  High Academic Background (circa 435 tariff points)  Requirements (AAB or ABB with an A in a fourth AS subject) 
Sources of uncertainty and current practice for addressing them: analytical perspective Roy Macarthur
Dr Bill Bartlett Joint Clinical Director. Diagnostics Group, Biochemical Medicine, Ninewells Hospital & Medical School, NHS Tayside, Scotland, UK.
Designs to Estimate Impacts of MSP Projects with Confidence. Ellen Bobronnikov March 29, 2010.
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Epidemiologic study designs
Sensitivity Analysis for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Kyiv, TRAINING WORKSHOP ON PHARMACEUTICAL QUALITY, GOOD MANUFACTURING PRACTICE & BIOEQUIVALENCE Statistical Considerations for Bioequivalence.
Estimation and Reporting of Heterogeneity of Treatment Effects in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare.
Introduction to Statistics Dr Linda Morgan Clinical Chemistry Division School of Clinical Laboratory Sciences.
Department of Health and Human Services Measuring Clinical Lab Ordering Quality: Theory and Practice Steven M. Asch MD MPH VA, RAND, UCLA April 29, 2005.
THE NEWCASTLE CRITICAL APPRAISAL WORKSHEET
Empirically Assessing End User Software Engineering Techniques Gregg Rothermel Department of Computer Science and Engineering University of Nebraska --
Chemometrics Method comparison
Quality Assessment 2 Quality Control.
Validation of Analytical Method
Are the results valid? Was the validity of the included studies appraised?
Copyright 2008 © Silliker, All Rights Reserved Interpretation of Lab Results What am I buying? What does it mean? What do I do with it?
Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition, or past practice. The importance.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
The Audit Process Tahera Chaudry March Clinical audit A quality improvement process that seeks to improve patient care and outcomes through systematic.
CRITICAL APPRAISAL OF SCIENTIFIC LITERATURE
1 ICEBOH Split-mouth studies and systematic reviews Ian Needleman 1 & Helen Worthington 2 1 Unit of Periodontology UCL Eastman Dental Institute International.
Semester 2: Lecture 9 Analyzing Qualitative Data: Evaluation Research Prepared by: Dr. Lloyd Waller ©
The Scientific Method Formulation of an H ypothesis P lanning an experiment to objectively test the hypothesis Careful observation and collection of D.
The report of the IHF/ICGP/IHF Primary Palliative Care in Ireland outlined the absence of a framework for Primary Care teams to support the delivery of.
EBC course 10 April 2003 Critical Appraisal of the Clinical Literature: The Big Picture Cynthia R. Long, PhD Associate Professor Palmer Center for Chiropractic.
BNPCV APCCB BIOLOGICAL VARIATION FOR N-TERMINAL PRO-BNP Jones GRD 1, Bennett A 2,3, Boscato L 1, Macdonald P 2, Brien J 3. Departments of Chemical.
Critical Appraisal of the Scientific Literature
Clinical Writing for Interventional Cardiologists.
Copyright © Allyn & Bacon 2007 Chapter 2 Research Methods This multimedia product and its contents are protected under copyright law. The following are.
MATERIAL & METHODS SECTION PREPARATION (IN THE HEALTH RESEARCH PROPOSAL) DR. HAYFAA A. WAHBI ASSISTANT PROFESSOR, CHAIR OF EBHC & KT COLLEGE OF MEDICINE.
Statistics & graphics for the laboratory 25 Biological variation Introduction Estimation (ANOVA application) Index-of-individuality Comparison of a result.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
Validation Defination Establishing documentary evidence which provides a high degree of assurance that specification process will consistently produce.
Evidence-Based Practice Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition,
Limit of detection, limit of quantification and limit of blank Elvar Theodorsson.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Instructor Resource Chapter 15 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Writing and presenting a dissertation proposal requires high self-discipline and commitment. Three essential pre-writing actions:  Complete preliminary.
Wenclawiak, B.: Fit for Purpose – A Customers View© Springer-Verlag Berlin Heidelberg 2003 In: Wenclawiak, Koch, Hadjicostas (eds.) Quality Assurance in.
1 AMPS 4 22/ Brussels Discussion Paper As of , Bullet 4 Analytical Methods for Operational and Surveillance Monitoring Of WFD PS.
Margin of Error S-IC.4 Use data from a sample survey to estimate a population mean or proportion; develop a margin of error through the use of simulation.
Measurement Technique A technique was developed for measuring the radioactive concentration of breast milk samples for Tc-99m labelled radiopharmaceuticals.
Confidence Intervals and Hypothesis Testing Mark Dancox Public Health Intelligence Course – Day 3.
Definition of a minimum data set to accompany indices of biological variation. Biological Variation Working Group, European Federation of Clinical Chemistry.
South West Hepatitis C Needs Assessment Dr Maya Gobin Health Protection Services (South West)
SEMINAR ON PRESENTED BY BRAHMABHATT BANSARI K. M. PHARM PART DEPARTMENT OF PHARMACEUTICS AND PHARMACEUTICAL TECHNOLGY L. M. COLLEGE OF PHARMACY.
Home Reading Skoog et al. Fundamental of Analytical Chemistry. Chapters 5 and 6.
Establishing by the laboratory of the functional requirements for uncertainty of measurements of each examination procedure Ioannis Sitaras.
Copyright © 2009 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 47 Critiquing Assessments.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
CHAPTER 8 Estimating with Confidence
Clinical Study Results Publication
AXIS critical Appraisal of cross sectional Studies
Reading Research Papers-A Basic Guide to Critical Analysis
This teaching material has been made freely available by the KEMRI-Wellcome Trust (Kilifi, Kenya). You can freely download,
Projects: Background, Design, Study Population, Exposure & Outcome Presentations start Continue on and
Measuring Data Quality and Compilation of Metadata
Standardised Social Statistics Variables Item 9 of the draft agenda
A proposal for Derivation of Analytical Quality Goal for Precision
STANDARDISATION, HARMONISATION AND TRACEABILITY
Exercise 1 The standard deviation of measurements at low level for a method for detecting benzene in blood is 52 ng/L. What is the Critical Level if we.
Presentation transcript:

Biological Variation Data: Time for Development of Standards? Dr William A Bartlett, On behalf of the Biological Variation Working Group, European Federation of Clinical Chemistry and Laboratory Medicine, Blood Sciences Department, Ninewells Hospital, Dundee Scotland UK DD1 9SY. B ackground Characterization and understanding of the biological components of variation in laboratory data is a fundamental requirement for laboratory medicine specialists. The data are used in the setting of quality standards and in the determination of significance of change in two consecutive results (reference change values (RCV). The characteristics of the data define their utility to providers and users of services, and so methods of data production and other data attributes are of great importance. There are parallels with production and use of reference values as identified by the IFCC and more recently in CLSI guidance. That approach identifies need for characterization of populations studied, methods for production of data, and the statistical treatment of data. The need for this degree of definition is accepted in the context of reference values, but not so in the context of biological variation data (BV). Indiscriminate application of poorly characterized, or produced, BV data leads to delivery of erroneous quality standards and RCVs, and compromises other applications of BV data. It follows that there is a need for standards for production of BV data, standards for reporting of them, and standards for their transmission, since these all impact on their utility and commutability. A working group has been constituted by the EFCCLM to consider the issues. As a first step the group has undertaken work to deliver a checklist to help users and publishers of biological variation data to appraise existing and future studies of biological variation data in a structured way. An outline critical appraisal checklist has been developed to be further validated, and is available for wider consideration, discussion and testing ( The checklist identifies critical factors to be considered, ranging from the need to adequately describe populations studied and the analytical methods used, to the importance of detecting outlying data and appropriate use of statistics. Need for Standardisation and Checklist Biological Variation Data: Applications & factors to be considered in their Generation BV data are Reference Data Requiring Standardisation Proposed Critical Appraisal Checklist: ml Data Archetype: Transmission “ “ Our hope is that the comparability of such data might be provided by use of a common study design and analysis of data” ” Fraser & Harris 1989 Crit Rev in Clin Lab Sci. 1989;27(5) Given that biological variation (BV) data are effectively being used as reference data and that current knowledge of BV indicates a significant number of confounding factors may impact on their quality and utility, it would appear timely to consider the approach to standardising their derivation. Tools also need to be made available to enable objective assessment the veracity of the data. BV data need to be described in terms of method of production, with standards for their reporting and transmission if they are to be applied across geography, populations and time. Publications by Braga et al (Clinica Chimica Acta 2010;411: ) and Miller et al (Clin Chem 2009;55:24-38), reviewing published biological variation data pertaining to haemoglobin A 1c and urinary albumin excretion respectively, highlight the need for critical appraisal of such data. They identified limitations in experimental design used to derive the data, inappropriate study lengths, and poorly description of statistical methods. Differing methodologies with differing analytical characteristics impacted on the biological variation data as do disease states. All of these confounding factors will impact on the commutability of these important data which have an important role in not only derivation of analytical goals and quality standards, but also in assessment of significance of change through definition of reference change values. In Miller’s study 40 publications were cited. The within subject coefficients of variation (CV I ) ranged from 4 to 103%. Thus highlighting an issue. Users of biological variation data need to have an understanding of the uncertainty around these data and standards need to be set for their production, reporting and transmission. The development and validation of a critical appraisal checklist to enable assessment of suitability of data for publication and application is presented here and in more detail at The development of a data archetype that describes the attributes of biological variation will enable commutability of the data and will constitute a basic set of attributes that should be stored against it in biological variation databases. Recently Roraas et al (Clin Chem 2012;58: ) have published and an approach to delivering confidence intervals and power calculations for within-person biological variation. They looked at the effect of analytical imprecision, number of replicates, number of samples, and number of individuals on the estimates. This approach can enable objective assessment of existing published data and provide and aid to future study design. The EFCCLM Biological Variation Working Group is undertaking work to asses the veracity of this checklist and the approach.