Dr Bill Bartlett Joint Clinical Director. Diagnostics Group, Biochemical Medicine, Ninewells Hospital & Medical School, NHS Tayside, Scotland, UK.

Slides:



Advertisements
Similar presentations
Regulation of Consumer Tests in California AAAS Meeting June 1-2, 2009 Beatrice OKeefe Acting Chief, Laboratory Field Services California Department of.
Advertisements

Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?
Ninewells Hospital & Medical School
Integrating the gender aspects in research and promoting the participation of women in Life Sciences, Genomics and Biotechnology for Health.
Are biological variation data fit for puRpose?
Biological Variation Data: Time for Development of Standards? Dr William A Bartlett, On behalf of the Biological Variation Working Group, European Federation.
Exploring uncertainty in cost effectiveness analysis NICE International and HITAP copyright © 2013 Francis Ruiz NICE International (acknowledgements to:
CLINICAL CHEMISTRY (MLT 301) NONPROTEIN NITROGEN (NPN) LECTURE ONE
8. Evidence-based management Step 3: Critical appraisal of studies
Beyond Null Hypothesis Testing Supplementary Statistical Techniques.
Estimation of Sample Size
THE NEWCASTLE CRITICAL APPRAISAL WORKSHEET
SAMPLE SIZE ESTIMATION
Summary 1 l The Analytical Problem l Data Handling.
Common Problems in Writing Statistical Plan of Clinical Trial Protocol Liying XU CCTER CUHK.
Quality Assurance.
The following lecture has been approved for University Undergraduate Students This lecture may contain information, ideas, concepts and discursive anecdotes.
By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.
Quantitative Genetics
Selection of Data Sources for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
EVIDENCE BASED MEDICINE
Performance of Community- based Management of Acute Malnutrition programme and its impact on nutritional status of children under five years of age in.
Quality Assurance / Quality Control
Chemometrics Method comparison
Creatinine and the eGFR Graham Jones Department of Chemical Pathology St Vincent’s Hospital, Sydney AACB-AIMS Annual Scientific meeting Hobart 2006.
1. Dr. Adel M. Assiri Faculty of Medicine Department of Biochemistry Umm Al-Qura University.
Are the results valid? Was the validity of the included studies appraised?
Performing the Study Data Collection
RESEARCH A systematic quest for undiscovered truth A way of thinking
Analytical Goals. Valid data are essential in making medical decisions, the most important concepts used in judging analytical performance :- 1)Analytical.
Influence of Analytical Bias and Imprecision on Guideline-Driven Medical Decision Limits Per Hyltoft Petersen Hyltoft Petersen P, Klee GG. Influence of.
Program Evaluation. Program evaluation Methodological techniques of the social sciences social policy public welfare administration.
Research Synthesis of Population-Based Prevalence Studies ORC Macro Benita J. O’Colmain, M.P.H. Wanda Parham, M.P.A. Arlen Rosenthal, M.A. Adrienne Y.
Cross-sectional study
Populations, Samples, Standard errors, confidence intervals Dr. Omar Al Jadaan.
Biostatistics: Measures of Central Tendency and Variance in Medical Laboratory Settings Module 5 1.
Prof. of Clinical Chemistry, Mansoura University.
Literature searching & critical appraisal Chihaya Koriyama August 15, 2011 (Lecture 2)
BNPCV APCCB BIOLOGICAL VARIATION FOR N-TERMINAL PRO-BNP Jones GRD 1, Bennett A 2,3, Boscato L 1, Macdonald P 2, Brien J 3. Departments of Chemical.
Copyright  2003 by Dr. Gallimore, Wright State University Department of Biomedical, Industrial Engineering & Human Factors Engineering Human Factors Research.
Determination of Sample Size: A Review of Statistical Theory
· Lecture 31 & 32 : Scope of clinical biochemistry ط Uses of clinical biochemistry tests ط Diagnosis, Prognosis, Screening, Monitoring ط Reporting results.
Evaluation of the Presage™ ST2 ELISA Jun Lu 1, David G. Grenache 1,2 1 ARUP Institute for Clinical and Experimental Pathology, Salt Lake City, UT 2 Department.
Statistics & graphics for the laboratory 25 Biological variation Introduction Estimation (ANOVA application) Index-of-individuality Comparison of a result.
Performance criteria or ”quality specifications” Gunnar Nordin Dubrovnik Course in Zagreb 2015.
Critical Appraisal (CA) I Prepared by Dr. Hoda Abd El Azim.
VERIFICATION OF REFERENCE INTERVALS GIAN LUCA SALVAGNO, MD, PhD University of Verona, Italy.
Quality control & Statistics. Definition: it is the science of gathering, analyzing, interpreting and representing data. Example: introduction a new test.
Chapter 2 What is Evidence?. Objectives Discuss the concept of “best available clinical evidence.” Describe the general content and procedural characteristics.
Advanced Residual Analysis Techniques for Model Selection A.Murari 1, D.Mazon 2, J.Vega 3, P.Gaudio 4, M.Gelfusa 4, A.Grognu 5, I.Lupelli 4, M.Odstrcil.
Quality Control: Analysis Of Data Pawan Angra MS Division of Laboratory Systems Public Health Practice Program Office Centers for Disease Control and.
Hemoglobin Device Regulation Josephine Bautista, M.S., MT (ASCP) Senior Advisor for IVD Regulation DRB/DBA/OBRR/CBER Workshop: Hemoglobin standards and.
Unit 11: Evaluating Epidemiologic Literature. Unit 11 Learning Objectives: 1. Recognize uniform guidelines used in preparing manuscripts for publication.
© The Strategic Projects Team Hosted by the Greater East Midlands Commissioning Support Unit National Pathology Programme Standardisation and Harmonisation.
Evidence Based Practice (EBP) Riphah College of Rehabilitation Sciences(RCRS) Riphah International University Islamabad.
Definition of a minimum data set to accompany indices of biological variation. Biological Variation Working Group, European Federation of Clinical Chemistry.
Research proposal (Lecture 3) Dr.Rehab F Gwada. Objectives of the Lecture The student at the end of this lecture should Know Identify Target Population.
Table 1. Methodological Evaluation of Observational Research (MORE) – observational studies of incidence or prevalence of chronic diseases Tatyana Shamliyan.
Understanding Populations & Samples
Josiane Arnaud1, Jean-Philippe Weber2,
To compare demographic and clinical characteristics of those with and without diabetes that undergo a lower extremity amputation in Glasgow, UK Fiona.
Critical Reading of Clinical Study Results
Reading Research Papers-A Basic Guide to Critical Analysis
Literature searching & critical appraisal
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
USE OF CLINICAL LABORATORY
A proposal for Derivation of Analytical Quality Goal for Precision
USE OF CLINICAL LABORATORY
STEPS Site Report.
Presentation transcript:

Dr Bill Bartlett Joint Clinical Director. Diagnostics Group, Biochemical Medicine, Ninewells Hospital & Medical School, NHS Tayside, Scotland, UK.

 Analytical variance (CV A ).  Within Subject biological variance (CV I ).  Between Subject biological variance (CV G ).   Total =   Analytical +   Individual +   Gro CV Total = CV A + CV l + CV G

Biological Variation Serum Creatinine: Average within subject (CVI) = 4.1% Gowans & Fraser. Ann Clin Biochem 1988:25:

 Setting of analytical goals (CV goal ).  Quality specifications for :  total allowable error (TE A )  Bias (B A )  Evaluating the significance of change in serial results (RCV).  Assessing the utility of reference intervals (Index of Individuality).  Assessing number of specimens required to estimate homeostatic set points.  Choice of specimen type.  Timing of specimens.

eGFR > 60 in a 30 year old white female: Changing renal function?

These fundamental data have many applications that under-pin our practice! Rodin’s Thinker Burrell Collection Glasgow Are These Not Reference Data? Do we have confidence in the data and understand their limitations?

Are current published biological variation data fit for purpose?

 Are these data valid and robust?  Confidence in method of their production and analysis.  Contemporaneously valid.  Can I apply them to my practice?  Population  Demographic  Diseased v Well  Method  Time Frame  What are the implications of error

Grasbeck & Saris 1969 Introduced the term “reference value”: The mode of generation of such values is known with respect to: -  Selection of subjects  Assessment of state of health  Population characteristics, age, sex,  Specimen collection and storage  Analytical technique and performance characteristics  Data handling techniques.

40 years of data Do the data travel through timeDo the data travel through time Method developmentsMethod developmentsQuality Enough reported detail.Enough reported detail. Good Design?Good Design? Commutable Population demographics.Population demographics. Healthy?Healthy? DiseasedDiseased? Translated into databases Excellent ResourcesExcellent Resources Granular enough?Granular enough? Data archetype required?Data archetype required? The Literature 319 Constituents: 90 entries based on 1 Paper 90 entries based on 1 Paper

 66 quantities 34 diseases with 45 references.  “For the majority of quantities studied CV I of same order as diseased. “  Disease specific RCVs may be necessary in some cases.  Effect of variability in variability not quantitatively studied.  “Heterogeneity in study designs and methods compiled”

What is the uncertainty? What are the quality standards for BV Data? Assay Characteristics Data Analysis Experimental Design Data Quality?

Experimental Design Data Analysis Standard for Production Enable Critical Appraisal Enable Commutability Standard for Reporting Data Archetype? Commutability & Valid Application Standard for Transmission

Our hope is that the comparability of such data might be provided by use of a common study design and analysis of data “ Our hope is that the comparability of such data might be provided by use of a common study design and analysis of data ” Fraser & Harris 1989 Crit Rev in Clin Lab Sci. 1989;27(5)

Generation and Application of data on Biological Variation in Clinical Chemistry: - Fraser CG, Harris EK. Crit Rev Clin Lab Sci 1989:27,(5), Optimal Conditions Precision

 Purpose of study  Experimental Design  Characterisation of the methods  Data analysis  Confidence limits

1. Define the purpose for which they are to be used. 2. Only meaningful and transferable if defined for the population or individual in terms of: -  Inclusion and exclusion criteria  Intake of food & drugs  Physiological and environmental conditions  Specimen collection criteria  Performance characteristics of the analytical method  The statistical methods used for estimation of the limits

CV I 4% to 103% with central tertile 28% to 48% 40 studies with confounding factors: -  Time period over which samples were collected  Study design  Type of sample and concentration range studied  Population studied and state of health  Preanalytical factors  Poorly described statistical methods

Braga et al Clinica Chimica Acta 2010;411:  Highlights the need for this approach “Nine recruited studies were limited by choice of analytic methodology, population selection, protocol application and statistical analysis” Issues: -  Heterogeneity in experimental model  Length of study inappropriate (3 days to 6 months)  Methods with differing specificities  Statistical methods not specified

 These data have associated metadata that should remain associated with them to enable appropriate application.  Enable comutability  Analogous to a reference value.  Concept of Archetypes may be relevant

BV Data Population Demographic Measurement SNOMED-LOINC Disease SNOMED Published Reference PUBMED Method

ISSUES  Non-complex v complex molecules.  Relativity of normality.  Improved assay specificity.  HbA1c  PTH  Creatinine

 Data in chronic stable disease “often can be considered constant over time and geography”  “Same order of magnitude in disease and health”

Within Subject Variation (CV I,%) for Serum Sodium and Urea No. ofTimeSexstatusNa + Urea subjects subjects hmH hmH dH weeksmH weeksmH weeksFH weeksmH weeksmH months-H weeks-H d-RF weeksFHP weeksmDM Fraser 2001

C-Terminal RIA 1970’s Development of IRMA assays 1980’s Nichols institute Ruled the world Range of other intact assays with antibodies against a variety of epitopes 1990’s Bioactive PTH Assays with n-terminal specific antibodies 2004 PTH Assays through time

 If clearance of fragments is not identical in all patients and non diseased patients the apparent biological variation will vary and be assay specific.  Assay specificity is an important BV qualifier  Historical data may not be always applicable.

StudyYearSubjects(M:F) State of Health Frequency of Sampling Number of Samples Method (6:4)Healthy7 D IE (?)Diabetic3-4 D6Endosmosis (?)Diabetic1 M & 3 M4Affin Chrom (?)Diabetic3 M & 12 M?HPLC IE (7:5)Healthy15 D10HPLC IE (0:11)Healthy7 D5HPLC IE (?)Diabetic6 M 4 - 7Imm Turbid (45:0)Diabetic7 D12HPLC Affin (24:14) a Diabetic1 Y5HPLC IE

Stud y CV I CV G Analytical Goal Desirable TE A (%) Bias Target RCV N for Homeostatic Setting point 1 H D D 4.2 & & & & 10 4D H H <0.7< D 7.9,5.4, ,2.7, ,16.7, ,6,3 8D 1.7 b 0.8 9D H = Healthy D = Diabetic

 Jaffe methods  Enzymatic methods  HPLC  ID-MS – reference method Review of the sedimentation process which is caused in normal urine by picric acid and a new reaction of creatinine By M. Jaffe (Submitted to the editor on 26th June 1886)

 Many points of reference.  International Standards

State of Health CV I Number of Subjects Length of Studies (days) Number Samples/Sub Healthy Median? CRF Type 1 DM Impaired renal function Type 1 DM Post renal transplant Acute MI CKD children Ricos et al Ann Clin Biochem 2007;44:

QuantityUnitsGroupMeanCV I CV G Index of Individuality Serum Creatinine µmol/LMale (7) Fraser µmol/LFemale (8) Fraser * µmol/L * Whole (15) Fraser µmol/L?? BioV Site ** µmol/L ** N= 20 Male (7) Female(13) Reinhard et al * Jaffe ** Enzymatic

CV I = 5.3 % CV G = 14.2%CV A =2.7%

MFG

Route Forward? variation.com

Need to assess on a case by case basis. Need to assess on a case by case basis. Questions around uncertainty. Questions around uncertainty. What are the implications for their application? What are the implications for their application? Can the impact of uncertainty be quantified and reduced where necessary. Can the impact of uncertainty be quantified and reduced where necessary. Accepted standard needed for their production. Accepted standard needed for their production. Critical appraisal checklist required to enable veracity of existing and new publications to be established. Critical appraisal checklist required to enable veracity of existing and new publications to be established. Archetype for transmission. Archetype for transmission. Questions to be addressed by the EFCC biological Variation Working group

Kinoull Hill, Perth Scotland. © Ruth Bartlett