Presentation on theme: "Dr Bill Bartlett Joint Clinical Director. Diagnostics Group, Biochemical Medicine, Ninewells Hospital & Medical School, NHS Tayside, Scotland, UK."— Presentation transcript:
Dr Bill Bartlett Joint Clinical Director. Diagnostics Group, Biochemical Medicine, Ninewells Hospital & Medical School, NHS Tayside, Scotland, UK.
Analytical variance (CV A ). Within Subject biological variance (CV I ). Between Subject biological variance (CV G ). Total = Analytical + Individual + Gro CV Total = CV A + CV l + CV G
Biological Variation Serum Creatinine: Average within subject (CVI) = 4.1% Gowans & Fraser. Ann Clin Biochem 1988:25:
Setting of analytical goals (CV goal ). Quality specifications for : total allowable error (TE A ) Bias (B A ) Evaluating the significance of change in serial results (RCV). Assessing the utility of reference intervals (Index of Individuality). Assessing number of specimens required to estimate homeostatic set points. Choice of specimen type. Timing of specimens.
eGFR > 60 in a 30 year old white female: Changing renal function?
These fundamental data have many applications that under-pin our practice! Rodin’s Thinker Burrell Collection Glasgow Are These Not Reference Data? Do we have confidence in the data and understand their limitations?
Are current published biological variation data fit for purpose?
Are these data valid and robust? Confidence in method of their production and analysis. Contemporaneously valid. Can I apply them to my practice? Population Demographic Diseased v Well Method Time Frame What are the implications of error
Grasbeck & Saris 1969 Introduced the term “reference value”: The mode of generation of such values is known with respect to: - Selection of subjects Assessment of state of health Population characteristics, age, sex, Specimen collection and storage Analytical technique and performance characteristics Data handling techniques.
40 years of data Do the data travel through timeDo the data travel through time Method developmentsMethod developmentsQuality Enough reported detail.Enough reported detail. Good Design?Good Design? Commutable Population demographics.Population demographics. Healthy?Healthy? DiseasedDiseased? Translated into databases Excellent ResourcesExcellent Resources Granular enough?Granular enough? Data archetype required?Data archetype required? The Literature 319 Constituents: 90 entries based on 1 Paper 90 entries based on 1 Paper
66 quantities 34 diseases with 45 references. “For the majority of quantities studied CV I of same order as diseased. “ Disease specific RCVs may be necessary in some cases. Effect of variability in variability not quantitatively studied. “Heterogeneity in study designs and methods compiled”
What is the uncertainty? What are the quality standards for BV Data? Assay Characteristics Data Analysis Experimental Design Data Quality?
Experimental Design Data Analysis Standard for Production Enable Critical Appraisal Enable Commutability Standard for Reporting Data Archetype? Commutability & Valid Application Standard for Transmission
Our hope is that the comparability of such data might be provided by use of a common study design and analysis of data “ Our hope is that the comparability of such data might be provided by use of a common study design and analysis of data ” Fraser & Harris 1989 Crit Rev in Clin Lab Sci. 1989;27(5)
Generation and Application of data on Biological Variation in Clinical Chemistry: - Fraser CG, Harris EK. Crit Rev Clin Lab Sci 1989:27,(5), Optimal Conditions Precision
Purpose of study Experimental Design Characterisation of the methods Data analysis Confidence limits
1. Define the purpose for which they are to be used. 2. Only meaningful and transferable if defined for the population or individual in terms of: - Inclusion and exclusion criteria Intake of food & drugs Physiological and environmental conditions Specimen collection criteria Performance characteristics of the analytical method The statistical methods used for estimation of the limits
CV I 4% to 103% with central tertile 28% to 48% 40 studies with confounding factors: - Time period over which samples were collected Study design Type of sample and concentration range studied Population studied and state of health Preanalytical factors Poorly described statistical methods
Braga et al Clinica Chimica Acta 2010;411: Highlights the need for this approach “Nine recruited studies were limited by choice of analytic methodology, population selection, protocol application and statistical analysis” Issues: - Heterogeneity in experimental model Length of study inappropriate (3 days to 6 months) Methods with differing specificities Statistical methods not specified
These data have associated metadata that should remain associated with them to enable appropriate application. Enable comutability Analogous to a reference value. Concept of Archetypes may be relevant
BV Data Population Demographic Measurement SNOMED-LOINC Disease SNOMED Published Reference PUBMED Method
C-Terminal RIA 1970’s Development of IRMA assays 1980’s Nichols institute Ruled the world Range of other intact assays with antibodies against a variety of epitopes 1990’s Bioactive PTH Assays with n-terminal specific antibodies 2004 PTH Assays through time
If clearance of fragments is not identical in all patients and non diseased patients the apparent biological variation will vary and be assay specific. Assay specificity is an important BV qualifier Historical data may not be always applicable.
StudyYearSubjects(M:F) State of Health Frequency of Sampling Number of Samples Method (6:4)Healthy7 D IE (?)Diabetic3-4 D6Endosmosis (?)Diabetic1 M & 3 M4Affin Chrom (?)Diabetic3 M & 12 M?HPLC IE (7:5)Healthy15 D10HPLC IE (0:11)Healthy7 D5HPLC IE (?)Diabetic6 M 4 - 7Imm Turbid (45:0)Diabetic7 D12HPLC Affin (24:14) a Diabetic1 Y5HPLC IE
Stud y CV I CV G Analytical Goal Desirable TE A (%) Bias Target RCV N for Homeostatic Setting point 1 H D D 4.2 & & & & 10 4D H H <0.7< D 7.9,5.4, ,2.7, ,16.7, ,6,3 8D 1.7 b 0.8 9D H = Healthy D = Diabetic
Jaffe methods Enzymatic methods HPLC ID-MS – reference method Review of the sedimentation process which is caused in normal urine by picric acid and a new reaction of creatinine By M. Jaffe (Submitted to the editor on 26th June 1886)
Many points of reference. International Standards
State of Health CV I Number of Subjects Length of Studies (days) Number Samples/Sub Healthy Median? CRF Type 1 DM Impaired renal function Type 1 DM Post renal transplant Acute MI CKD children Ricos et al Ann Clin Biochem 2007;44:
QuantityUnitsGroupMeanCV I CV G Index of Individuality Serum Creatinine µmol/LMale (7) Fraser µmol/LFemale (8) Fraser * µmol/L * Whole (15) Fraser µmol/L?? BioV Site ** µmol/L ** N= 20 Male (7) Female(13) Reinhard et al * Jaffe ** Enzymatic
CV I = 5.3 % CV G = 14.2%CV A =2.7%
Route Forward? variation.com
Need to assess on a case by case basis. Need to assess on a case by case basis. Questions around uncertainty. Questions around uncertainty. What are the implications for their application? What are the implications for their application? Can the impact of uncertainty be quantified and reduced where necessary. Can the impact of uncertainty be quantified and reduced where necessary. Accepted standard needed for their production. Accepted standard needed for their production. Critical appraisal checklist required to enable veracity of existing and new publications to be established. Critical appraisal checklist required to enable veracity of existing and new publications to be established. Archetype for transmission. Archetype for transmission. Questions to be addressed by the EFCC biological Variation Working group