Reliability of Screening Tests RELIABILITY: The extent to which the screening test will produce the same or very similar results each time it is administered.

Slides:



Advertisements
Similar presentations
Validity and Reliability of Analytical Tests. Analytical Tests include both: Screening Tests Diagnostic Tests.
Advertisements

SCREENING CHP400: Community Health Program-lI Mohamed M. B. Alnoor
SCID Review Discussion. Decision Matrix Key Questions 1.This is the overarching question for the evidence review: Is there direct evidence that screening.
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
SCREENING FOR DISEASE Nigel Paneth. THREE KEY MEASURES OF VALIDITY 1.SENSITIVITY 2.SPECIFICITY 3.PREDICTIVE VALUE.
1 EPI-820 Evidence-Based Medicine LECTURE 5: SCREENING Mat Reeves BVSc, PhD.
Concept of Measurement
1 Comunicación y Gerencia 18/4/2011Dr Salwa Tayel (Screening) بسم الله الرحمن الرحيم.
Screening. Screening refers to the application of a test to people who are as yet asymptomatic for the purpose of classifying them with respect to their.
Baye’s Rule and Medical Screening Tests. Baye’s Rule Baye’s Rule is used in medicine and epidemiology to calculate the probability that an individual.
Statistics for Health Care
EVIDENCE BASED MEDICINE
Principles of Epidemiology Lecture 12 Dona Schneider, PhD, MPH, FACE
Chronic diseases 1.Chronic diseases have long and variable preclinical phases. 2.The preclinical phase is that portion of the disease natural history during.
Thoughts on Biomarker Discovery and Validation Karla Ballman, Ph.D. Division of Biostatistics October 29, 2007.
(Medical) Diagnostic Testing. The situation Patient presents with symptoms, and is suspected of having some disease. Patient either has the disease or.
Screening Sherine Shawky, MD, Dr.PH Assistant Professor Public Health King Abdulaziz University College of Medicine
Stage-specific survival of screen-detected versus clinically diagnosed colorectal cancer - evidence from the FOBT screening trials- Iris Lansdorp-Vogelaar.
The Nature of Disease.
Multiple Choice Questions for discussion
Screening.
EPIB-591 Screening Jean-François Boivin 29 September
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
Lecture 4: Assessing Diagnostic and Screening Tests
HSS4303B Intro to Epidemiology Feb 4, 2010 – Screening Tests.
Basic statistics 11/09/13.
Principles and Predictive Value of Screening. Objectives Discuss principles of screening Describe elements of screening tests Calculate sensitivity, specificity.
SCREENING Asst. Prof. Sumattna Glangkarn RN, MSc. (Epidemiology), PhD (Nursing studies)
Biostatistics Case Studies Peter D. Christenson Biostatistician Session 2: Diagnostic Classification.
Screening and Diagnostic Testing Sue Lindsay, Ph.D., MSW, MPH Division of Epidemiology and Biostatistics Institute for Public Health San Diego State University.
EBCP. Random vs Systemic error Random error: errors in measurement that lead to measured values being inconsistent when repeated measures are taken. Ie:
1 SCREENING. 2 Why screen? Who wants to screen? n Doctors n Labs n Hospitals n Drug companies n Public n Who doesn’t ?
CHP400: Community Health Program-lI Mohamed M. B. Alnoor Muna M H Diab SCREENING.
· Lecture 31 & 32 : Scope of clinical biochemistry ط Uses of clinical biochemistry tests ط Diagnosis, Prognosis, Screening, Monitoring ط Reporting results.
 Volunteer bias  Lead time bias  Length bias  Stage migration bias  Pseudodisease.
Screening Puja Myles
1 Lecture 6: Descriptive follow-up studies Natural history of disease and prognosis Survival analysis: Kaplan-Meier survival curves Cox proportional hazards.
Prediction statistics Prediction generally True and false, positives and negatives Quality of a prediction Usefulness of a prediction Prediction goes Bayesian.
Screening of diseases Dr Zhian S Ramzi Screening 1 Dr. Zhian S Ramzi.
Principles of Screening
Screening and its Useful Tools Thomas Songer, PhD Basic Epidemiology South Asian Cardiovascular Research Methodology Workshop.
HSS4303B – Intro to Epidemiology Feb 8, Agreement.
Diagnostic Tests Afshin Ostovar Bushehr University of Medical Sciences Bushehr, /7/20151.
1 Wrap up SCREENING TESTS. 2 Screening test The basic tool of a screening program easy to use, rapid and inexpensive. 1.2.
Diagnostic Tests Studies 87/3/2 “How to read a paper” workshop Kamran Yazdani, MD MPH.
Unit 15: Screening. Unit 15 Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
The Diagnostic Process A BRIEF OVERVIEW diagnostic process What is it? to figure out to problem solve method scheme.
Evidence based medicine Diagnostic tests Ross Lawrenson.
10 May Understanding diagnostic tests Evan Sergeant AusVet Animal Health Services.
12/12/2009Dr. Salwa Tayel1 Comunicación y Gerencia.
Screening – a discussion in clinical preventive medicine Galit M Sacajiu MD MPH.
Life expectancy Stuart Harris Public Health Intelligence Analyst Course – Day 3.
Date of download: 5/31/2016 From: Tipping the Balance of Benefits and Harms to Favor Screening Mammography Starting at Age 40 Years: A Comparative Modeling.
© 2010 Jones and Bartlett Publishers, LLC. Chapter 12 Clinical Epidemiology.
Screening Tests: A Review. Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
CHP400: Community Health Program-lI Mohamed M. B. Alnoor Muna M H Diab SCREENING.
DR.FATIMA ALKHALEDY M.B.Ch.B;F.I.C.M.S/C.M
Cancer prevention and early detection
Clinical Epidemiology
Principles of Epidemiology E
Class session 7 Screening, validity, reliability
From: Tipping the Balance of Benefits and Harms to Favor Screening Mammography Starting at Age 40 YearsA Comparative Modeling Study of Risk Ann Intern.
Dr. Tauseef Ismail Assistant Professor Dept of C Med. KGMC
Comunicación y Gerencia
How do we delay disease progress once it has started?
Dr. Hannah Jordan Lecturer in Public Health ScHARR
Interpreting Epidemiologic Results.
PICO model for developing EBM questions
Evidence Based Diagnosis
Presentation transcript:

Reliability of Screening Tests RELIABILITY: The extent to which the screening test will produce the same or very similar results each time it is administered. --- A test must be reliable before it can be valid. --- However, an invalid test can demonstrate high reliability.

Reliability of Screening Tests Sources of variability that can affect the reproducibility of results of a screening test: 1. Biological variation (e.g. blood pressure) 2. Reliability of the instrument itself 3. Intra-observer variability (differences in repeated measurement by the same screener) 4.Inter-observer variability (inconsistency in the way different screeners apply or interpret test results)

Use of Multiple Screening Tests Sequential (two-stage) testing: A less expensive, less invasive, or less uncomfortable test is performed first… those who screen positive are referred for further testing using a test which may have greater sensitivity and specificity… reduces false positives, hence an increase in net specificity.

Use of Multiple Screening Tests Simultaneous testing: Multiple tests are used simultaneously… Person tests “positive” if there is a positive result on any of the tests employed… reduces false negatives, hence an increase in sensitivity … but at the expense of decreased specificity.

Measuring the performance (yield) of a screening test

Performance Yield People with positive screening test results will also test positive on the diagnostic test: Predictive Value Positive (PV+) l People with negative screening test results are actually free of disease Predictive Value Negative (PV-)

Performance Yield a d c b True Disease Status + - Results of Screening Test + - Predictive value positive (PV+): The probability that a person actually has the disease given that he or she tests positive. PV+ =a / (a + b)

Performance Yield a d c b True Disease Status + - Results of Screening Test + - Predictive value negative (PV-): The probability that a person is truly disease free given that he or she tests negative. PV- =d / (c + d)

Performance Yield True Disease Status + - Results of Screening Test + - Sensitivity:a / (a + c) = 400 / ( ) = 80% Specificity:d / (b + d) = / ( ) = 99% PV+:a / (a + b) = 400 / ( ) = 29% PV-:d / (c + d) = / ( ) = 99%

Performance Yield True Disease Status + - Results of Screening Test + - PV+:a / (a + b) = 400 / ( ) = 29% Among persons who screen positive, 29% are found to have the disease.

Performance Yield True Disease Status + - Results of Screening Test + - PV-:d / (c + d) = / ( ) = 99.9% Among persons who screen negative, 99.9% are found to be disease free.

Performance Yield Factors that influence PV+ and PV- 1.The more specific the test, the higher the PV+ 2.The higher the prevalence of preclinical disease in the screened population, the higher the PV+ 3.The more sensitive the test, the higher the PV-

Performance Yield Prevalence (%) Sensitivity Specificity PV % 95% 1.8% 1.090% 95% 15.4% 5.090% 95% 48.6% % 95% 94.7%

Performance Yield Thus, the PV+ is maximized when used in “high risk” populations since the prevalence of pre- clinical disease is higher than in the general population…. screening a total population for a relatively infrequent disease can be very wasteful of resources and may yield few previously undetected cases.

Effectiveness of Screening Evaluating if the screening program reduced morbidity and mortality from the disease: 1.Overall shift in severity of disease at the time of diagnosis. 2.Compare cause-specific mortality from among those whose disease was picked up by screening versus those with a diagnosis related to symptoms.

Effectiveness of Screening Evaluating if the screening program reduced morbidity and mortality from the disease: 3.Reduction in disease-related complications. 4.Improvement of quality of life in screened individuals.

Effectiveness of Screening In reality, establishing the sensitivity and specificity of screening tests may be difficult… often times, data are only available on persons who screen positive and are referred for further testing. ab cd Data are available for cells “a” and “b” only. Permits calculation of PV+ only

Effectiveness of Screening Sources of bias in evaluating screening programs: 1.Self-selection bias (volunteer bias) 2.Lead time bias 3. Length bias 4. Over-diagnosis bias

Effectiveness of Screening 1.Self-selection bias (volunteer bias): ---Volunteers for screening programs may be healthier, on average, than persons who do not participate in screening programs. On the other hand…. ---The “worried well” may be more likely to participate and may be at overall higher risk due to family history or lifestyle characteristics.

Effectiveness of Screening 2.Lead time bias: Lead time: The interval between “diagnosis” of disease at screening and when it would have been detected from clinical symptoms. ---Survival may appear to be increased among screen-detected cases simply because diagnosis was made earlier in the course of the disease.

Effectiveness of Screening 3.Length bias (prognostic selection): ----The overrepresentation among screen- detected cases of those with a long pre- clinical phase, and thus a more favorable prognosis. ---Those with a long pre-clinical phase are more readily detectable by screening than more rapidly progressing cases with a short pre-clinical phase.

Effectiveness of Screening 4.Over-diagnosis bias: ----Persons who screen positive and are truly disease free (false positives), yet are erroneously diagnosed as having the disease. ---Since these persons are truly disease free, we expect a more favorable long- term outcome – giving the appearance of an effective screening program.

Effectiveness of Screening Possible interpretations for null results in a screening program evaluation include: ----The disease has an extremely short detectable pre-clinical phase. ---Current therapeutic intervention is no more effective when provided earlier than at usual time of diagnosis. ---Inadequacies of care provided to those who screen positive.

Effectiveness of Screening Study Designs Used to Evaluate Screening Programs: 1.Ecological Studies 2.Observational Analytic Studies 3.Randomized Trials (infrequent and difficult to carry out)