Lecture 11 BSC 417. Outline More on sensitivity analysis –Spreadsheet on website –Examples and in-class exercise Case analysis Discussion of Eisenberg.

Slides:



Advertisements
Similar presentations
3.2 Environmental transmission of pathogens Where do the pathogens come from? How do pathogens in excreta contaminate the environment? Learning objective:
Advertisements

Infectious Disease Epidemiology EPIET Introductory Course, 2006 Lazareto, Menorca Prepared by: Mike Catchpole, Johan Giesecke, John Edmunds, Bernadette.
1 U.S. EPA and DHS Center of Excellence CAMRA is an interdisciplinary research center established to develop scientific knowledge on the fate and risk.
Kathy Sykes Senior Advisor, US EPA Aging Initiative October 31, 2007 Improving Patient Safety Through Informed Medication Prescribing and Disposal Practices.
How can Modeling Help in Emerging Epidemics? John Grefenstette, PhD Public Health Dynamics Lab Health Policy & Management Pitt Public Health Dec 5, 2014.
Principles of Outbreak Management
Evaluating Whether Interventions on the Use of Antibiotics Work to Decrease Resistance Chris Ford Regina Joice 1/18/08.
Journal Club Alcohol and Health: Current Evidence July-August 2006.
Microbial Risk Assessment Part 2: Dynamic Epidemiology Models of Microbial Risk Envr 133 Mark D. Sobsey Spring, 2006.
Lecture 10 Comparison and Evaluation of Alternative System Designs.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Modeling the SARS epidemic in Hong Kong Dr. Liu Hongjie, Prof. Wong Tze Wai Department of Community & Family Medicine The Chinese University of Hong Kong.
Network modeling of the Ebola Outbreak Ahmet Aksoy.
Evaluate potential limitations with current foodborne illness source attribution estimates obtained from outbreak reports. Neal Golden, Ph.D. January 31.
Epidemiological Study Designs And Measures Of Risks (2) Dr. Khalid El Tohami.
Analysis of Complex Survey Data
Incidence and Prevalence
Study Design and Analysis in Epidemiology: Where does modeling fit? Meaningful Modeling of Epidemiologic Data, 2010 AIMS, Muizenberg, South Africa Steve.
Biology and Control of Giardia and Cryptosporidium Miodrag Belosevic, PhD, FRS(TMH), Department of Biological Sciences University of Alberta.
Cohort Study.
Environmental Risk Analysis
Modeling Menstrual Cycle Length in Pre- and Peri-Menopausal Women Michael Elliott Xiaobi Huang Sioban Harlow University of Michigan School of Public Health.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 7: Gathering Evidence for Practice.
Epidemiology.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
TWO-STAGE CASE-CONTROL STUDIES USING EXPOSURE ESTIMATES FROM A GEOGRAPHICAL INFORMATION SYSTEM Jonas Björk 1 & Ulf Strömberg 2 1 Competence Center for.
Community Health Risk Assessment An Assessment of Risk Related to the Oil and Gas Industry in Garfield County Teresa A. Coons, PhD Senior Scientist Saccomanno.
Health and Disease in Populations 2001 Sources of variation (2) Jane Hutton (Paul Burton)
Informing disease control strategies using stochastic models S.
Epidemiological Study designs
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Smart designs Case control studies FETP India. Competency to be gained from this lecture Design a case control study.
1 The Protocol on Water and Health: making a difference The Protocol on Water and Health: where health, environment, and development policies meet Prof.
This presentation is made available through a Creative Commons Attribution- Noncommercial license. Details of the license and permitted uses are available.
1 An Interim Monitoring Approach for a Small Sample Size Incidence Density Problem By: Shane Rosanbalm Co-author: Dennis Wallace.
Investigation of the Hald model as a method to improve foodborne illness source attribution estimates Antonio Vieira, DVM, MPH, PhD Enteric Diseases Epidemiology.
Tirhani Masia University of Venda South Africa
Is for Epi Epidemiology basics for non-epidemiologists.
Effect of antiviral use on the emergence of resistance to nucleoside analogs in Herpes Simplex Virus, Type 1 Marc Lipsitch, Bruce Levin, Rustom Antia,
PhD We knew nothing about the set-point viral loads. What was unknown about HIV-1 infection before this paper was published in 2007? 1.Virus density.
Case Control Study Dr. Ashry Gad Mohamed MB, ChB, MPH, Dr.P.H. Prof. Of Epidemiology.
Relative Values. Statistical Terms n Mean:  the average of the data  sensitive to outlying data n Median:  the middle of the data  not sensitive to.
Using Models to Assess Microbial Risk: A Case Study CAMRA August 10 th, 2006.
Overview of Study Designs. Study Designs Experimental Randomized Controlled Trial Group Randomized Trial Observational Descriptive Analytical Cross-sectional.
1 Basic epidemiological study designs and its role in measuring disease exposure association M. A. Yushuf Sharker Assistant Scientist Center for Communicable.
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
Environmental Risk Analysis Chapter 6 © 2007 Thomson Learning/South-WesternCallan and Thomas, Environmental Economics and Management, 4e.
Epidemiology. Epidemiological studies involve: –determining etiology of infectious disease –reservoirs of disease –disease transmission –identifying patterns.
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
Part 1d: Exposure Assessment and Modeling Thomas Robins, MD, MPH.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 10 Comparing Two Groups Section 10.1 Categorical Response: Comparing Two Proportions.
Exposure Assessment for Health Effect Studies: Insights from Air Pollution Epidemiology Lianne Sheppard University of Washington Special thanks to Sun-Young.
Instructor Resource Chapter 15 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Epidemiology. Epidemiology involves: –determining etiology of infectious disease –reservoirs of disease –disease transmission –identifying patterns associated.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Statistical Methods. 2 Concepts and Notations Sample unit – the basic landscape unit at which we wish to establish the presence/absence of the species.
Parameter Estimation. Statistics Probability specified inferred Steam engine pump “prediction” “estimation”
Copyright © 2008 Delmar. All rights reserved. Chapter 4 Epidemiology and Public Health Nursing.
Does the brain compute confidence estimates about decisions?
Risk CHARACTERIZATION
1 Water and Health: A Global Perspective Jim Shine Dept. Environmental Health, Harvard School of Public Health.
Evaluation of Microbiological Risks Associated with Direct Potable Reuse (DPR) Water Microbiology Conference 2016 University of North Carolina May 2016.
The Role of Environmental Processes in Infectious Disease Dynamics Andrew Brouwer University of Michigan.
October 4, 2004 Building Steps for Canada’s New Integrated Enteric Pathogen Surveillance Program 12th Annual APHEO Conference October 4, 2004 Niagara Falls,
Sample size calculation
Combined predictor Selection for Multiple Clinical Outcomes Using PHREG Grisell Diaz-Ramirez.
Statistical Data Analysis
Susceptible, Infected, Recovered: the SIR Model of an Epidemic
Biomarkers as Endpoints
Presentation transcript:

Lecture 11 BSC 417

Outline More on sensitivity analysis –Spreadsheet on website –Examples and in-class exercise Case analysis Discussion of Eisenberg et al. (2002) paper Eisenberg presentation on model Translating the model to Stella

Assessing Risk from Environmental Exposure to Waterborne Pathogens: Use of Dynamic, Population-Based Analytical Methods and Models 26 February 2008 The following is based on lecture material prepared by Prof. Joe Eisenberg, formerly of the University of California- Berkeley and now at the University of Michigan Used with his permission

Overview Role of water in disease burden – Water as a route of disease transmission Methods of risk estimation – Direct: intervention trials – Indirect: risk assessment Population-level risks – Example: the Milwaukee outbreak

Importance of Waterborne Pathogens Domestic: U.S. interest in water quality – 1993 Cryptosporidium outbreak – Increasing number of disease outbreaks associated with water – Congressional mandates for water quality – (Safe Drinking Water Act) – Emphasis on risk assessment and regulation

Importance of Waterborne Pathogens Worldwide: WHO interest in water quality – Estimating GBD associated with water, sanitation, and hygiene – Diarrheal diseases are a major cause of childhood death in developing countries. – 3 million of the 12.9 million deaths in children under the age of 5 attributable to diarrheal disease – Emphasis on intervention and control

Pathways of Transmission Person-person – Mediated through fomites (e.g., phone, sink, etc.) – Often associated with hygiene practices Person-environment-person – Mediated through water, food, or soil – Contamination can occur through improper sanitation (example: sewage inflow into drinking water source or lack of latrines) – Animals are often sources (Zoonotic pathogens) – Exposure can occur through improper treatment of food or water

The Disease Transmission Process Risk estimation depends on transmission dynamics and exposure pathways Animals Agricultural Runoff Drinking Water 2° Trans. Recreational Waters or Wastewater reuse Transport to other water sources Food

Approaches to Risk Estimation Direct approach: The intervention trial – Can be used to assess risk from drinking water and recreational water exposures – Problems with sensitivity (sample size issue) – Trials are expensive. Indirect approach: Mathematical models – Must account for properties of infectious disease processes – Pathogen specific models – Uncertainty and variability may make interpretation difficult.

Approaches to Risk Estimation Combining direct and indirect approaches – Models can define the issues and help design studies. – Epidemiology can confirm current model structure and provide insight into how to improve the model.

Approaches for Risk Estimation: Direct estimates of waterborne infectious illnesses Surveillance: count waterborne infectious illnesses – How can a waterborne disease outbreak be distinguished from other outbreak causes (food, fomites, etc.)? – What about endemic disease? Observational – Ecologic studies (e.g., serosurvey comparing communities with and without filtration). – Time series (e.g., correlation between turbidity and hospitalization data)

Approaches for Risk Estimation : Distinguishing waterborne GI disease from other GI diseases Methods for addressing the question – In a single community: a randomized, blinded, placebo-controlled trial – design provides an estimate of the effectiveness of a drinking water intervention. Basic study design: two groups –“Exposed” group = normal tap water. –“Treated” group = use a water treatment device to provide water as pathogen-free as technically possible

Approaches for Risk Estimation: A Tap Water Intervention Trial Enroll 1000 subjects 500 receive an active home water treatment device (and carry drinking water to work, etc. when practical) 500 receive a “placebo” home water drinking device (does nothing to change the water) Follow the subjects for one year with daily logs of GI illness Alternative design: Each household changes device type after 6 months.

Approaches for Risk Estimation : A Tap Water Intervention Trial Placebo group (tap water): – 90 illnesses over course of the study – “Rate” = 90 / 500 Rate in placebo group = 0.18 per person per year Treated group (active device): –60 illnesses in the treated group (active device) –“Rate” = 60 / 500 Rate in treated group = 0.12 per person per year

Approaches for Risk Estimation: Epidemiologic Measures Relative Risk (RR) Incidence in exposed group Incidence in unexposed group Interpretation: the risk of disease in the tap water group is 1.5 times higher than that of the treated group

Approaches for Risk Estimation: Epidemiologic Measures  Attributable Risk (AR) Incidence in exposed – Incidence in unexposed Interpretation: There are 6 excess cases of disease per 100 subjects receiving tap water

Approaches for Risk Estimation: Epidemiologic Measures  Attributable Risk Percent (AR%) Excess cases in exposed Incidence in exposed Interpretation: 33% of the cases of disease in the tap water group are due to water

Approaches for Risk Estimation: Epidemiologic Measures To generalize beyond the cohort, need an estimate of the community incidence. PAR: population attributable risk PAR%: population attributable risk % AR compares completely protected group with completely unprotected group. PAR incorporates intermediate exposure

Approaches for Risk Estimation: Epidemiologic Measures Population attributable risk Incidence in the community – incidence in the unexposed Interpretation: In the community, 2 excess cases of disease per every 100 subjects in the community

Approaches for Risk Estimation: Epidemiologic Measures Population attributable risk percentage Excess cases in the community Incidence in the exposed Interpretation: 14% of the cases of disease in the community are due to tap water

Approaches for Risk Estimation: Tap Water Intervention Trials Trials in immunocompetent populations  Canada (Payment)--challenged surface water – AR = 0.35 (Study 1), (Study 2)  Australia (Fairley)--pristine surface water – No effect  Walnut Creek (UCB) – pilot trial – AR = 0.24 (non-significant effect)  Iowa (UCB)--challenged surface water – No effect Trials in sensitive populations  HIV+ in San Francisco (UCB)--mixed sources  Elderly in Sonoma (UCB)--intermediate quality surface

Approaches for Risk Estimation: Tap Water Intervention Trials Davenport, Iowa study – Comparing sham vs. active groups – AR = cases/10,000/year (CI: -2555, 1825) – Interpretation: No evidence of a significantly elevated drinking water risk – Is the drinking water safe?

Approaches for Risk Estimation: Risk Assessment vs. Intervention Trial Comparing estimates from a risk assessment to randomized trial results (Eienberg et al. AJE, submitted)  Data collected during the intervention trial – Self-report illnesses from participants: Weekly diaries – Source water quality: Cryptosporidium, Giardia, enteric viruses – Drinking water patterns: RDD survey – Water treatment: B. subtilis, somatic coliphage

Approaches for Risk Estimation: Risk Assessment Model

Approaches for Risk Estimation: Risk Assessment Results Overall risk estimate: 14 cases/10,000/yr

Approaches for Risk Estimation: Comparison/Conclusions Table 3. Comparison of risk assessment and intervention trials

Microbial Risk Assessment Two classes of risk assessment models –Individual-based –Population-based Individual-based estimates –Risk estimates assume independence among individuals within the population –Chemical risk paradigm –Focus is on direct risks –Probability of disease for a given individual –This probability can be either daily, yearly, our lifetime.

Microbial Risk Assessment Chemical risk paradigm – Hazard identification, exposure assessment, dose response, risk characterization Model structure where P = probability that a single individual, exposed to N organisms, will become infected or diseased. Exposure calculation:

Microbial Risk Assessment Alternative framework: risk estimates at the population level allow for the inclusion of indirect risks due to secondary transmission Animals Agricultural Runoff Drinking Water 2° Trans. Recreational Waters or Wastewater reuse Transport to other water sources Food

Microbial Risk Assessment Eisenberg et al. AJE 2005 Transmission pathways – Example: a Cryptosporidium outbreak in Milwaukee Wisconsin, 1993 Competing hypotheses on the cause –Oocyst contamination of drinking water influent coupled with treatment failure –Chemical risk paradigm may be sufficient (still need to consider secondary transmission) –Amplification of oocyst concentrations in the drinking water influent due to a person-environment-person transmission process –Chemical risk paradigm cannot address this potential cause of the outbreak

A model of disease transmission: The SIR model Mathematical modeling of a population where individuals fall into three main categories: –Susceptible (S) –Infectious (I) –Recovered (R) Different individuals within this population can be in one of a few key states at any given time –Susceptible to disease (S) –infectious/asymptomatic (I) –infectious/symptomatic (I) –non-infectious/asymptomatic; recovered (R) A dynamic model: individuals are moving from state to state over time

The SIR model: key details There are two sets of variables: Variables describing the states people are in –S=susceptible –I=infectious –R=non-infectious/asymptomatic Variables describing how many people are moving between these states (parameters) –Example: γ=Fraction of people in state R who move to state S

S: Susceptible I: Infectious (symptomatic+asymptomatic) R: Non-infectious W: Concentration of pathogens in the environment β: Infection rate due to exposure to pathogen δ: Fraction of people who move from state I to state R γ : Fraction of people who move from state R to state S Solid lines: Individuals moving from state to state Dashed lines: Pathogen flows between individuals in different states The SIR Model ENVIRONMENT W SR    I

The SIR Model: slightly different version  The variables X: susceptible Y: infectious/asymptomatic Z: non-infectious/asymptomatic D: infectious/symptomatic W: concentration of pathogens at the source a: number of new susceptible individuals migrating in δ+μδ+μ W X Z  0 +  (W) (ρ)(ρ) D ρ σ Y λ a μ

The SIR Model: slightly different version (cont) The parameters ρ: fraction in state Y who move to state D α: Fraction in state Y who move to state Z σ: Fraction in state D who move to state Z γ: Fraction in state Z who move to state X δ: Fraction in state D who die μ: Fraction who die of natural causes λ: Numbers of pathogen shed per infectious/asymptomatic individual β 0 : Baseline transmission rate β : Infection rate due to pathogen δ+μδ+μ W X Z  0 +  (W)  (ρ)(ρ) D ρ σ Y λ a μ

Dynamic Modeling of Disease Transmission: an example Remember: a derivative is a rate of change X= the population of individuals susceptible to a disease dX/dt = rate of change in the susceptible population The equation describes individuals moving in and out of the susceptible population Each variable represents some number of individuals moving –into the susceptible population (+) from some other group, –out of the susceptible population (-) to some other group

Dynamic Modeling of Disease Transmission: an example a= number of susceptible individuals migrating into the population γZ =number of non-infectious/asymptomatic individuals migrating back into the susceptible population μX =Fraction of susceptible individuals who drop out of the susceptible population because they die of natural causes β 0 X =number of susceptible individuals who become infected and drop out of the susceptible population β(W)X =number of susceptible people becoming ill due to pathogen exposure and drop out of the susceptible population

Analysis of Disease Transmission Models Traditional approaches to evaluating dynamics models are qualitative – Stability analysis, threshold estimates (Ro), qualitative fits – Statistics rarely used to analyze output Methodological goal to obtain public health relevant estimates of the outbreak – Need to modify traditional statistical techniques to address models with large number of parameters, sparse data, and collinearity

Analysis of Disease Transmission Models Likelihood  Traditional likelihood methods – Difficult to find maximum likelihood point in highly parameterized models. – Confidence intervals are often not possible in complex likelihood spaces  Profile likelihood is an alternative option – Fix a subset of the parameters across a grid of values. – At each point in the grid the remaining parameters are maximized. Bayesian techniques  Practical for combining outbreak data with existing information about parameters.  Modifications required to deal with collinearities

Model 1 Goals:  To examine the role of person-person (secondary) transmission  To estimate the fraction of outbreak cases associated with person-person (secondary) transmission

Cryptosporidium Outbreak - Model Diagram S(t) Susceptible E1E1 E2E2 EkEk I A (t) Infectious (asymptomatic) R(t) Removed W(t) Environmental Transmission... Latently Infected I S (t) Infectious (symptomatic)  +  S       S: Susceptible W: Concentration of Pathogens in the Environment I S : Symptomatic and Infectious I A : Asymptomatic and Infectious R: Immune/ Partially Protected Solid: Individual Flows from State to State Dashed: Pathogen Flows

Analysis - Model 1 Monte Carlo Markov Chain (MCMC) was used to generate a posterior distribution.  Two step procedure was used to address collinearities of the parameter estimates – MCMC at profiled points – Second MCMC on draws from first MCMC  Cumulative incidence, I 1, was produced by a random draw of the posterior  Cumulative incidence, I 0, was produced by first setting b s =0 then obtaining a random draw of the posterior.  The attributable risk associated with secondary transmission was I 1 - I 0

Risk Attributable to Secondary Transmission 10%, 95% CI [6, 21]

Model 2 Goal:  To examine the role of person- environment-person transmission  To estimate the preventable fraction due to an increase in distance between wastewater outlet and drinking water inlet  Examine preventable fraction as a function of transport time parameter, d – Where d is a surrogate for the potential intervention of moving the drinking water inlet farther from the wastewater outlet

Cryptosporidium Outbreak- Model Diagram S(t) Susceptible E1E1 E2E2 EkEk I A (t) Infectious (asymptomatic) R(t) Removed W(t) Environmental Transmission... Latently Infected I S (t) Infectious (symptomatic)  +  S       S: Susceptible W: Concentration of Pathogens in the Environment I S : Symptomatic and Infectious I A : Asymptomatic and Infectious R: Immune/ Partially Protected Solid: Individual Flows from State to State Dashed: Pathogen Flows

Analysis - Model 2 Estimate the likelihood for different values of d, ranging from days. Estimate the attack rate (AR) for the MLE parameters Estimate the AR for different values of d, keeping all other parameters constant at their MLE values. Plot PF d = 1 - AR MLE / AR d

Profile Likelihood of the Delay Parameter MLE for the time between contamination of sewage and exposure from drinking water tap was 11 days (95% CI [8.3, 19])

Preventable Fraction As a Function of Delay Time Predicting the public health benefits of moving the drinking water inlet

Conclusions Secondary transmission was small. – Best guess is 10%, most likely less than 21% – Consistent with empirical findings of McKenzie et al. – Kinetics of the outbreak in Milwaukee were too quick to be driven solely by secondary transmission

Conclusions Person-water-person transmission as the main infection pathway has not been well studied – Few data exist that examines person- water-person transmission – Studies have demonstrated a correlation between cases of specific viral serotypes in humans and in sewage – Provides information on a potentially important environmental intervention

Conclusions: Methods Analyzing disease transmission models using statistical techniques  Allows inferences about parameters that are interesting and relevant – Can get at posterior distribution that allows for calculation of relevant public health measures  Requires the modification of existing techniques – Profile likelihood to deal with large numbers of parameters – Bayesian estimation techniques to address the co-linearity.

Conclusions Risk assessments should use models that can integrate relevant information  Health data – Epidemiology – Basic biology  Environmental data – Water quality – Fate and transport  Need a population perspective – Model-based approach