1 Hierarchical Models for Quantifying Uncertainty in Human Health Risk/Safety Assessment Ralph L. Kodell, Ph.D. Department of Biostatistics University.

Slides:



Advertisements
Similar presentations
1 Case Studies in Modeling and Simulation Discussion Stella G. Machado, Ph.D. Office of Biostatistics/OTS/CDER/FDA FDA/Industry Workshop, September 2006.
Advertisements

Presentation title Date Responder endpoint and continuous endpoint, logistic regression or ANOVA? DSBS 24 OCT 2013 Søren Andersen.
1 The “Straw Man” System for Defining the RfD as a Risk-Specific Dose Making Use of Empirical Distributions Dale Hattis, Meghan Lynch, Sue Greco Clark.
Introduction to Regression with Measurement Error STA431: Spring 2015.
BPS - 5th Ed. Chapter 241 One-Way Analysis of Variance: Comparing Several Means.
Regulatory Toxicology James Swenberg, D.V.M., Ph.D.
National Institute for Public Health and the Environment 1 Integrated probabilistic risk assessment Bas Bokkers National Institute for Public Health and.
Southwest Research Institute, San Antonio, Texas A Framework to Estimate Uncertain Random Variables Luc Huyse and Ben H. Thacker Reliability and Materials.
An Introduction to Stochastic Reserve Analysis Gerald Kirschner, FCAS, MAAA Deloitte Consulting Casualty Loss Reserve Seminar September 2004.
CS 589 Information Risk Management 6 February 2007.
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Topic 3: Regression.
G. Cowan Lectures on Statistical Data Analysis Lecture 14 page 1 Statistical Data Analysis: Lecture 14 1Probability, Bayes’ theorem 2Random variables and.
1 Issues in Harmonizing Methods for Risk Assessment Kenny S. Crump Louisiana Tech University
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
1 BA 555 Practical Business Analysis Review of Statistics Confidence Interval Estimation Hypothesis Testing Linear Regression Analysis Introduction Case.
Introduction to Regression with Measurement Error STA431: Spring 2013.
Scot Exec Course Nov/Dec 04 Ambitious title? Confidence intervals, design effects and significance tests for surveys. How to calculate sample numbers when.
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
1 Model Averaging: Beyond Model Uncertainty in Risk Analysis * Matthew W. Wheeler NIOSH *The findings and conclusions in this report are.
Environmental Risk Analysis
Copyright © 2010 Lumina Decision Systems, Inc. Statistical Hypothesis Testing (8 th Session in “Gentle Introduction to Modeling Uncertainty”) Lonnie Chrisman,
Lynn H. Pottenger, PhD, DABT The Dow Chemical Company
Committee on Carcinogenicity (COC) Approach to Risk Assessment of Genotoxic Carcinogens David H. Phillips* COC Chairman Descriptive vs. Quantitative.
Introduction to Regression with Measurement Error STA302: Fall/Winter 2013.
1 A Presentation of ‘Bayesian Models for Gene Expression With DNA Microarray Data’ by Ibrahim, Chen, and Gray Presentation By Lara DePadilla.
Statistics: Unlocking the Power of Data Lock 5 Synthesis STAT 250 Dr. Kari Lock Morgan SECTIONS 4.4, 4.5 Connecting bootstrapping and randomization (4.4)
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Sampling and Confidence Interval
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
A Beginner’s Guide to Bayesian Modelling Peter England, PhD EMB GIRO 2002.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
University of Ottawa - Bio 4118 – Applied Biostatistics © Antoine Morin and Scott Findlay 08/10/ :23 PM 1 Some basic statistical concepts, statistics.
Two Approaches to Calculating Correlated Reserve Indications Across Multiple Lines of Business Gerald Kirschner Classic Solutions Casualty Loss Reserve.
St5219: Bayesian hierarchical modelling lecture 2.1.
Estimating Incremental Cost- Effectiveness Ratios from Cluster Randomized Intervention Trials M. Ashraf Chaudhary & M. Shoukri.
Animal Studies and Human Health Consequences Sorell L. Schwartz, Ph.D. Department of Pharmacology Georgetown University Medical Center.
Testing Models on Simulated Data Presented at the Casualty Loss Reserve Seminar September 19, 2008 Glenn Meyers, FCAS, PhD ISO Innovative Analytics.
Risk Assessment Nov 7, 2008 Timbrell 3 rd Edn pp Casarett & Doull 7 th Edn Chapter 7 (pp )
Why Model? Make predictions or forecasts where we don’t have data.
Metabolomics Metabolome Reflects the State of the Cell, Organ or Organism Change in the metabolome is a direct consequence of protein activity changes.
Maximum Likelihood - "Frequentist" inference x 1,x 2,....,x n ~ iid N( ,  2 ) Joint pdf for the whole random sample Maximum likelihood estimates.
P2-78: Generic Modeling Approach for Quantitative Microbial Risk Assessment Thomas P. Oscar, USDA, ARS/1890 Center of Excellence in Poultry Food Safety.
Determining Risks to Background Arsenic Using a Margin – of – Exposure Approach Presentation at Society of Risk Analysis, New England Chapter Barbara D.
ENGM 620: Quality Management Session 8 – 30 October 2012 Process Capability.
1 Modeling and Estimation of Benchmark Dose (BMD) for Binary Response Data Wei Xiong.
1 METHODS FOR DETERMINING SIMILARITY OF EXPOSURE-RESPONSE BETWEEN PEDIATRIC AND ADULT POPULATIONS Stella G. Machado, Ph.D. Quantitative Methods and Research.
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
Statistics: Unlocking the Power of Data Lock 5 Inference for Means STAT 250 Dr. Kari Lock Morgan Sections 6.4, 6.5, 6.6, 6.10, 6.11, 6.12, 6.13 t-distribution.
SAMPLING DISTRIBUTION OF MEANS & PROPORTIONS. PPSS The situation in a statistical problem is that there is a population of interest, and a quantity or.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics Seventh Edition By Brase and Brase Prepared by: Lynn Smith.
1 Statistics 262: Intermediate Biostatistics Regression Models for longitudinal data: Mixed Models.
Stochastic Loss Reserving with the Collective Risk Model Glenn Meyers ISO Innovative Analytics Casualty Loss Reserving Seminar September 18, 2008.
How does Biostatistics at Roche typically analyze longitudinal data
Reducing Uncertainty in Fatigue Life Estimates Design, Analysis, and Simulation 1-77-Nastran A Probabilistic Approach To Modeling Fatigue.
Perspective on the current state-of-knowledge of mode of action as it relates to the dose response assessment of cancer and noncancer toxicity Jennifer.
6. Ordered Choice Models. Ordered Choices Ordered Discrete Outcomes E.g.: Taste test, credit rating, course grade, preference scale Underlying random.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
Acute Toxicity Studies Single dose - rat, mouse (5/sex/dose), dog, monkey (1/sex/dose) 14 day observation In-life observations (body wt., food consumption,
1 James R. Black Qing Qing Wu 17 Feb 2016 Modeling Prediction Intervals using Monte Carlo Simulation Software 2016 ICEAA Professional Development & Training.
DOSE-RESPONSE ASSESSMENT
CHAPTER 5 Occupational Exposure Limits and Assessment of Workplace Chemical Risks.
Regression and Correlation
Lesson Comparing Two Means.
Basic Training for Statistical Process Control
Basic Training for Statistical Process Control
Oliver Kroner, Lynne Haber, Rick Hertzberg TERA
Statistical Data Analysis
Presentation transcript:

1 Hierarchical Models for Quantifying Uncertainty in Human Health Risk/Safety Assessment Ralph L. Kodell, Ph.D. Department of Biostatistics University of Arkansas for Medical Sciences Little Rock, AR

2 Risk/Safety Assessment: A Multi-step Process Risk/Safety Characterization Hazard Identification Dose-Response Assessment Exposure Assessment

3 Outline Background on Human Risk/Safety Assessment Exposure-to-Dose Response –PK/PD relationship via hierarchical model –Benchmark dose estimation (distributions) –How uncertainty can be reduced by PK information Dose Response-to-Risk/Safety Characterization –Inter-species and intra-species uncertainties –BMD conversion via hierarchical model Summary and Conclusions Challenges and Needs –Model uncertainty

4 Uncertainty Analysis Issue: There are many uncertainties in getting from Hazard and Dose-Response Assessment in experimental (animal) settings to Exposure and Risk/Safety Characterization for human settings Challenge: How to properly reflect these uncertainties Today’s Talk: How Hierarchical Probabilistic Models can help to characterize and manage these uncertainties

5 Usual Approach to Exposure Setting: Two-Step Process Human Exposure (Risk) = Animal-Derived Benchmark Dose (Risk) Animal→Average Human→Sensitive Human ( Exposure→Dose-Response ) (Dose-Response→Risk/Safety Characterization)

6 Dose-Response Modeling for BMD Estimation: Illustration D n#tumorsObserved Predicted Weibull model: P(D)= α+(1-α)[1-exp(-  D  )] P(D)= [1-exp( D 1.30 )] Goodness-of-fit p-value = 0.61

8 Exposure → Dose-Response Context: Dose-response analysis for cancer –Fit a mathematical model to D-R data: Prob(tumor  D) = F(D) –D is administered (external) dose Generally acknowledged that PK information on internal dose (d) should be incorporated whenever possible –e.g., d = mean AUC in tissue or blood

9 PK/PD Hidden Structure However, most often there is no formal attempt to separate the hidden Pharmacokinetic (PK) and Pharmacodynamic (PD) components of F that might explain the transformation of an external exposure into the development of a tumor –e.g., F(D), F(d): multistage, probit, Weibull

10 Hierarchical Model The most natural way to link the PK and PD components of a dose-response model is via a hierarchical model Background Risk PD Model PK Model

11 How to implement the model PK: Experiment, e.g., rats, n animals/D –Calculate mean and s.d. of d  AUC –Assume normal distribution for f(d|D) Simple PK: variability in internal dose Complex PK: variability + parameter uncertainty PD: Mechanism/Mode of Action? –e.g., two-stage clonal growth model for cancer –OR, multistage, probit, Weibull Numerical integration to fit hierarchical model

12 Example PK analysis –f(d|D) ~ Normal [  =(2D/(10+D),  =0.2  ] –f(d|D)={1/[  √(2  )]}exp{-½[(d-  )/  ] 2 } PD model –g(tumor|d): Weibull model –g(tumor|d)=1-exp(-  d k ) Fit hierarchical model using nonlinear least squares with numerical integration (e.g., SAS NLIN)

13 Results D n#tumorsproportion PK/PD fit  =(2D/(10+D),  =0.2  (from PK analysis)  =0.0406, k=4.65 (from fit to tumor data)

14 Benchmark Doses Can get BMD on scale of external (administered) dose –Fix the parameters at estimated values –Let the desired BMD, e.g., BMD 10, be the “parameter” of interest –Set BMR (0.10) = [P(tumor|D)-P 0 ]/[1-P 0 ] Estimated BMD 10 is (SAS NLIN)

15 Uncertainty Analysis Can simulate a complete distribution of BMD 100BMR for any BMR using Monte Carlo bootstrap re-sampling of the tumor data. Similarly, can simulate a distribution of excess risks for any D

16 Figure 2. Use 5 th percentile as 95% BMDL 100BMR Useful for managing risk: BMDL 10 = 6.86 BMDL 01 = 0.95

17 Reduced Uncertainty in BMDs PK (f)PD (g)BMR BMDL(05) Mic-MenWeibull (mean only) Mic-MenWeibull (distribution) NoneWeibull Nonlinear PK info can reduce the spread of distributions of BMDs (reduce the data uncertainty). But, mean internal dose seems sufficient.

18 Why the Mean Seems Sufficient

19 Comparison of Variation from Hierarchical Model with Ordinary Binomial Variation D N Mean SD Bin. SD Model: Hierarchical model with P0=0.098, g: Weibull (0.0406, 4.65), f: N(2D/(10+D), 0.4D/(10+D)) Mean: average of N generated tumor proportions SD: observed std dev of N generated tumor proportions Bin. SD: std dev calculated by [p(1-p)/50] 1/2, where p=observed mean and 50 is number of animals/group

20 Combining PK and PD Results OSHA: Methylene Chloride 1997 Internal dose from PK analysis Mean d UCL on d Risk estimate from PD model MLE excess risk UCL on excess risk MLE excess risk UCL on excess risk

21 Usual Approach to Exposure Setting: Two-Step Process Human Exposure = Animal-Derived NOAEL or Benchmark Dose Animal→Average Human→Sensitive Human ( Exposure→Dose-Response ) (Dose-Response→Risk/Safety Characterization)

22 Dose-Response → Risk Characterization Inter-species extrapolation: –Animal → Human –Location extrapolation, from susceptibility of test animal to center (mean),  H, of human susceptibility distribution –Uncertainty is due to a lack of knowledge about  H, because of the variability among chemicals in their differential effects on test animals and humans

23 Dose-Response → Risk Characterization (cont.) Intra-species extrapolation: –Human → Human –Scale extrapolation, from the center,  H, of the human susceptibility distribution to an extreme tail area –Uncertainty is due to the inherent inter- individual variability in human sensitivity

24 BMD Conversion Suppose we have BMD or BMDL for animals, say, D a Let T a be a random variable representing the ratio of human-to-animal sensitivity over all chemicals Let T h be a random variable representing the ratio of human-to-human sensitivity to the tested chemical Need to “convert” D a to D h to D s

25 Conditional Distribution of Human Susceptibility Assume that T a has a shifted lognormal distribution with pdf –f a (t a |  a,  a,  a ) Assume that T h has a prior shifted lognormal distribution with pdf –f h (t h |  h =c,  h,  h ) Then, conditional on T a =t a, T h has a shifted lognormal distribution –f h (t h |  h =log(t a )+c,  h,  h )

26 Unconditional Distribution of Human Susceptibility Hierarchical model for pdf of T s : Human to Human Animal to Human

27 Human Extrapolated Dose Lower 100p% statistical confidence limit on human extrapolated dose: Instead of D a /(T a,100p T h,100p ) [D a /(10 ∗ 10)] Calculate by D a /T s,100p –where T s,100p is the 100p th percentile of the unconditional human susceptibility distribution In general, T s,100p can be expected to be smaller than T a,100p ∗ T h,100p

28 Illustrations T a (0, 0.58, 1):T 50 =2, T 95 =10 T h (0, 0.61, 0)T 50 =1, T 95 =10 –T a,95 ∗ T h,95 = 100 –T s,95 = 34T s,99 = 100 T a (0, 0.697, 1):T 50 =2, T 95 =15 T h (0, 0.715, 0)T 50 =1, T 95 =15 –T a,95 ∗ T h,95 = 225 –T s,95 = 60T s,97 = 100

29 Exposure → Dose-Response Conclusions Information on internal dose though PK analysis can reduce uncertainty in BMD estimation (both data and model uncertainty) by improving the estimate of the mean risk But, the complete distribution of internal dose does not appear to affect the characterization of uncertainty…the mean internal dose seems sufficient The only measure of uncertainty in risk arises from the ultimate endpoint, presence or absence of an adverse effect

30 Dose-Response → Risk Characterization Conclusions Hierarchical probabilistic models can be useful for managing the uncertainties in the extrapolation process of converting animal-derived exposures into human- equivalent exposures for risk characterization by providing vehicles for proper quantification and propagation of the uncertainties

31 Overall Summary Hierarchical models are useful for understanding and quantifying uncertainties in doing: Exposure → Dose-Response. Dose-Response) →Risk Characterization

32 Challenges and Needs Correct propagation of uncertainty –Don’t overstate or misstate –Hierarchical models PK→PD, A average →H average, H average →H sensitive Model uncertainty –Don’t ignore –Model averaging Which and how many? Confidence limits on model-averaged BMDs Should you average BMDLs?

33 References Gaylor DW and Kodell RL (2000). Percentiles of the product of uncertainty factors for establishing probabilistic reference doses. Risk Analysis 20: Moon H, Kim H-J, Chen JJ and Kodell RL (2005). Model averaging using the Kullback information criterion in estimating effective doses for microbial infection and illness. Risk Analysis 25: Kodell RL, Chen JJ, Delongchamp RD and Young, JF (2006). Hierarchical models for probabilistic dose- response assessment. Reg. Tox. Pharm. 45: Kodell RL and Chen JJ (2007). On the use of hierarchical probabilistic models for characterizing and managing uncertainty in risk/safety assessment. Risk Anal. 27: