Risk Prediction of Complex Disease David Evans. Genetic Testing and Personalized Medicine Is this possible also in complex diseases? Predictive testing.

Slides:



Advertisements
Similar presentations
Regulation of Consumer Tests in California AAAS Meeting June 1-2, 2009 Beatrice OKeefe Acting Chief, Laboratory Field Services California Department of.
Advertisements

What is an association study? Define linkage disequilibrium
Family History for Public Health and Preventive Medicine: Developing a Research Agenda Paula Yoon, ScD, MPH Office of Genomics & Disease Prevention CDC.
Genetic Analysis in Human Disease
Critically Evaluating the Evidence: diagnosis, prognosis, and screening Elizabeth Crabtree, MPH, PhD (c) Director of Evidence-Based Practice, Quality Management.
Perspectives from Human Studies and Low Density Chip Jeffrey R. O’Connell University of Maryland School of Medicine October 28, 2008.
Sensitivity, Specificity and ROC Curve Analysis.
What Happens to the Performance of a Diagnostic Test when the Disease Prevalence and the Cut-Point Change? Pathological scores Healthy scores Healthy population.
Association Mapping David Evans. Outline Definitions / Terminology What is (genetic) association? How do we test for association? When to use association.
1 SIMG Florence ppt The Horizons of Predictive Medicine Dr Ian Gilham Worldwide Director, Predictive Medicine Glaxo Wellcome Research and Development.
Personalized Medicine Presentation by: Alex Wiki by: John and Lydia.
Update on Genetics in Hypertension Christian Delles BHF Glasgow Cardiovascular Research Centre Institute of Cardiovascular and Medical Sciences University.
Model and Variable Selections for Personalized Medicine Lu Tian (Northwestern University) Hajime Uno (Kitasato University) Tianxi Cai, Els Goetghebeur,
Classification and risk prediction Usman Roshan. Disease risk prediction What is the best method to predict disease risk? –We looked at the maximum likelihood.
Personalized Medicine in the Era of Genomics Wylie Burke MD PhD Department of Medical History and Ethics Center for Genomics and Healthcare Equality University.
Baye’s Rule and Medical Screening Tests. Baye’s Rule Baye’s Rule is used in medicine and epidemiology to calculate the probability that an individual.
Statistics for Health Care
Single nucleotide polymorphisms and applications Usman Roshan BNFO 601.
Clinical Applications of Whole Genome/Whole Exome Sequencing Robert L. Nussbaum, MD, FACMG Division of Genomic Medicine, UCSF AMA – November 11, 2012.
Practical Considerations in Statistical Genetics Ashley Beecham June 19, 2015.
Direct-to-Consumer Genetic Testing Developed by Dr. June Carroll, Ms. Shawna Morrison and Dr. Judith Allanson Last updated April 2014.
P REDICTION M ODELS U SING G ENOMIC P ROFILING H. Zhang E. Warner D. Zhao.
Genomics Alexandra Hayes. Genomics is the study of all the genes in a person, as well as the interactions of those genes with each other and a person’s.
Understanding Genetics of Schizophrenia
Exploring the behavioral genetics of Trade and Cooperation Arcadi Navarro and Elodie Gazave July 5th 2007.
Genetic Analysis in Human Disease. Learning Objectives Describe the differences between a linkage analysis and an association analysis Identify potentially.
Statistics in Screening/Diagnosis
BASIC STATISTICS: AN OXYMORON? (With a little EPI thrown in…) URVASHI VAID MD, MS AUG 2012.
Multiple Choice Questions for discussion
LARA MANGRAVITE SAGE BIONETWORKS ON BEHALF OF THE RA CHALLENGE ORGANIZING TEAM The DREAM Rheumatoid Arthritis Responder Challenge: Motivation, Data, Scoring.
Criteria for Assessment of Performance of Cancer Risk Prediction Models: Overview Ruth Pfeiffer Cancer Risk Prediction Workshop, May 21, 2004 Division.
Non-Traditional Metrics Evaluation measures from the Evaluation measures from the medical diagnostic community medical diagnostic community Constructing.
Division of Population Health Sciences Royal College of Surgeons in Ireland Coláiste Ríoga na Máinleá in Éirinn Indices of Performances of CPRs Nicola.
Statistics for Health Care Biostatistics. Phases of a Full Clinical Trial Phase I – the trial takes place after the development of a therapy and is designed.
Case(Control)-Free Multi-SNP Combinations in Case-Control Studies Dumitru Brinza and Alexander Zelikovsky Combinatorial Search (CS) for Disease-Association:
Metabolic Syndrome and Recurrence within the 21-Gene Recurrence Score Assay Risk Categories in Lymph Node Negative Breast Cancer Lakhani A et al. Proc.
GA-Based Feature Selection and Parameter Optimization for Support Vector Machine Cheng-Lung Huang, Chieh-Jen Wang Expert Systems with Applications, Volume.
Alexander Statnikov Discovery Systems Laboratory Department of Biomedical Informatics Vanderbilt University 10/3/
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Personalized Medicine Detection Diagnosis Treatment Survival.
From Genome-Wide Association Studies to Medicine Florian Schmitzberger - CS 374 – 4/28/2009 Stanford University Biomedical Informatics
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Personalized Medicine Dr. M. Jawad Hassan. Personalized Medicine Human Genome and SNPs What is personalized medicine? Pharmacogenetics Case study – warfarin.
Jianfeng Xu, M.D., Dr.PH Professor of Public Health and Cancer Biology Director, Program for Genetic and Molecular Epidemiology of Cancer Associate Director,
The Problem with Individual Risk Beverly Rockhill, Ph.D. Department of Epidemiology University of North Carolina, Chapel Hill.
1 Risk Assessment Tests Marina Kondratovich, Ph.D. OIVD/CDRH/FDA March 9, 2011 Molecular and Clinical Genetics Panel for Direct-to-Consumer (DTC) Genetic.
Screening Puja Myles
Positive Predictive Value and Negative Predictive Value
What’s the Difference? Genetic and Common Diseases.
QTL Studies- Past, Present and Future David Evans.
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
Diagnostic Test Characteristics: What does this result mean
Design and Validation of Methods Searching for Risk Factors in Genotype Case- Control Studies Dumitru Brinza Alexander Zelikovsky Department of Computer.
Risk Factor Searching Heuristics for SNP Case-Control Studies Dumitru Brinza February 21, 2008 Department of Computer Science & Engineering University.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Timothy Wiemken, PhD MPH Assistant Professor Division of Infectious Diseases Diagnostic Tests.
Diagnostic Likelihood Ratio Presented by Juan Wang.
Diagnosis:Testing the Test Verma Walker Kathy Davies.
Sensitivity, Specificity, and Receiver- Operator Characteristic Curves 10/10/2013.
Insights Into Complex Disease Genetics (?) David M Evans.
Uses of Diagnostic Tests Screen (mammography for breast cancer) Diagnose (electrocardiogram for acute myocardial infarction) Grade (stage of cancer) Monitor.
Next generation genomics: translation into clinically useful applications in health care Prof.dr. Martina Cornel
Date of download: 7/2/2016 Copyright © 2016 American Medical Association. All rights reserved. From: How to Interpret a Genome-wide Association Study JAMA.
Brendan Burke and Kyle Steffen. Important New Tool in Genomic Medicine GWAS is used to estimate disease risk and test SNPs( the most common type of genetic.
SNPs and complex traits: where is the hidden heritability?
Genetics of common complex diseases: a view from Iceland
Beyond GWAS Erik Fransen.
Complex Traits Qualitative traits. Discrete phenotypes with direct Mendelian relationship to genotype. e.g. black or white, tall or short, sick or healthy.
Exercise: Effect of the IL6R gene on IL-6R concentration
Evidence Based Diagnosis
Presentation transcript:

Risk Prediction of Complex Disease David Evans

Genetic Testing and Personalized Medicine Is this possible also in complex diseases? Predictive testing in the case of monogenic diseases has been used for years (1300+ tests available) The idea that diagnosis, preventative and therapeutic interventions are tailored to individuals based upon their genotypes Preventative strategies radical (PKU, Breast cancer) Predictive utility of many different variants -> genomic profiling Environmental risk factors Diagnosis -> Modification of risk Tailoring treatment options

Test Outcome PositiveTrue Positive False Positive (Type I error) Positive Predictive Value Negative False Negative (Type II error) True Negative Negative Predictive Value Reality DiseasedNormal SensitivitySpecificity Sensitivity = P(T+ | D+) A sensitivity of 100% means that the test recognises all sick people “SNOUT” Property of test itself

Test Outcome PositiveTrue Positive False Positive (Type I error) Positive Predictive Value Negative False Negative (Type II error) True Negative Negative Predictive Value Reality DiseasedNormal SensitivitySpecificity Specificity = P(T- | D-) A specificity of 100% means that the test identifies all healthy people as healthy “SPIN” Positive results in a highly specific test is used to confirm disease Property of test itself

Test Outcome PositiveTrue Positive False Positive (Type I error) Positive Predictive Value Negative False Negative (Type II error) True Negative Negative Predictive Value Reality DiseasedNormal SensitivitySpecificity PPV = P(D+ | T+) Depends on prevalence of disease

Test Outcome PositiveTrue Positive False Positive (Type I error) Positive Predictive Value Negative False Negative (Type II error) True Negative Negative Predictive Value Reality DiseasedNormal SensitivitySpecificity NPV = P(D- | T-) Depends on prevalence of disease

Likelihood Ratio

(from Yang et al AJHG) (from Janssens et al AJHG) Genomic Profiling

ROC Curves Sensitivity 1 - Specificity Area under Curve (AUC)

Genomic Profiling Janssens & van Duijn (2008) HMG

Genetic variants appear to add little to traditional risk factors Some genetic variants might influence intermediate risk factors Janssens & van Duijn (2008) HMG

Problems Most individuals have disease risks only slightly higher or lower than the population average Janssens & van Duijn (2008) HMG Substantial variation in disease risk may be seen between individuals with the same number of risk genotypes resulting from differences in effect sizes between risk genotypes

Problems Can we do better than just asking a first degree relative? Knowledge of increased risk may not be useful Janssens & van Duijn (2008) HMG Predictive value of genetic tests are limited by their heritability

Ankylosing Spondylitis Auto-immune arthritis resulting in fusion of vertebrae Often associated with psoriasis, IBD and uveitis Prevalence of 0.4% in Caucasians. More common in men. Ed Sullivan, Mike Atherton

WTCCC (2007) Nat Genet IL23-R ARTS-1

Prevalence of B27+, ARTS1+,IL23R+ is 2.4% Prevalence of B27-, ARTS1-, IL23R- is 19% Ankylosing Spondylitis (Brown & Evans, in prep)

Genome-wide Prediction?

CASES 1.Type 1 Diabetes 2.Type 2 Diabetes 3.Crohn’s Disease 4.Coronary Heart Disease 5.Hypertension 6.Bipolar Disorder 7.Rheumatoid Arthritis CONTROLS 1. UK Controls A (1, BC) Wellcome Trust Case-Control Consortium Genome-Wide Association Across Major Human Diseases DESIGN Collaboration amongst 26 UK disease investigators 2000 cases each from 7 diseases GENOTYPING Affymetrix 500k SNPs

Methods “Training set” “Prediction set” 90% of cases and controls Apply prediction method to prediction set (10% of cases and controls) Run test of association in training set Select a set of nominally associated SNPs according to a threshold (α = 0.8, 0.5, 0.1, 0.05, 0.01, 0.001, , ) Cross validation Do ten times, record mean AUC and range of AUCs

Methods “Count Method” “Log Odds Method” Score = sum(x_i) * log(OR_i) x_i = Number of risk alleles (=0,1,2) at SNP i OR_i = Estimated OR at SNP i from discovery set Score = sum(x_i) For each individual:

Control Condition These will inflate the apparent predictive ability of SNPs Differences between cases and controls might reflect undetected batch effects, population stratification and/or genotyping error Predict a disease using SNPs derived from training sets of other diseases Would expect AUC ~ 0.5 in the absence of these factors

ThresholdOdds MethodLog Odds Method ProfilingControlProfilingControl p < p < p < p < p < p < p < p < Bipolar Disorder

ThresholdOdds MethodLog Odds Method ProfilingControlProfilingControl p < p < p < p < p < p < p < p < Type I Diabetes

Conclusions Does this genome-wide score provide discriminative ability over and above that afforded by known variants? A genome-wide score provides significant (but not very good) discrimination between cases and controls

ThresholdOdds MethodLog Odds Method ProfilingControlKnownAll Known.549 p < p < p < p < p < p < p < p < Bipolar Disorder

ThresholdOdds MethodLog Odds Method KnownAllKnownAll Known.784 p < p < p < p < p < p < p < p < Type I Diabetes

Limitations Genotyping error, batch effects and/or population stratification in the cases group Only additive relationships modelled

Conclusions A simple genome-wide score has discriminative ability and can add information over and above that afforded by known variants Currently genetic information of little diagnostic utility for (most) complex diseases