Issues with DNA Evidence, Past and Future Washington County Bar Association March, 2016 Washington, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh,

Slides:



Advertisements
Similar presentations
Overcoming DNA Stochastic Effects 2010 NEAFS & NEDIAI Meeting November, 2010 Manchester, VT Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics.
Advertisements

DNA Mixture Interpretations and Statistics – To Include or Exclude Cybergenetics © Prescription for Criminal Justice Forensics ABA Criminal Justice.
Finding Truth in DNA Mixture Evidence Innocence Network Conference April, 2013 Charlotte, NC Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA.
How Inclusion Interpretation of DNA Mixture Evidence Reduces Identification Information American Academy of Forensic Sciences February, 2013 Washington,
Creating informative DNA libraries using computer reinterpretation of existing data Northeastern Association of Forensic Scientists November, 2011 Newport,
Preventing rape in the military through effective DNA computing Forensics Europe Expo Forensics Seminar Theatre April, 2014 London, UK Mark W Perlin, PhD,
Coding a Safer Society through Computer Interpretation of DNA Evidence Cybergenetics © MATLAB Virtual Conference March, 2014 Mark W Perlin, PhD,
Probabilistic Software Workshop September 29, 2014 TrueAllele® Casework Mark W. Perlin, PhD, MD, PhD.
TrueAllele ® Interpretation of DNA Mixture Evidence 9 th International Conference on Forensic Inference and Statistics August, 2014 Leiden University,
How TrueAllele® Works (Part 1)
TrueAllele ® Casework Validation on PowerPlex ® 21 Mixture Data Australian and New Zealand Forensic Science Society September, 2014 Adelaide, South Australia.
Using TrueAllele ® Casework to Separate DNA Mixtures of Relatives California Association of Criminalists October, 2014 San Francisco, CA Jennifer Hornyak,
Revolutionising DNA analysis in major crime investigations The Investigator Conferences Green Park Conference Centre May, 2014 Aylesbury, Buckinghamshire.
No DNA Left Behind: When "inconclusive" really means "informative" Schenectady County District Attorney’s Office January, 2014 Mark W Perlin, PhD, MD,
Challenging DNA Evidence The Fifth Judicial District of Pennsylvania Criminal Division February, 2015 Pittsburgh, PA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Revolutionising DNA analysis in major crime investigations The Investigator Conferences Green Park Conference Centre May, 2014 Aylesbury, Buckinghamshire.
Solving Cold Cases by TrueAllele ® Analysis of DNA Evidence Finding Closure: The Science, Law and Politics of Cold Case Investigations October, 2014 Pittsburgh,
TrueAllele ® Mixture Interpretation Cybergenetics © th Annual DNA Technology Educational Seminar Centre of Forensic Sciences and the Promega.
DNA Mixture Statistics Cybergenetics © Spring Institute Commonwealth's Attorney's Services Council Richmond, Virginia March, 2013 Mark W.
Computer Interpretation of Uncertain DNA Evidence National Institute of Justice Computer v. Human June, 2011 Arlington, VA Mark W Perlin, PhD, MD, PhD.
TrueAllele ® Modeling of DNA Mixture Genotypes California Association of Crime Laboratory Directors October, 2014 San Francisco, CA Mark W Perlin, PhD,
Challenging DNA Evidence The Fifth Judicial District of Pennsylvania Criminal Division February, 2015 Pittsburgh, PA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Reanimating Zombie™ DNA Penn State Dickinson Law School September, 2012 State College, Pennsylvania Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh,
Computer interpretation of touch DNA mixtures Seminar for Chiefs of Police in Western Pennsylvania May, 2014 Allegheny County, PA Mark W Perlin, PhD, MD,
Separating Familial Mixtures, One Genotype at a Time Northeastern Association of Forensic Scientists November, 2014 Hershey, PA Ria David, PhD, Martin.
Cybergenetics Webinar January, 2015 Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics © How TrueAllele ® Works (Part 4)
Cracking the DNA mixture code – computer analysis of UK crime cases Forensics Europe Expo Forensic Innovation Conference April, 2014 London, UK Mark W.
Forensic Science & Criminal Law: Cutting Edge DNA Strategies Pennsylvania Association of Criminal Defense Lawyers September, 2015 Hotel Monaco, Pittsburgh,
Unleashing Forensic DNA through Computer Intelligence Forensics Europe Expo Forensic Innovation Conference April, 2013 London, UK Mark W Perlin, PhD, MD,
Rapid DNA Response: On the Wings of TrueAllele Mid-Atlantic Association of Forensic Scientists May, 2015 Cambridge, Maryland Martin Bowkley, Matthew Legler,
Getting Past First Bayes with DNA Mixtures American Academy of Forensic Sciences February, 2014 Seattle, WA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Compute first, ask questions later: an efficient TrueAllele ® workflow Midwestern Association of Forensic Scientists October, 2014 St. Paul, MN Martin.
TrueAllele ® interpretation of Allegheny County DNA mixtures Cybergenetics © Continuing Legal Education Allegheny County Courthouse February,
Virginia TrueAllele ® Validation Study: Casework Comparison Presented at AAFS, February, 2013 Published in PLOS ONE, March, 2014 Mark W Perlin, PhD, MD,
TrueAllele ® Computing: All the DNA, all the time Continuing Professional Development Sydney, Australia March, 2014 Mark W Perlin, PhD, MD, PhD Cybergenetics,
Murder in McKeesport October 25, 2008 Tamir Thomas.
When Good DNA Goes Bad International Conference on Forensic Research & Technology October, 2012 Chicago, Illinois Mark W Perlin, PhD, MD, PhD Cybergenetics,
DNA Mapping the Crime Scene: Do Computers Dream of Electric Peaks? 23rd International Symposium on Human Identification October, 2012 Nashville, TN Mark.
Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics © Duquesne University October, 2015 Pittsburgh, PA What’s in a Match?
Open Access DNA Database Duquesne University March, 2013 Pittsburgh, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©
Objective DNA Mixture Information in the Courtroom: Relevance, Reliability & Acceptance NIST International Symposium on Forensic Science Error Management:
DNA-led investigation through computer interpretation of evidence Pennsylvania State Police Training Seminar Hershey, PA April, 2014 Mark W Perlin, PhD,
Understanding DNA Pennsylvania Conference of State Trial Judges Mid Annual Meeting Administrative Office of Pennsylvania Courts Judicial Education Department.
Data summary – “alleles” Threshold Over threshold, peaks are labeled as allele events All-or-none allele peaks, each given equal status Allele Pair 8,
Separating DNA Mixtures by Computer to Identify and Convict a Serial Rapist Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Garett Sugimoto,
Understanding DNA Evidence Beaver County Courthouse March, 2016 Beaver, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©
DNA Investigation: Across the Universe Pennsylvania Homicide Investigators Association April, 2016 State College, PA Mark W Perlin, PhD, MD, PhD Cybergenetics,
Four person DNA mixture
DNA: TrueAllele® Statistical Analysis, Probabilistic Genotyping
Overcoming Bias in DNA Mixture Interpretation
Validating TrueAllele® genotyping on ten contributor DNA mixtures
Shedding Light on Inconclusive DNA: TrueAllele® Computer Analysis
How to Defend Yourself Against DNA Mixtures
Explaining the Likelihood Ratio in DNA Mixture Interpretation
Distorting DNA evidence: methods of math distraction
On the threshold of injustice: manipulating DNA evidence
Machines can work it out: Automated TrueAllele® workflow
Virginia TrueAllele® Validation Study: Casework Comparison
Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA, USA
TrueAllele for DNA Mixtures
Solving Crimes using MCMC to Analyze Previously Unusable DNA Evidence
Investigative DNA Databases that Preserve Identification Information
The Triumph and Tragedy of DNA Evidence
Probabilistic Genotyping to the Rescue for Pinkins and Glenn
DNA Identification: Mixture Interpretation
Exonerating the Innocent with Probabilistic Genotyping
Testifying about probabilistic genotyping results
David W. Bauer1, PhD Nasir Butt2, PhD Jeffrey Oblock2
Using probabilistic genotyping to distinguish family members
Presentation transcript:

Issues with DNA Evidence, Past and Future Washington County Bar Association March, 2016 Washington, PA Mark W Perlin, PhD, MD, PhD Cybergenetics, Pittsburgh, PA Cybergenetics ©

National Academy of Sciences Among existing forensic methods, only nuclear DNA analysis has been rigorously shown to have the capacity to consistently, and with a high degree of certainty, demonstrate a connection between an evidentiary sample and a specific individual or source. "Strengthening Forensic Science: A Path Forward" (2009) Human examination bias Statistics & reporting Underlying scientific basis

DNA genotype 10, ACGT A genetic locus has two DNA sentences, one from each parent. locus Many alleles allow for many many allele pairs. A person's genotype is relatively unique. mother allele father allele repeated word An allele is the number of repeated words. A genotype at a locus is a pair of alleles

DNA match statistic Evidence item Evidence data LabInfer Evidence genotype Known genotype 10, 12 Compare DNA from one person 1 Prob(coincidental match)

National Academy of Sciences However,... there may be problems... with how the DNA was... interpreted, such as when there are mixed samples "Strengthening Forensic Science: A Path Forward" (2009) Human examination bias Statistics & reporting Underlying scientific basis

DNA match statistic Evidence item Evidence data Lab Contributor genotype Known genotype 10, 20% 11, 30% 11, 50% 11, 12 Compare DNA from two people Prob(evidence match) Prob(coincidental match) Separate

Pennsylvania v Ralph Skundrich On July 25, 2002, a Pittsburgh college student, 18, was threatened with a gun and sexually assaulted in her Shadyside apartment. The victim's jeans and T-shirt contained biological evidence. The Allegheny County crime lab developed DNA data from the two evidence items. Skundrich was identified as a suspect after a DNA match was made in the national database in 2009.

DNA mixture evidence (jeans) Quantitative peak heights at locus D13S317 peak height peak size

TrueAllele ® Casework ViewStation User Client Database Server Interpret/Match Expansion Visual User Interface VUIer™ Software Parallel Processing Computers

How the computer thinks Consider every possible genotype solution Explain the peak pattern Better explanation has a higher likelihood First person's allele pair Second person's allele pair 90% 10%

DNA match information Prob(evidence match) Prob(coincidental match) How much more does the suspect match the evidence than a random person? 35x 98% 3%

Match information at 13 loci DNA locus Likelihood ratio (LR)

Is the suspect in the evidence? A match between the jeans and Ralph Skundrich is: 2.1 quadrillion times more probable than coincidence A match between the T-shirt and Ralph Skundrich is: 4.04 quadrillion times more probable than coincidence

Crime lab data summary Threshold Over threshold, peaks are labeled as allele events All-or-none allele peaks, each given equal status Allele Pair 8, 8 8, 11 8, 12 8, 14 11, 11 11, 12 11, 14 12, 12 10%12, 14 14, 14

Match statistic comparison DNA locus Likelihood ratio (LR)

Information comparison Jeans 280 thousand (5) 2 quadrillion (15) T-shirt 630 thousand (5) 4 quadrillion (15) Method Combined PI TrueAllele

Reliability (PA Rule 702) A witness who is qualified as an expert by knowledge, skill, experience, training, or education may testify in the form of an opinion or otherwise if: (a) the expert’s scientific, technical, or other specialized knowledge is beyond that possessed by the average layperson; (b) the expert’s scientific, technical, or other specialized knowledge will help the trier of fact to understand the evidence or to determine a fact in issue; and (c) the expert’s methodology is generally accepted in the relevant field. Testimony by Expert Witness

Validation axes Sensitivity. The extent to which interpretation identifies the correct person. Truly include, don't falsely exclude. Specificity. The extent to which interpretation does not misidentify the wrong person. Truly exclude, don't falsely include. Reproducibility. The extent to which interpretation gives the same answer to the same question. Concordant independent computer runs.

TrueAllele validation papers Perlin MW, Sinelnikov A. An information gap in DNA evidence interpretation. PLoS ONE. 2009;4(12):e8327. Ballantyne J, Hanson EK, Perlin MW. DNA mixture genotyping by probabilistic computer interpretation of binomially-sampled laser captured cell populations: Combining quantitative data for greater identification information. Science & Justice. 2013;53(2): Perlin MW, Hornyak J, Sugimoto G, Miller K. TrueAllele ® genotype identification on DNA mixtures containing up to five unknown contributors. Journal of Forensic Sciences. 2015;on-line. Greenspoon SA, Schiermeier-Wood L, Jenkins BC. Establishing the limits of TrueAllele ® Casework: a validation study. Journal of Forensic Sciences. 2015;in press. Perlin MW, Legler MM, Spencer CE, Smith JL, Allan WP, Belrose JL, Duceman BW. Validating TrueAllele ® DNA mixture interpretation. Journal of Forensic Sciences. 2011;56(6): Perlin MW, Belrose JL, Duceman BW. New York State TrueAllele ® Casework validation study. Journal of Forensic Sciences. 2013;58(6): Perlin MW, Dormer K, Hornyak J, Schiermeier-Wood L, Greenspoon S. TrueAllele ® Casework on Virginia DNA mixture evidence: computer and manual interpretation in 72 reported criminal cases. PLOS ONE. 2014;(9)3:e92837.

WTC DNA data reanalysis 18,000 victim remains 2,700 missing people match

Widespread acceptance Admitted after Frye or Daubert challenge in: California, Louisiana, New York, Ohio, Pennsylvania, South Carolina, Virginia, Australia & United Kingdom Used in five hundred criminal cases in most of the United States, for both prosecution and defense Crime labs use TrueAllele ® system in California, Maryland, South Carolina & Virginia Seventy five criminal cases in Pennsylvania Adams, Allegheny, Beaver, Berks, Butler, Cambria, Columbia, Delaware, Indiana, Luzerne, Lycoming, Mercer, Mifflin, Pike, Washington, Westmoreland, York

Pennsylvania appellate court

Relevance (PA Rule 403) The court may exclude relevant evidence if its probative value is outweighed by a danger of one or more of the following: unfair prejudice, confusing the issues, misleading the jury, undue delay, wasting time, or needlessly presenting cumulative evidence. Excluding relevant evidence for prejudice, confusion, waste of time, or other reasons probative force unfair prejudice

Commonwealth v Booher DNA excluded as misleading, confusing & prejudicial

DNA statistic shuts down labs “National accreditation board suspends all DNA testing at D.C. crime lab” The Washington Post April 27, 2015 Did not comply with FBI standards “New protocol leads to reviews of ‘mixed DNA’ evidence” The Texas Tribune September 12, ,468 lab tests affected

MIX05: Statistics not reproducible National Institute of Standards and Technology Two Contributor Mixture Data, Known Victim 31 thousand (4) 213 trillion (14) MIX05: NIST mixture interpretation interlaboratory study. Butler JM, Kline MC, National Institute of Standards and Technology Promega's Sixteenth International Symposium on Human Identification, 2005

MIX13: An interlaboratory study on the present state of DNA mixture interpretation in the U.S. Coble M, National Institute of Standards and Technology 5th Annual Prescription for Criminal Justice Forensics, Fordham University School of Law, MIX13: Statistics falsely include

Process is not objective science (1) Choose, alter, discard, edit, and manipulate the DNA data signals (2) Compare defendant's genotype to edited data & decide if he is in the DNA evidence (3) If he is "included", then calculate a DNA mixture statistic Human examination bias Statistics & reporting Underlying scientific basis

CPI lacks probative value Forensic crime laboratories have generated CPI statistics on hundreds of thousands of DNA mixture evidence items. However, this commonly used match statistic behaves like a random generator of inclusionary values, following the LLN rather than measuring identification information. A quantitative CPI number adds little meaningful information beyond the analyst’s initial qualitative assessment that a person’s DNA is included in a mixture. Statistical methods for reporting on DNA mixture evidence should be scientifically validated before they are relied upon by criminal justice.

Relevance of CPI Unvalidated DNA match statistic, unrelated to identification Probative value Unfair prejudice Confusing the issues Misleading the jury Cumulative evidence none PA Rule 403 “outweighed by a danger of:” PA Rule 401 “evidence makes a fact more or less probable”

Method comparison CapabilityHuman reviewTrueAllele Data choiceSelection biasUse all data UncertaintyThresholdStatistical NeutralInclude onlyInclude/Exclude StatisticCounts testsProbative ObjectiveNoYes ValidatedNoYes AccurateNoYes Frye challengeNoYes Item-to-itemNoYes Database10%100%

Inconclusive mixture Crime laboratory DNA report Crime lab user fee: $5,000 Conclusions: Item 1 – Swab of textured areas from a handgun The data indicates that DNA from four (4) or more contributors was obtained from the swab of the handgun. Due to the complexity of the data, no conclusions can be made regarding persons A and B as possible contributors to this mixture.

Computer reanalysis Cybergenetics TrueAllele ® report Match statistics provide information Person B included 400,000 Person A excluded Unmix the mixture Contributor

TrueAllele in Allegheny County CrimeEvidenceDefendantOutcomeSentence rapeclothingRalph Skundrichguilty75 years murdergun, hatLeland Davisguilty23 years rapeclothingAkaninyene Akanguilty32 years murdershotgun shellsJames Yeckel, Jr.guilty plea25 years murderfingernailAnthony Morganguiltylife weaponsgunThomas Doswellguilty plea1 year bank robberyclothingJesse Lumbergerguilty10 years drugsgunDerek McKissickguilty plea2 1/2 years drugsgunSteve Morganguilty plea2 1/2 years murderdoor, clothingCalvin Kaneguilty plea20 years murdergunJaykwaan Pinckneyguilty plea10 years child rapeclothingDhaque Jonesguilty plea6 years shootinggunAnthony Jeffersonguilty plea4 years weaponsgunDelmingo Williamsguilty plea3 years incest rapeclothingTerry L.guilty40 years bank robberyhatRobert Schatzmanguiltypending weaponsgunRashawn Walkerguilty1.5 years robberyhatLauren Peakguilty plea1 year murdergunChaz Whiteguilty plea4 years 44 cases, 8 trials, 3 DNA exonerations

Post-conviction relief § 9543(a)(2). Eligibility for PCR (ii) Ineffective assistance of counsel (vi) The unavailability … of exculpatory evidence that has subsequently become available and would have changed the outcome … § Post-conviction DNA testing TrueAllele reanalysis of “inconclusive” DNA or inaccurate DNA match statistics Han Tak Lee v. Monroe County (PA Innocence) US Court of Appeals for the Third Circuit (2012) “fire expert testimony at trial fundamentally unreliable, so entitled to federal habeas relief on due process claim” Title 42, Chapter 95, Subchapter B

More DNA information Courses Newsletters Newsroom Presentations Publications Webinars TrueAllele YouTube channel