Next-generation sequencing: informatics & software aspects Gabor T. Marth Boston College Biology Department.

Slides:



Advertisements
Similar presentations
The Good, Bad, and Ugly of Next-Gen Sequencing
Advertisements

Single Nucleotide Polymorphism And Association Studies Stat 115 Dec 12, 2006.
G ENOTYPE AND SNP C ALLING FROM N EXT - GENERATION S EQUENCING D ATA Authors: Rasmus Nielsen, et al. Published in Nature Reviews, Genetics, Presented.
Reference mapping and variant detection Peter Tsai Bioinformatics Institute, University of Auckland.
Base quality and read quality: How should data quality be measured? Gabor T. Marth Boston College Biology Department 1000 Genomes Meeting Cold Spring Harbor.
Next-generation sequencing
Targeted Data Introduction  Many mapping, alignment and variant calling algorithms  Most of these have been developed for whole genome sequencing and.
Next-generation sequencing – the informatics angle Gabor T. Marth Boston College Biology Department AGBT 2008 Marco Island, FL. February
Next-generation sequencing and PBRC. Next Generation Sequencer Applications DeNovo Sequencing Resequencing, Comparative Genomics Global SNP Analysis Gene.
Next-generation sequencing: informatics & software aspects Gabor T. Marth Boston College Biology Department Harvard Nanocourse October 7, 2009.
Greg Phillips Veterinary Microbiology
Variant discovery Different approaches: With or without a reference? With a reference – Limiting factors are CPU time and memory required – Crossbow –
Design Goals Crash Course: Reference-guided Assembly.
Bioinformatics for high-throughput DNA sequencing Gabor Marth Boston College Biology New grad student orientation Boston College September 8, 2009.
Bioinformatics Methods and Computer Programs for Next-Generation Sequencing Data Analysis Gabor Marth Boston College Biology Next Generation Sequencing.
1000 Genomes SV detection Boston College Chip Stewart 24 November 2008.
Biology and Bioinformatics Gabor T. Marth Department of Biology, Boston College BI820 – Seminar in Quantitative and Computational Problems.
Data analysis methods for next- generation sequencing technologies Gabor T. Marth Boston College Biology Department Epigenomics & Sequencing Meeting July.
Next-generation sequence analysis Gabor T. Marth Boston College Biology Department PSB 2008 January
NHGRI/NCBI Short-Read Archive: Data Retrieval Gabor T. Marth Boston College Biology Department NCBI/NHGRI Short-Read.
Computational Tools for Finding and Interpreting Genetic Variations Gabor T. Marth Department of Biology, Boston College
Mining SNPs from EST Databases Picoult-Newberg et al. (1999)
Polymorphism discovery in next- generation re-sequencing data Gabor T. Marth Boston College Biology Department Illumina workshop, Washington, DC November.
Bioinformatics for next-generation DNA sequencing Gabor T. Marth Boston College Biology Department BC Biology new graduate student orientation September.
Evolutionary Genome Biology Gabor T. Marth, D.Sc. Department of Biology, Boston College Medical Genomics Course – Debrecen, Hungary, May 2006.
Read mapping and variant calling in human short-read DNA sequences
Next-generation sequencing: informatics & software aspects Gabor T. Marth Boston College Biology Department.
Genotyping of James Watson’s genome from Low-coverage Sequencing Data Sanjiv Dinakar and Yözen Hernández.
Informatics tools for next-generation sequence analysis Gabor T. Marth Boston College Biology Department University of Michigan October 20, 2008.
Polymorphism discovery informatics Gabor T. Marth Department of Biology Boston College Chestnut Hill, MA
Sequence Variation Informatics Gabor T. Marth Department of Biology, Boston College BI420 – Introduction to Bioinformatics.
Informatics for next-generation sequence analysis – SNP calling Gabor T. Marth Boston College Biology Department PSB 2008 January
Informatics challenges and computer tools for sequencing 1000s of human genomes Gabor T. Marth Boston College Biology Department Cold Spring Harbor Laboratory.
Department of Bioinformatics and Computational Biology
Diabetes and Endocrinology Research Center The BCM Microarray Core Facility: Closing the Next Generation Gap Alina Raza 1, Mylinh Hoang 1, Gayan De Silva.
Next generation sequencing platforms Applications
Special Topics in Genomics Lecture 1: Introduction Instructor: Hongkai Ji Department of Biostatistics
Next generation sequencing Xusheng Wang 4/29/2010.
Whole Exome Sequencing for Variant Discovery and Prioritisation
Biostatistics-Lecture 15 High-throughput sequencing and sequence alignment Ruibin Xi Peking University School of Mathematical Sciences.
Considerations for Analyzing Targeted NGS Data Introduction Tim Hague, CTO.
Todd J. Treangen, Steven L. Salzberg
Computational research for medical discovery at Boston College Biology Gabor T. Marth Boston College Department of Biology
High throughput sequencing: informatics & software aspects Gabor T. Marth Boston College Biology Department BI543 Fall 2013 January 29, 2013.
Chromatin Immunoprecipitation DNA Sequencing (ChIP-seq)
How will new sequencing technologies enable the HMP? Elaine Mardis, Ph.D. Associate Professor of Genetics Co-Director, Genome Sequencing Center Washington.
Copy Number Variation Eleanor Feingold University of Pittsburgh March 2012.
SEQUENCING – THE BENCHTOPS. Roche 454 Junior Same technology as 454 FLX Read length: 400 bases Paired-end 100,000 reads 12 hours (instrument time) Output.
Lecture 6. Functional Genomics: DNA microarrays and re-sequencing individual genomes by hybridization.
MEME homework: probability of finding GAGTCA at a given position in the yeast genome, based on a background model of A = 0.3, T = 0.3, G = 0.2, C = 0.2.
Informatics challenges for next-generation sequence analysis
Variant calling: number of individuals vs. depth of read coverage Gabor T. Marth Boston College Biology Department 1000 Genomes Meeting Cold Spring Harbor.
Next-generation sequencing: the informatics angle
Next-generation sequencing: the informatics angle Gabor T. Marth Boston College Biology Department CHI Next-Generation Data Analysis meeting Providence,
Accessing and visualizing genomics data
Characterizing the short tandem repeat mutation process at every locus in the genome Melissa Gymrek Genome Informatics
Analyzing DNA using Microarray and Next Generation Sequencing (1) Background SNP Array Basic design Applications: CNV, LOH, GWAS Deep sequencing Alignment.
GSVCaller – R-based computational framework for detection and annotation of short sequence variations in the human genome Vasily V. Grinev Associate Professor.
SNP Discovery in Whole-Genome Light-Shotgun 454 Pyrosequences Aaron Quinlan 1, Andrew Clark 2, Elaine Mardis 3, Gabor Marth 1 (1) Department of Biology,
Canadian Bioinformatics Workshops
Introduction to Illumina Sequencing
From Reads to Results Exome-seq analysis at CCBR
Canadian Bioinformatics Workshops
Lesson: Sequence processing
Next generation sequencing
2nd (Next) Generation Sequencing
Discovery tools for human genetic variations
Data formats Gabor T. Marth Boston College
Next-generation DNA sequencing
BF528 - Genomic Variation and SNP Analysis
Presentation transcript:

Next-generation sequencing: informatics & software aspects Gabor T. Marth Boston College Biology Department

Next-gen data

Read length read length [bp] ~ (variable) (fixed) (fixed) (variable) 400

Paired fragment-end reads fragment amplification: fragment length bp fragment length limited by amplification efficiency Korbel et al. Science 2007 paired-end read can improve read mapping accuracy (if unique map positions are required for both ends) or efficiency (if fragment length constraint is used to rescue non-uniquely mapping ends) instrumental for structural variation discovery circularization: 500bp - 10kb (sweet spot ~3kb) fragment length limited by library complexity

Representational biases this affects genome resequencing (deeper starting read coverage is needed) will have major impact is on counting applications “dispersed” coverage distribution

Amplification errors many reads from clonal copies of a single fragment early PCR errors in “clonal” read copies lead to false positive allele calls early amplification error gets propagated into every clonal copy

Read quality

Error rate (Solexa)

Error rate (454)

Per-read errors (Solexa)

Per read errors (454)

Applications

Genome resequencing for variation discovery SNPs short INDELs structural variations the most immediate application area

Genome resequencing for mutational profiling Organismal reference sequence likely to change “classical genetics” and mutational analysis

De novo genome sequencing Lander et al. Nature 2001 difficult problem with short reads promising, especially as reads get longer

Identification of protein-bound DNA Chromatin structure (CHIP-SEQ) (Mikkelsen et al. Nature 2007) Transcription binding sites. (Robertson et al. Nature Methods, 2007) DNA methylation. (Meissner et al. Nature 2008) natural applications for next-gen. sequencers

Transcriptome sequencing: transcript discovery Mortazavi et al. Nature Methods 2008 Ruby et al. Cell, 2006 high-throughput, but short reads pose challenges

Transcriptome sequencing: expression profiling Jones-Rhoads et al. PLoS Genetics, 2007 Cloonan et al. Nature Methods, 2008 high-throughput, short-read sequencing should make a major impact, and potentially replace expression microarrays

Analysis software (resequencing)

Individual resequencing (iii) read assembly REF (ii) read mapping IND (i) base calling IND (iv) SNP and short INDEL calling (vi) data validation, hypothesis generation (v) SV calling

The variation discovery “toolbox” base callers read mappers SNP callers SV callers assembly viewers

1. Base calling base sequence base quality (Q-value) sequence diverse chemistry & sequencing error profiles

454 pyrosequencer error profile multiple bases in a homo-polymeric run are incorporated in a single incorporation test  the number of bases must be determined from a single scalar signal  the majority of errors are INDELs

454 base quality values the native 454 base caller assigns too low base quality values

PYROBAYES: determine base number

PYROBAYES: Performance better correlation between assigned and measured quality values higher fraction of high-quality bases

Base quality value calibration Raw Illumina reads (1000G data)

Recalibrated base quality values (Illumina) Recalicrated Illumina reads (1000G data)

… and they give you the picture on the box 2. Read mapping Read mapping is like doing a jigsaw puzzle… …you get the pieces… Unique pieces are easier to place than others…

Non-uniqueness of reads confounds mapping Reads from repeats cannot be uniquely mapped back to their true region of origin RepeatMasker does not capture all micro-repeats, i.e. repeats at the scale of the read length

Strategies to deal with non-unique mapping Non-unique read mapping: optionally either only report uniquely mapped reads or report all map locations for each read (mapping quality values for all mapped reads are being implemented) read mapping to multiple loci requires the assignment of alignment probabilities (mapping qualities)

Longer reads are easier to map 454 FLX (1000G data)

Paired-end reads help unique read placement fragment amplification: fragment length bp fragment length limited by amplification efficiency Korbel et al. Science 2007 circularization: 500bp - 10kb (sweet spot ~3kb) fragment length limited by library complexity PE MP PE reads are now the standard for genome resequencing

MOSAIK

INDEL alleles/errors – gapped alignments 454

Aligning multiple read types together ABI/capillary 454 FLX 454 GS20 Illumina Alignment and co- assembly of multiple reads types permits simultaneous analysis of data from multiple sources and error characteristics

Aligner speed

3. Polymorphism / mutation detection sequencing error polymorphism

Allele calling in “trad” sequences capillary sequences: either clonal or diploid traces

Allele calling in next-gen data SNP INS New technologies are perfectly suitable for accurate SNP calling, and some also for short- INDEL detection

Human genome polymorphism projects common SNPs

Human genome polymorphism discovery

The 1000 Genomes Project

New challenges for SNP calling deep alignments of 100s / 1000s of individuals trio sequences

Rare alleles in 100s / 1,000s of samples

Allele discovery is a multi-step sampling process Population SamplesReads Allele detection

Capturing the allele in the sample

Allele calling in deep sequence data aatgtagtaAgtacctac aatgtagtaCgtacctac aatgtagtaAgtacctac Q30Q40Q50Q

Allele calling in the reads base call sample size individual read coverage base quality

More samples or deeper coverage / sample? Shallower read coverage from more individuals … …or deeper coverage from fewer samples? simulation analysis by Aaron Quinlan

Analysis indicates a balance

SNP calling in trios the child inherits one chromosome from each parent there is a small probability for a mutation in the child

SNP calling in trios aatgtagtaAgtacctac aatgtagtaCgtacctac aatgtagtaAgtacctac aatgtagtaCgtacctac mother father child P=0.79 P=0.86

Determining genotype directly from sequence AACGTTAGCATA AACGTTCGCATA AACGTTAGCATA individual 1 individual 3 individual 2 A/C C/CC/C A/A

4. Structural variation discovery

SV events from PE read mapping patterns

Deletion: Aberrant positive mapping distance

Copy number estimation from depth of coverage

Spanner – a hybrid SV/CNV detection tool Navigation bar Fragment lengths in selected region Depth of coverage in selected region

5. Data visualization 1.aid software development: integration of trace data viewing, fast navigation, zooming/panning 2.facilitate data validation (e.g. SNP validation): simultanous viewing of multiple read types, quality value displays 3.promote hypothesis generation: integration of annotation tracks

Data visualization

New analysis tools are needed 1.Tailoring existing tools for specialized applications (e.g. read mappers for transcriptome sequencing) 2.Analysis pipelines and viewers that focus on the essential results e.g. the few mutations in a mutant, or compare 1000 genome sequences (but hide most details) 3.Work-bench style tools to support downstream analysis

Data storage and data standards

What level of data to store? images traces base quality values base-called reads

Data standards Sequence Read Format, SRF (Asim Siddiqui, UBC) Assembly format working group Genotype Likelihood Format (Richard Durbin, Sanger)

Summary

Conclusions: next-gen sequencing software Next-generation sequencing is a boon for mass-scale human resequencing, whole-genome mutational profiling, expression analysis and epigenetic studies Informatics tools already effective for basic applications There is a need both for “generic” analysis tools e.g. flexible read aligners and for specialized tools tailored to specific applications (e.g. expression profiling) Move toward tools that focus on biological analysis Most challenges are technical in nature (e.g. data storage, useful data formats, fast read mapping)

Roche / 454 system pyrosequencing technology variable read-length the only new technology with >100bp reads

Illumina / Solexa Genome Analyzer fixed-length short-read sequencer very high throughput read properties are very close to traditional capillary sequences low INDEL error rate

AB / SOLiD system ACGT A C G T 2 nd Base 1 st Base fixed-length short-reads very high throughput 2-base encoding system color-space informatics

Helicos / Heliscope system short-read sequencer single molecule sequencing no amplification variable read-length error rate reduced with 2- pass template sequencing

Data characteristics

Data standards different data storage needs (archival, transfer, processing) often poses contradictory requirements (e.g. normalized vs. non-normalized storage of assembly, alignment, read, image data) even different analysis goals often call for different optimal storage / data access strategies (e.g. paired-end read analysis for SV detection vs. SNP calling) requirements include binary formats, fast sequential and / or random access, and flexible indexing (e.g. an entire genome assembly can no longer reside in RAM)