Presentation is loading. Please wait.

Presentation is loading. Please wait.

Computational Phylogenomics and Metagenomics Tandy Warnow Departments of Bioengineering and Computer Science The University of Illinois at Urbana-Champaign.

Similar presentations


Presentation on theme: "Computational Phylogenomics and Metagenomics Tandy Warnow Departments of Bioengineering and Computer Science The University of Illinois at Urbana-Champaign."— Presentation transcript:

1 Computational Phylogenomics and Metagenomics Tandy Warnow Departments of Bioengineering and Computer Science The University of Illinois at Urbana-Champaign http://tandy.cs.illinois.edu

2 The “Tree of Life” Applications of phylogenies to: protein structure and function population genetics human migrations

3 Challenges: gene tree conflict due to incomplete lineage sorting, horizontal gene transfer, or gene duplication and loss.

4

5 1. What is this fragment? (Classify each fragment as well as possible.) 2. What is the taxonomic distribution in the dataset? (Note: helpful to use marker genes.) 3. What are the organisms in this metagenomic sample doing together? Basic Questions

6 Computational Phylogenetics and Metagenomics Courtesy of the Tree of Life project

7 Phylogenomic pipeline Select taxon set and markers Gather and screen sequence data, possibly identify orthologs Compute multiple sequence alignments for each locus Compute species tree or network: – Compute gene trees on the alignments and combine the estimated gene trees, OR – Perform “concatenation analysis” (aka “combined analysis”) Get statistical support on each branch (e.g., bootstrapping) Estimate dates on the nodes of the phylogeny Use species tree with branch support and dates to understand biology

8 Phylogenomic pipeline Select taxon set and markers Gather and screen sequence data, possibly identify orthologs Compute multiple sequence alignments for each locus Compute species tree or network: – Compute gene trees on the alignments and combine the estimated gene trees, OR – Perform “concatenation analysis” (aka “combined analysis”) Get statistical support on each branch (e.g., bootstrapping) Estimate dates on the nodes of the phylogeny Use species tree with branch support and dates to understand biology

9 Avian Phylogenomics Project (100+ people) G Zhang, BGI Approx. 50 species, whole genomes 8000+ genes, UCEs Gene sequence alignments and trees computed using SATé (Science 2009, Systematic Biology 2012) Concatenation analysis (multi-million site) using ExaML (new version of RAxML for very long alignments) MTP Gilbert, Copenhagen S. Mirarab Md. S. Bayzid UT-Austin UT-Austin T. Warnow UT-Austin Erich Jarvis, HHMI CHALLENGE: Massive gene tree incongruence suggestive of incomplete lineage sorting, but gene trees had poor resolution due to low phylogenetic signal Coalescent-based estimation methods had poor accuracy

10 1kp: Thousand Transcriptome Project (~40 people) Plant Tree of Life based on transcriptomes of ~1200 species More than 13,000 gene families (most not single copy) Gene Tree Incongruence G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, Md. S.Bayzid UT-Austin UT-Austin Challenges: 1. Alignment of datasets with > 100,000 sequences, with many fragmentary sequences 2. Gene tree incongruence due to ILS, too many species for standard methods

11 Ultra-large multiple-sequence alignment (briefly today) Metagenomic taxon identification and abundance profiling Species tree estimation from multiple genes in the presence of gene tree conflict (Math Colloquium, Oct 2) Current Research Projects

12 Alignment-free phylogeny estimation Supertree estimation Genome rearrangement phylogeny Reticulate evolution detection and reconstruction Data mining techniques to explore multiple optima Theoretical guarantees under Markov models of evolution Historical linguistics Other Research Projects

13 Phylogenetic Estimation: Big Data Challenges NP-hard problems Large datasets: 100,000+ sequences 10,000+ genes “BigData” complexity missing data mixture models errors in input data model misspecification streaming data

14 This talk Multiple sequence alignment methods, SATé (2009), PASTA (2014), and UPP (in preparation), and applications to metagenomic taxon identification (TIPP, submitted)

15 Multiple Sequence Alignment

16 DNA Sequence Evolution AAGACTT TGGACTTAAGGCCT -3 mil yrs -2 mil yrs -1 mil yrs today AGGGCATTAGCCCTAGCACTT AAGGCCTTGGACTT TAGCCCATAGACTTAGCGCTTAGCACAAAGGGCAT TAGCCCTAGCACTT AAGACTT TGGACTTAAGGCCT AGGGCATTAGCCCTAGCACTT AAGGCCTTGGACTT AGCGCTTAGCACAATAGACTTTAGCCCAAGGGCAT

17 Phylogeny Problem TAGCCCATAGACTTTGCACAATGCGCTTAGGGCAT UVWXY U VW X Y

18 AGAT TAGACTTTGCACAATGCGCTT AGGGCATGA UVWXY U VW X Y The “real” problem

19 …ACGGTGCAGTTACCA… MutationDeletion …ACCAGTCACCA… Indels (insertions and deletions)

20 …ACGGTGCAGTTACC-A… …AC----CAGTCACCTA… The true multiple alignment – Reflects historical substitution, insertion, and deletion events – Defined using transitive closure of pairwise alignments computed on edges of the true tree … ACGGTGCAGTTACCA … Substitution Deletion … ACCAGTCACCTA … Insertion

21 Input: unaligned sequences S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA

22 Phase 1: Alignment S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA

23 Phase 2: Construct tree S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 S4 S2 S3

24 Simulation Studies S1S2 S3S4 S1 = - AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 = - AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-C--T-----GACCGC-- S4 = T---C-A-CGACCGA----CA Compare True tree and alignment S1S4 S3S2 Estimated tree and alignment Unaligned Sequences

25 Quantifying Error FN: false negative (missing edge) FP: false positive (incorrect edge) 50% error rate FN FP

26 Two-phase estimation Alignment methods Clustal POY (and POY*) Probcons (and Probtree) Probalign MAFFT Muscle Di-align T-Coffee Prank (PNAS 2005, Science 2008) Opal (ISMB and Bioinf. 2007) FSA (PLoS Comp. Bio. 2009) Infernal (Bioinf. 2009) Etc. Phylogeny methods Bayesian MCMC Maximum parsimony Maximum likelihood Neighbor joining FastME UPGMA Quartet puzzling Etc. RAxML: heuristic for large-scale ML optimization

27 1000-taxon models, ordered by difficulty (Liu et al., 2009)

28 Re-aligning on a tree A B D C Merge sub- alignments Estimate ML tree on merged alignment Decompose dataset AB CD Align subproblem s AB CD ABCD

29 SATé and PASTA Algorithms Estimate ML tree on new alignment Tree Obtain initial alignment and estimated ML tree Use tree to compute new alignment Alignment If new alignment/tree pair has worse ML score, realign using a different decomposition Repeat until termination condition (typically, 24 hours)

30 1000 taxon models, ordered by difficulty SATé-1 24 hour analysis, on desktop machines (Similar improvements for biological datasets) SATé-1 can analyze up to about 30,000 sequences. SATé-1 (Science 2009) performance

31 1000 taxon models ranked by difficulty SATé-1 and SATé-2 (Systematic Biology, 2012)

32 PASTA (2014): even better than SATé-2

33 1kp: Thousand Transcriptome Project Plant Tree of Life based on transcriptomes of ~1200 species More than 13,000 gene families (most not single copy) Gene Tree Incongruence G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, Md. S.Bayzid UT-Austin UT-Austin Challenge: Alignment of datasets with > 100,000 sequences with many fragmentary sequences Plus many many other people…

34 1KP dataset: more than 100,000 p450 sequences, many fragmentary All standard alignment methods we tested performed poorly.

35 UPP Basic approach: Select random subset of sequences, and build “backbone alignment” Construct a “Family of Hidden Markov Models” on the backbone alignment Add all remaining sequences to the backbone alignment using the Family of HMMs UPP can analyze much larger datasets than PASTA, and is highly robust to fragmentary sequences

36 One Hidden Markov Model for the entire alignment?

37 Or 2 HMMs?

38 Or 4 HMMs?

39 Impact of backbone size and use of HMM Family technique Notes: Relative performance under standard alignment criteria is not predictive of relative performance for tree estimation. For alignment estimation, a large backbone is important. For tree estimation, the use of the HMM Family is most important, but large backbones also help.

40 RNASim: alignment error Note: Mafft was run under default settings for 10K and 50K sequences and under Parttree for 100K sequences, and fails to complete under any setting For 200K sequences. Clustal-Omega only completes on 10K dataset. All methods given 24 hrs on a 12-core machine

41 RNASim: tree error Note: Mafft was run under default settings for 10K and 50K sequences and under Parttree for 100K sequences, and fails to complete under any setting For 200K sequences. Clustal-Omega only completes on 10K dataset. All methods given 24 hrs on a 12-core machine

42 RNASim Million Sequences: tree error Notes: PASTA cannot run on this dataset size, UPP(Fast,NoDecomp) took 2.2 days, and UPP(Fast) took 11.9 days (both using 12 processors).

43 Running Time Wall-clock time used (in hours) given 12 processors

44 Performance on fragmentary datasets of the 1000M2 model condition UPP vs. PASTA: impact of fragmentation Under high rates of evolution, PASTA is badly impacted by fragmentary sequences (the same is true for other methods). Under low rates of evolution, PASTA can still be highly accurate (data not shown). UPP continues to have good accuracy even on datasets with many fragments under all rates of evolution.

45 Impact of rate of evolution on performance on fragmentary sequence data

46 New Alignment Methods SATé-1 (Science 2009) can analyze 10,000 sequences SATé-2 (Systematic Biology 2012) can analyze 50,000 sequences, is faster and more accurate than SATé-1 PASTA (RECOMB 2014) can analyze 200,000 sequences, and is faster and more accurate than both SATé versions. UPP (in preparation) uses a very different technique than SATé and PASTA. – Fast – Scalable (up to 1,000,000 sequences) – Robust to fragmentary data

47

48 Metagenomic Taxon Identification Objective: classify short reads in a metagenomic sample

49 Objective: Distribution of the species (or genera, or families, etc.) within the sample. For example: The distribution of the sample at the species-level is: 50% species A 20% species B 15% species C 14% species D 1% species E Abundance Profiling

50 Leading techniques: PhymmBL (Brady & Salzberg, Nature Methods 2009) NBC (Rosen, Reichenberger, and Rosenfeld, Bioinformatics 2011) MetaPhyler (Liu et al., BMC Genomics 2011), from the Pop lab at the University of Maryland MetaPhlAn (Segata et al., Nature Methods 2012), from the Huttenhower Lab at Harvard mOTU (Bork et al., Nature Methods 2013) MetaPhyler, MetaPhlAn, and mOTU are marker-based techniques (but use different marker genes). Marker gene are typically single-copy, universal, and resistant to horizontal transmission. Abundance Profiling

51 High indel datasets containing known genomes Note: NBC, MetaPhlAn, and MetaPhyler cannot classify any sequences from at least one of the high indel long sequence datasets, and mOTU terminates with an error message on all the high indel datasets.

52 “Novel” genome datasets Note: mOTU terminates with an error message on the long fragment datasets and high indel datasets.

53 TIPP vs. other abundance profilers TIPP is highly accurate, even in the presence of high indel rates and novel genomes, and for both short and long reads. All other methods have some vulnerability (e.g., mOTU is only accurate for short reads and is impacted by high indel rates).

54 Phylogenetic “boosters” Goal: improve accuracy, speed, robustness, or theoretical guarantees of base methods Techniques: divide-and-conquer, iteration, chordal graph algorithms, and “bin-and-conquer” Examples: DCM-boosting for distance-based methods (1999) DCM-boosting for heuristics for NP-hard problems (1999) SATé- and PASTA-boosting for alignment methods (2009, 2012, and 2014) SuperFine-boosting for supertree methods (2012) DACTAL: almost alignment-free phylogeny estimation methods (2012) SEPP-boosting for phylogenetic placement of short sequences (2012) TIPP-boosting for metagenomic taxon identification (submitted) UPP-boosting for alignment methods (in preparation) Bin-and-conquer for coalescent-based species tree estimation (2013 and 2014)

55 Warnow Laboratory U Texas PhD students: Siavash Mirarab, Nam Nguyen (former), and Md. S. Bayzid Postdoctoral Fellow: Ruth Davidson (at UIUC) Lab Website: http://www.cs.utexas.edu/users/phylohttp://www.cs.utexas.edu/users/phylo Current and Past Funding: Guggenheim Foundation, Packard Foundation, NSF, Microsoft Research New England, and TACC (Texas Advanced Computing Center). HHMI graduate fellowship to Siavash Mirarab and Fulbright graduate fellowship to Md. S. Bayzid. http://tandy.cs.illiinois.eduhttp://tandy.cs.illiinois.eduTandy’s website

56

57 Challenges: Gene tree conflict due to incomplete lineage sorting, duplication and loss, recombination, etc. Reticulate evolution (horizontal gene transfer, hybridization) requiring phylogenetic networks.

58 Scientific challenges: Ultra-large multiple-sequence alignment Alignment-free phylogeny estimation Supertree estimation Estimating species trees from many gene trees Genome rearrangement phylogeny Reticulate evolution Visualization of large trees and alignments Data mining techniques to explore multiple optima Theoretical guarantees under Markov models of evolution Techniques: machine learning, applied probability theory, graph theory, combinatorial optimization, supercomputing, and heuristics The Tree of Life: Multiple Challenges

59 Combined analysis gene 1 S1S1 S2S2 S3S3 S4S4 S5S5 S6S6 S7S7 S8S8 gene 2gene 3 TCTAATGGAA GCTAAGGGAA TCTAAGGGAA TCTAACGGAA TCTAATGGAC TATAACGGAA GGTAACCCTC GCTAAACCTC GGTGACCATC GCTAAACCTC TATTGATACA TCTTGATACC TAGTGATGCA CATTCATACC TAGTGATGCA ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?

60 Red gene tree ≠ species tree (green gene tree okay)

61 The Coalescent Present Past Courtesy James Degnan

62 Incomplete Lineage Sorting (ILS) 1000+ papers in 2013 alone Confounds phylogenetic analysis for many groups: – Hominids – Birds – Yeast – Animals – Toads – Fish – Fungi There is substantial debate about how to analyze phylogenomic datasets in the presence of ILS.

63 Orangutan GorillaChimpanzee Human From the Tree of the Life Website, University of Arizona Species tree estimation: difficult, even for small datasets

64 1- Concatenation: statistically inconsistent (Roch & Steel 2014) 2- Summary methods: can be statistically consistent 3- Co-estimation methods: too slow for large datasets Species tree estimation

65 Is Concatenation Evil? Joseph Heled: – YES John Gatesy – No Data needed to held understand existing methods and their limitations Better methods are needed

66 Avian Phylogenomics Project (100+ people) G Zhang, BGI Approx. 50 species, whole genomes 8000+ genes, UCEs Gene sequence alignments and trees computed using SATé (Science 2009, Systematic Biology 2012) Concatenation analysis (multi-million site) using ExaML (new version of RAxML for very long alignments) Massive gene tree incongruence suggestive of incomplete lineage sorting -- coalescent-based species tree estimation computed using “Statistical Binning” (Science, in press) MTP Gilbert, Copenhagen S. Mirarab Md. S. Bayzid UT-Austin UT-Austin T. Warnow UT-Austin Erich Jarvis, HHMI

67 1kp: 1000 Plant Transcriptomes Whole Transcriptomes of 103 plant species and 850 single copy loci (1200 taxa in next phase) Most accurate summary methods cannot handle this size Common ancestor about 1 billion years ago and so gene trees are hard to root Most summary methods need rooted gene trees Pre-existing summary methods do not provide reasonable results on this dataset G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, UT-Austin UT-Austin UT-Austin Plus many many other people… [Wickett et al. (under review), 2014.]

68 Our methods “Statistical Binning” (accepted): uses a statistical method to determine sets of “combinable” gene sequence alignments, improves coalescent-based species tree estimation accuracy when gene trees have poor resolution (used for Avian Phylogenomics Project). ASTRAL (Bioinformatics 2014): polynomial time statistically consistent method, can run on very large datasets of unrooted gene trees.

69 Mammalian simulations Based on a biological mammalian dataset of 37 taxa and 442 genes, published by Song et al., PNAS, 2012. In simulations, we vary – Levels of ILS – Number of genes – Alignment length to control gene tree estimation error Compare ASTRAL to – MP-EST, BUCKy – Concatenation – MRP, Greedy Measure species tree error compared to the known true tree

70 ASTRAL vs. Concatenation 200 genes, 500bp Less ILS

71 Analyses of the Song et al. Mammalian dataset The placement of Scandentia (Tree Shrew) is controversial. The ASTRAL analysis agrees with maximum likelihood concatenation analysis of this dataset.

72 Summary New multiple sequence alignments with improved accuracy and scalability, as well as high robustness to fragmentary data – SATé used in many studies. New coalescent-based species tree estimation methods that have better accuracy than current methods, and can analyze large datasets (used in 1KP and Avian Phylogenomics project analyses) New methods for metagenomic taxon identification and abundance profiling with improved accuracy (will be used in analyses here at Illinois) Method development inspired by collaboration with biologists, and improves biological analyses.

73 AA Sequence Alignment Error (13 HomFam datasets) Homfam: Sievers et al., MSB 2011 10,000 to 46,000 sequences per dataset; 5-14 sequences in each seed alignment Sequence lengths from 46-364 AA

74 Alignment Accuracy – Correct columns

75 Other co-estimation methods Statistical methods: BAli-Phy (Redelings and Suchard): Bayesian software to co- estimate alignments and trees under a statistical model of evolution that includes indels. Can scale to about 100 sequences, but takes a very long time. – http://www.bali-phy.org/ http://www.bali-phy.org/ StatAlign: http://statalign.github.io/ Extensions of Parsimony POY (most well known software) – http://www.amnh.org/our-research/computational- sciences/research/projects/systematic-biology/poy BeeTLe (Liu and Warnow, PLoS One 2012)

76 Horizontal Gene Transfer – Phylogenetic Networks Ford Doolittle

77 Warnow Laboratory PhD students: Siavash Mirarab*, Nam Nguyen, and Md. S. Bayzid** Undergrad: Keerthana Kumar Lab Website: http://www.cs.utexas.edu/users/phylohttp://www.cs.utexas.edu/users/phylo Funding: Guggenheim Foundation, Packard, NSF, Microsoft Research New England, David Bruton Jr. Centennial Professorship, TACC (Texas Advanced Computing Center), and the University of Alberta (Canada) TACC and UTCS computational resources * Supported by HHMI Predoctoral Fellowship ** Supported by Fulbright Foundation Predoctoral Fellowship

78 But… Gene trees may not be identical to species trees: –Incomplete Lineage Sorting (deep coalescence) –Gene duplication and loss –Horizontal gene transfer This makes combined analysis and standard supertree analyses inappropriate

79 ... Analyze separately Summary Method Two competing approaches gene 1 gene 2... gene k... Concatenation Species

80 ... How to compute a species tree?

81 Statistically consistent under ILS? MP-EST (Liu et al. 2010): maximum likelihood estimation of rooted species tree – YES BUCKy-pop (Ané and Larget 2010): quartet-based Bayesian species tree estimation –YES MDC – NO Greedy – NO Concatenation under maximum likelihood – NO MRP (supertree method) – open

82 The Debate: Concatenation vs. Coalescent Estimation In favor of coalescent-based estimation – Statistical consistency guarantees – Addresses gene tree incongruence resulting from ILS – Some evidence that concatenation can be positively misleading In favor of concatenation – Reasonable results on data – High bootstrap support – Summary methods (that combine gene trees) can have poor support or miss well-established clades entirely – Some methods (such as *BEAST) are computationally too intensive to use

83 Results on 11-taxon datasets with strongILS * BEAST more accurate than summary methods (MP-EST, BUCKy, etc) CA-ML: (concatenated analysis) also very accurate Datasets from Chung and Ané, 2011 Bayzid & Warnow, Bioinformatics 2013

84 Species tree/network estimation Methods have been developed to estimate species phylogenies (trees or networks!) from gene trees, when gene trees can conflict from each other (e.g., due to ILS, gene duplication and loss, and horizontal gene transfer). Phylonet (software suite), has effective methods for many optimization problems – including MDC and maximum likelihood. Tutorial on Wednesday. Software available at http://bioinfo.cs.rice.edu/phylonet?destination=node/3 http://bioinfo.cs.rice.edu/phylonet?destination=node/3

85 Metagenomic Taxon Identification Objective: classify short reads in a metagenomic sample

86 1. What is this fragment? (Classify each fragment as well as possible.) 2. What is the taxonomic distribution in the dataset? (Note: helpful to use marker genes.) Two Basic Questions

87 SEPP SEPP: SATé-enabled Phylogenetic Placement, by Mirarab, Nguyen, and Warnow Pacific Symposium on Biocomputing, 2012 (special session on the Human Microbiome) Tutorial on Thursday.

88 Other problems Genomic MSA estimation: – Multiple sequence alignment of very long sequences – Multiple sequence alignment of sequences that evolve with rearrangement events Phylogeny estimation under more complex models – Heterotachy – Violation of the rates-across-sites assumption – Rearrangements Estimating branch support on very large datasets

89 New methods for estimating sequence alignments, gene trees, and species trees, with applications to metagenomics Tandy Warnow Departments of Bioengineering and Computer Science The University of Illinois at Urbana-Champaign http://tandy.cs.illinois.edu

90 Challenges: gene tree conflict due to incomplete lineage sorting, horizontal gene transfer, or gene duplication and loss.

91 Phylogenomic pipeline Select taxon set and markers Gather and screen sequence data, possibly identify orthologs Compute multiple sequence alignments for each locus Compute species tree or network: – Compute gene trees on the alignments and combine the estimated gene trees, OR – Perform “concatenation analysis” (aka “combined analysis”) Get statistical support on each branch (e.g., bootstrapping) Estimate dates on the nodes of the phylogeny Use species tree with branch support and dates to understand biology

92 Phylogenetic Estimation: Big Data Challenges NP-hard problems Large datasets: 100,000+ sequences 10,000+ genes “BigData” complexity missing data mixture models errors in input data model misspecification streaming data

93 1. What is this fragment? (Classify each fragment as well as possible.) 2. What is the taxonomic distribution in the dataset? (Note: helpful to use marker genes.) 3. What are the organisms in this metagenomic sample doing together? Basic Questions

94 What I do I develop new methods for difficult computational problems, to improve the accuracy of the biological analyses. Collaborations drive method development.

95 Avian Phylogenomics Project (100+ people) G Zhang, BGI Approx. 50 species, whole genomes 8000+ genes, UCEs Gene sequence alignments and trees computed using SATé (Science 2009, Systematic Biology 2012) Concatenation analysis (multi-million site) using ExaML (new version of RAxML for very long alignments) MTP Gilbert, Copenhagen S. Mirarab Md. S. Bayzid UT-Austin UT-Austin T. Warnow UT-Austin Erich Jarvis, HHMI CHALLENGE: Massive gene tree incongruence suggestive of incomplete lineage sorting, but gene trees had poor resolution due to low phylogenetic signal Coalescent-based estimation methods had poor accuracy

96 1kp: Thousand Transcriptome Project (~40 people) Plant Tree of Life based on transcriptomes of ~1200 species More than 13,000 gene families (most not single copy) Gene Tree Incongruence G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, Md. S.Bayzid UT-Austin UT-Austin Challenges: 1. Alignment of datasets with > 100,000 sequences, with many fragmentary sequences 2. Gene tree incongruence due to ILS, too many species for standard methods

97 This talk Multiple sequence alignment methods, SATé (2009), PASTA (2014), and UPP (in preparation), and applications to metagenomic taxon identification (TIPP, submitted) New coalescent-based species tree estimation methods for: –Avian Phylogenomics Project (submitted) and –1KP, the Thousand Plant Transcriptome Project (submitted)

98 Phylogenies and Applications Basic Biology: How did life evolve? Applications of phylogenies to: protein structure and function population genetics human migrations

99

100 Computational Phylogenetics and Metagenomics Courtesy of the Tree of Life project

101 Multiple Sequence Alignment (MSA): another grand challenge 1 S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- … Sn = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC … Sn = TCACGACCGACA Novel techniques needed for scalability and accuracy NP-hard problems and large datasets Current methods do not provide good accuracy Few methods can analyze even moderately large datasets Many important applications besides phylogenetic estimation 1 Frontiers in Massive Data Analysis, National Academies Press, 2013

102 DNA Sequence Evolution AAGACTT TGGACTTAAGGCCT -3 mil yrs -2 mil yrs -1 mil yrs today AGGGCATTAGCCCTAGCACTT AAGGCCTTGGACTT TAGCCCATAGACTTAGCGCTTAGCACAAAGGGCAT TAGCCCTAGCACTT AAGACTT TGGACTTAAGGCCT AGGGCATTAGCCCTAGCACTT AAGGCCTTGGACTT AGCGCTTAGCACAATAGACTTTAGCCCAAGGGCAT

103 Phylogeny Problem TAGCCCATAGACTTTGCACAATGCGCTTAGGGCAT UVWXY U VW X Y

104 AGAT TAGACTTTGCACAATGCGCTT AGGGCATGA UVWXY U VW X Y The “real” problem

105 …ACGGTGCAGTTACCA… MutationDeletion …ACCAGTCACCA… Indels (insertions and deletions)

106 …ACGGTGCAGTTACC-A… …AC----CAGTCACCTA… The true multiple alignment – Reflects historical substitution, insertion, and deletion events – Defined using transitive closure of pairwise alignments computed on edges of the true tree … ACGGTGCAGTTACCA … Substitution Deletion … ACCAGTCACCTA … Insertion

107 Input: unaligned sequences S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA

108 Phase 1: Alignment S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA

109 Phase 2: Construct tree S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 S4 S2 S3

110 Phylogenomic pipeline Select taxon set and markers Gather and screen sequence data, possibly identify orthologs Compute multiple sequence alignments for each locus Compute species tree or network: – Compute gene trees on the alignments and combine the estimated gene trees, OR – Estimate a tree from a concatenation of the multiple sequence alignments Get statistical support on each branch (e.g., bootstrapping) Estimate dates on the nodes of the phylogeny Use species tree with branch support and dates to understand biology

111 Phylogenomic pipeline Select taxon set and markers Gather and screen sequence data, possibly identify orthologs Compute multiple sequence alignments for each locus Compute species tree or network: – Compute gene trees on the alignments and combine the estimated gene trees, OR – Estimate a tree from a concatenation of the multiple sequence alignments Get statistical support on each branch (e.g., bootstrapping) Estimate dates on the nodes of the phylogeny Use species tree with branch support and dates to understand biology

112 Large-scale Alignment Estimation Many genes are considered unalignable due to high rates of evolution Only a few methods can analyze large datasets iPlant (NSF Plant Biology Collaborative) and other projects planning to construct phylogenies with 500,000 taxa

113 Hard Computational Problems NP-hard problems Large datasets 100,000+ sequences thousands of genes “Big data” complexity: model misspecification fragmentary sequences errors in input data streaming data

114 This talk “Big data” multiple sequence alignment SATé (2009, 2012) and PASTA (2014), methods for co-estimation of alignments and trees The HMM Family technique, and applications to –phylogenetic placement (SEPP, PSB 2012), –multiple sequence alignment (UPP, in preparation), and –metagenomic taxon identification (TIPP, submitted).

115 Multiple Sequence Alignment

116 First Align, then Compute the Tree S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 S4 S2 S3

117 Simulation Studies S1S2 S3S4 S1 = - AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 = - AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-C--T-----GACCGC-- S4 = T---C-A-CGACCGA----CA Compare True tree and alignment S1S4 S3S2 Estimated tree and alignment Unaligned Sequences

118 Quantifying Error FN: false negative (missing edge) FP: false positive (incorrect edge) 50% error rate FN FP

119 Two-phase estimation Alignment methods Clustal POY (and POY*) Probcons (and Probtree) Probalign MAFFT Muscle Di-align T-Coffee Prank (PNAS 2005, Science 2008) Opal (ISMB and Bioinf. 2007) FSA (PLoS Comp. Bio. 2009) Infernal (Bioinf. 2009) Etc. Phylogeny methods Bayesian MCMC Maximum parsimony Maximum likelihood Neighbor joining FastME UPGMA Quartet puzzling Etc. RAxML: heuristic for large-scale ML optimization

120 1000-taxon models, ordered by difficulty (Liu et al., 2009)

121 Re-aligning on a tree A B D C Merge sub- alignments Estimate ML tree on merged alignment Decompose dataset AB CD Align subproblem s AB CD ABCD

122 SATé and PASTA Algorithms Estimate ML tree on new alignment Tree Obtain initial alignment and estimated ML tree Use tree to compute new alignment Alignment If new alignment/tree pair has worse ML score, realign using a different decomposition Repeat until termination condition (typically, 24 hours)

123 1000 taxon models, ordered by difficulty SATé-1 24 hour analysis, on desktop machines (Similar improvements for biological datasets) SATé-1 can analyze up to about 30,000 sequences. SATé-1 (Science 2009) performance

124 1000 taxon models ranked by difficulty SATé-1 and SATé-2 (Systematic Biology, 2012)

125 PASTA (2014): even better than SATé-2

126 1kp: Thousand Transcriptome Project Plant Tree of Life based on transcriptomes of ~1200 species More than 13,000 gene families (most not single copy) Gene Tree Incongruence G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, Md. S.Bayzid UIUC UT-Austin UT-Austin UT-Austin Challenge: Alignment of datasets with > 100,000 sequences with many fragmentary sequences Plus many many other people…

127 1KP dataset: more than 100,000 p450 amino-acid sequences, many fragmentary

128 1KP dataset: more than 100,000 p450 amino-acid sequences, many fragmentary All standard multiple sequence alignment methods we tested performed poorly on datasets with fragments.

129 Phylogenetic Placement ACT..TAGA..AAGC...ACATAGA...CTTTAGC...CCAAGG...GCAT ACCG CGAG CGG GGCT TAGA GGGGG TCGAG GGCG GGG. ACCT Fragmentary sequences from some gene Full-length sequences for same gene, and an alignment and a tree

130 SEPP SEPP: SATé-enabled Phylogenetic Placement, by Mirarab, Nguyen, and Warnow. Pacific Symposium on Biocomputing, 2012, special session on the Human Microbiome Objective: –phylogenetic analysis of single-gene datasets with fragmentary sequences Introduces “HMM Family” technique

131 Step 1: Align each query sequence to backbone alignment Step 2: Place each query sequence into backbone tree, using extended alignment Phylogenetic Placement

132 Align Sequence S1 S4 S2 S3 S1 = -AGGCTATCACCTGACCTCCA-AA S2 = TAG-CTATCAC--GACCGC--GCA S3 = TAG-CT-------GACCGC--GCT S4 = TAC----TCAC--GACCGACAGCT Q1 = TAAAAC

133 Align Sequence S1 S4 S2 S3 S1 = -AGGCTATCACCTGACCTCCA-AA S2 = TAG-CTATCAC--GACCGC--GCA S3 = TAG-CT-------GACCGC--GCT S4 = TAC----TCAC--GACCGACAGCT Q1 = -------T-A--AAAC--------

134 Place Sequence S1 S4 S2 S3 Q1 S1 = -AGGCTATCACCTGACCTCCA-AA S2 = TAG-CTATCAC--GACCGC--GCA S3 = TAG-CT-------GACCGC--GCT S4 = TAC----TCAC--GACCGACAGCT Q1 = -------T-A--AAAC--------

135 Phylogenetic Placement Align each query sequence to backbone alignment –HMMALIGN (Eddy, Bioinformatics 1998) –PaPaRa (Berger and Stamatakis, Bioinformatics 2011) Place each query sequence into backbone tree –Pplacer (Matsen et al., BMC Bioinformatics, 2011) –EPA (Berger and Stamatakis, Systematic Biology 2011) Note: pplacer and EPA use maximum likelihood, and are reported to have the same accuracy.

136 HMMER vs. PaPaRa Alignments Increasing rate of evolution 0.0

137 HMMER+pplacer: 1) build one HMM for the entire alignment 2) Align fragment to the HMM, and insert into alignment 3) Insert fragment into tree to optimize likelihood

138 One Hidden Markov Model for the entire alignment?

139 SEPP(10%), based on ~10 HMMs 0.0 Increasing rate of evolution

140 SEPP produced more accurate phylogenetic placements than HMMER+pplacer. The only difference is the use of a Family of HMMs instead of one HMM. The biggest differences are for datasets with high rates of evolution. SEPP vs. HMMER+pplacer

141 UPP: large-scale MSA estimation UPP = “Ultra-large multiple sequence alignment using Phylogeny-aware Profiles” Nguyen, Mirarab, and Warnow. In preparation. Objective: highly accurate large-scale multiple sequence alignments, even in the presence of fragmentary sequences. Uses a variant of the HMM Family technique in SEPP

142 UPP Algorithmic Approach Select random subset of sequences, and build “backbone alignment” Construct a “Family of Hidden Markov Models” on the backbone alignment (the family has HMMs on many subsets of different sizes, not disjoint) Add all remaining sequences to the backbone alignment using the Family of HMMs

143 Evaluation Simulated datasets (some have fragmentary sequences): – 10K to 1,000,000 sequences in RNASim (Guo, Wang, and Kim, arxiv) – 1000-sequence nucleotide datasets from SATé papers – 5000-sequence AA datasets (from FastTree paper) – 10,000-sequence Indelible nucleotide simulation Biological datasets: – Proteins: largest BaliBASE and HomFam – RNA: 3 CRW datasets up to 28,000 sequences

144 Summary SATé-1 (Science 2009), SATé-2 (Systematic Biology 2012), and PASTA (RECOMB 2014): methods for co-estimating gene trees and multiple sequence alignments. PASTA can analyze up to 200,000 sequences, and is highly accurate for full-length sequences. – But none of these methods are robust to fragmentary sequences. HMM Family technique: uses an ensemble of HMMs to represent a “backbone alignment”. HMM families improve accuracy, especially in the presence of high rates of evolution. Applications of HMM Families in: – SEPP (phylogenetic placement) – UPP (ultra-large multiple sequence alignment) up to 1,000,000 sequences – TIPP (metagenomic taxon identification and abundance profiling)

145 Acknowledgments PhD students: Siavash Mirarab*, Nam Nguyen, and Md. S. Bayzid** Undergrad: Keerthana Kumar Lab Website: http://www.cs.utexas.edu/users/phylohttp://www.cs.utexas.edu/users/phylo Personal Website: http://tandy.cs.illinois.eduhttp://tandy.cs.illinois.edu Funding: Guggenheim Foundation, NSF, Microsoft Research New England, David Bruton Jr. Centennial Professorship, TACC (Texas Advanced Computing Center), and the University of Alberta (Canada) TACC and UTCS computational resources * Supported by HHMI Predoctoral Fellowship ** Supported by Fulbright Foundation Predoctoral Fellowship

146

147 1. What is this fragment? (Classify each fragment as well as possible.) 2. What is the taxonomic distribution in the dataset? (Note: helpful to use marker genes.) 3. What are the organisms in this metagenomic sample doing together? Basic Questions

148 Phylogenetic Placement ACT..TAGA..AAGC...ACATAGA...CTTTAGC...CCAAGG...GCAT ACCG CGAG CGG GGCT TAGA GGGGG TCGAG GGCG GGG. ACCT Fragmentary sequences from some gene Full-length sequences for same gene, and an alignment and a tree

149 TIPP: SEPP + statistics SEPP has high recall but low precision (classifies almost everything) TIPP: dramatically reduces false positive rate with small reduction in true positive rate, by considering uncertainty in alignment (HMMER) and placement (pplacer) TIPP: Taxon Identification and Phylogenetic Profiling. N. Nguyen, S. Mirarab, and T. Warnow. Under review.

150 Algorithmic Strategies Divide-and-conquer Chordal graph decompositions Iteration Multiple HMMs Bin-and-conquer (technique used for improving species tree estimation from multiple gene trees, Bayzid and Warnow, Bioinformatics 2013)

151 1kp: 1000 Plant Transcriptomes Whole Transcriptomes of 103 plant species and 850 single copy loci (1200 taxa in next phase) Most accurate summary methods cannot handle this size Common ancestor about 1 billion years ago and so gene trees are hard to root Most summary methods need rooted gene trees Pre-existing summary methods do not provide reasonable results on this dataset G. Ka-Shu Wong U Alberta N. Wickett Northwestern J. Leebens-Mack U Georgia N. Matasci iPlant T. Warnow, S. Mirarab, N. Nguyen, UT-Austin UT-Austin UT-Austin Plus many many other people… [Wickett et al. (under review), 2014.]

152 Combined analysis gene 1 S1S1 S2S2 S3S3 S4S4 S5S5 S6S6 S7S7 S8S8 gene 2gene 3 TCTAATGGAA GCTAAGGGAA TCTAAGGGAA TCTAACGGAA TCTAATGGAC TATAACGGAA GGTAACCCTC GCTAAACCTC GGTGACCATC GCTAAACCTC TATTGATACA TCTTGATACC TAGTGATGCA CATTCATACC TAGTGATGCA ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?

153 Red gene tree ≠ species tree (green gene tree okay)

154 The Coalescent Present Past Courtesy James Degnan

155 Incomplete Lineage Sorting (ILS) 1000+ papers in 2013 alone Confounds phylogenetic analysis for many groups: – Hominids – Birds – Yeast – Animals – Toads – Fish – Fungi There is substantial debate about how to analyze phylogenomic datasets in the presence of ILS.

156 Orangutan GorillaChimpanzee Human From the Tree of the Life Website, University of Arizona Species tree estimation: difficult, even for small datasets

157 1- Concatenation: statistically inconsistent (Roch & Steel 2014) 2- Summary methods: can be statistically consistent 3- Co-estimation methods: too slow for large datasets Species tree estimation

158 Is Concatenation Evil? Joseph Heled: – YES John Gatesy – No Data needed to held understand existing methods and their limitations Better methods are needed

159 Avian Phylogenomics Project (100+ people) G Zhang, BGI Approx. 50 species, whole genomes 8000+ genes, UCEs Gene sequence alignments and trees computed using SATé (Science 2009, Systematic Biology 2012) Concatenation analysis (multi-million site) using ExaML (new version of RAxML for very long alignments) Massive gene tree incongruence suggestive of incomplete lineage sorting -- coalescent-based species tree estimation computed using “Statistical Binning” (Science, in press) MTP Gilbert, Copenhagen S. Mirarab Md. S. Bayzid UT-Austin UT-Austin T. Warnow UT-Austin Erich Jarvis, HHMI

160 Our methods “Statistical Binning” (accepted): uses a statistical method to determine sets of “combinable” gene sequence alignments, improves coalescent-based species tree estimation accuracy when gene trees have poor resolution (used for Avian Phylogenomics Project). ASTRAL (Bioinformatics 2014): polynomial time statistically consistent method, can run on very large datasets of unrooted gene trees.

161 Mammalian simulations Based on a biological mammalian dataset of 37 taxa and 442 genes, published by Song et al., PNAS, 2012. In simulations, we vary – Levels of ILS – Number of genes – Alignment length to control gene tree estimation error Compare ASTRAL to – MP-EST, BUCKy – Concatenation – MRP, Greedy Measure species tree error compared to the known true tree

162 ASTRAL vs. Concatenation 200 genes, 500bp Less ILS

163 Analyses of the Song et al. Mammalian dataset The placement of Scandentia (Tree Shrew) is controversial. The ASTRAL analysis agrees with maximum likelihood concatenation analysis of this dataset.

164 Summary New multiple sequence alignments with improved accuracy and scalability, as well as high robustness to fragmentary data – SATé used in many studies. New coalescent-based species tree estimation methods that have better accuracy than current methods, and can analyze large datasets (used in 1KP and Avian Phylogenomics project analyses) New methods for metagenomic taxon identification and abundance profiling with improved accuracy (will be used in analyses here at Illinois) Method development inspired by collaboration with biologists, and improves biological analyses.

165 AA Sequence Alignment Error (13 HomFam datasets) Homfam: Sievers et al., MSB 2011 10,000 to 46,000 sequences per dataset; 5-14 sequences in each seed alignment Sequence lengths from 46-364 AA

166 Other co-estimation methods Statistical methods: BAli-Phy (Redelings and Suchard): Bayesian software to co- estimate alignments and trees under a statistical model of evolution that includes indels. Can scale to about 100 sequences, but takes a very long time. – http://www.bali-phy.org/ http://www.bali-phy.org/ StatAlign: http://statalign.github.io/ Extensions of Parsimony POY (most well known software) – http://www.amnh.org/our-research/computational- sciences/research/projects/systematic-biology/poy BeeTLe (Liu and Warnow, PLoS One 2012)

167 Horizontal Gene Transfer – Phylogenetic Networks Ford Doolittle

168 But… Gene trees may not be identical to species trees: –Incomplete Lineage Sorting (deep coalescence) –Gene duplication and loss –Horizontal gene transfer This makes combined analysis and standard supertree analyses inappropriate

169 ... Analyze separately Summary Method Two competing approaches gene 1 gene 2... gene k... Concatenation Species

170 ... How to compute a species tree?

171 Statistically consistent under ILS? MP-EST (Liu et al. 2010): maximum likelihood estimation of rooted species tree – YES BUCKy-pop (Ané and Larget 2010): quartet-based Bayesian species tree estimation –YES MDC – NO Greedy – NO Concatenation under maximum likelihood – NO MRP (supertree method) – open

172 The Debate: Concatenation vs. Coalescent Estimation In favor of coalescent-based estimation – Statistical consistency guarantees – Addresses gene tree incongruence resulting from ILS – Some evidence that concatenation can be positively misleading In favor of concatenation – Reasonable results on data – High bootstrap support – Summary methods (that combine gene trees) can have poor support or miss well-established clades entirely – Some methods (such as *BEAST) are computationally too intensive to use

173 Results on 11-taxon datasets with strongILS * BEAST more accurate than summary methods (MP-EST, BUCKy, etc) CA-ML: (concatenated analysis) also very accurate Datasets from Chung and Ané, 2011 Bayzid & Warnow, Bioinformatics 2013

174 Species tree/network estimation Methods have been developed to estimate species phylogenies (trees or networks!) from gene trees, when gene trees can conflict from each other (e.g., due to ILS, gene duplication and loss, and horizontal gene transfer). Phylonet (software suite), has effective methods for many optimization problems – including MDC and maximum likelihood. Tutorial on Wednesday. Software available at http://bioinfo.cs.rice.edu/phylonet?destination=node/3 http://bioinfo.cs.rice.edu/phylonet?destination=node/3

175 1. What is this fragment? (Classify each fragment as well as possible.) 2. What is the taxonomic distribution in the dataset? (Note: helpful to use marker genes.) Two Basic Questions

176 SEPP SEPP: SATé-enabled Phylogenetic Placement, by Mirarab, Nguyen, and Warnow Pacific Symposium on Biocomputing, 2012 (special session on the Human Microbiome) Tutorial on Thursday.

177 Other problems Genomic MSA estimation: – Multiple sequence alignment of very long sequences – Multiple sequence alignment of sequences that evolve with rearrangement events Phylogeny estimation under more complex models – Heterotachy – Violation of the rates-across-sites assumption – Rearrangements Estimating branch support on very large datasets


Download ppt "Computational Phylogenomics and Metagenomics Tandy Warnow Departments of Bioengineering and Computer Science The University of Illinois at Urbana-Champaign."

Similar presentations


Ads by Google