Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1.

Similar presentations


Presentation on theme: "1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1."— Presentation transcript:

1 1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1

2 2011 2008 A Big Problem...

3  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish

4 High-throughput Data Acquisition In 11 Days Generates 4TB of raw data 600,000,000,000 bases of DNA sequence (200 human genomes)

5 5 and it a global phenomenon

6 $70K for ~30 camera sets ~200 movies of plants undergoing a dynamic growth process “Only” 4GB a day High-throughput Phenotyping (Watching Grass Grow)

7 Big Data in Ecology Global Multidimensional Data

8 GGGTGCCCAAAAGCCCGGTTTGTTAGCCCCTTTCCGATTCCCTCACCCAATCTCATTAAAAGCAAGCCCAGCAGGCCCTGCCTTAACCTGTCCCCAGACAGCCAGCCCTCACCAGGCCGCTGGCATTACTCAATGCTCCGCCACGA AGCAAGCTCTCCCGAATACGACAGATGCGGAAGTGGCTCAAGAAGTCGGAGGAATCAAGTAGTTGGAAAACTGTATGCACGAGGGGACATGAGTCTTCTGGGAATTGGCAACATTGGCAGAAAATAAAGGGGAATACAAGGGGGGT AGGAATCCACTTTGTTAGGTGTAGCTATACTCACGTAAGTAGTCGGCCTAACCTTCGGTTCCCGTAACCAAGTTGTTCTTTCTCACTCCTGATTGACTTTTGATTACTGAATCCATACTTTTTTACTTTTTTTGAATTTGAAGTGTGGGGA AAAGGGCGCCCTCTACTTCTACTTCTAACTACAGGCGAAAAGCTGGCATTGCAAGCAAATAGAGAGCCCCCGCCCGTTTGAGTCGTTGCGAGCCGGAAAGCGTACCAGCGGTTTGAGTCGCGAAAGGGCCGCTTGCTTAATTATAT TATAATATAATATATATAATCTTCTATCTCTATCTATCAACAATAAAATCAGAAGAAAGTAAAAAAAATATAAAAAAGAAAATCATTTTTTGTATCCAATTTTGCATTCCTGGGAAGAGGAAGAAGCAGATAGAGCAAAGGCCTCCTCTTTC CGTCCGCTCTTCCCGAAGTGAGCGAATTGCATGTAGAGATCCGTAGGGGCTTATAGTTTAATTGGTTGAAACGTACCGCTCATAACGGTGATATTGTAGGTTCGAGCCCTACTAAGCCTACCACCCCCTTCTCTTCACCCGATACAAG GCAGTCGAAGTCCCCGCCACCCTGCAGATCTCAATCTAGCGACGGCACCTAGAACCACACTGCTGCCGCTGCCCGAAGGGCACGCCTCCTACGCTCTTGCAGCATGCCCCCTTCGGGGCAGATGTTACTATACTAAAAAAGAAGG CCCTCGCTAAGCGCTGGTTCTATCCCGGCCAAGCAACCAAGGTGGGAATAGTGAACGAAAGAGAAGGACATTGTTCAGAGTGAAACTGAACCCCCTTGATCAATCCTGTAAGAACGAAGACTTCACCAATCGACCAATGGGCCTTTC CTTGTAGGCGGCGAAGGGCAGGTGAACACTCTTCCCTTGGAACCTGCGCATAATGAAATATAACATTTTTTACTTCCATGGTCATACTATATTTATCTTTATATTGCGAATGAGTCTGGACCATCTCCTATTGTAGTATCAAAATGAATA TGACTTTACTTTGAAGTTTAGCCCTCTTTCAACAGTATGACAACCTTCCCAATCACTCGGTTCAATCCTTACCTGAGGATGACAAGGCTTGGCTGATAGGCCGAGGACGAAGCATGCACCTTCGCTTAACCTTCGATGTTGTCATCAC GCTGCCTTTCGCATGTCGGGCCTATACACGCTCGTCAAGTTACACCTTAACTGCTTTCTCAACGCGCGGCTCTTATAGATAACCCTTCCTTATCAATCAAATAAGCATTTGTGAGTTGAGATTCCTTCCCTATGTTTCAAAGCTAGCTTC TCTAGCTATACTGTGTGACCCACCTCCTCCCTTCGCTCTCTTGCTAGAGCTGGTTCTAAGCCTACCTTTTCCTTCCCCACCCTCTGTCTGACCAACCTCTGACTTCGATAATGACCTATAAACAATTATTCCAAGTGAAACGATAAGCAT GTTGGCTTAGACCTTATCTTACCAGACAAGACATTGATGTCTGCCCGAACATCGAAATGAATCTTTCATATGCGGATTTTCACTTCCCCTCATTAAGCTAGCTAGCGCAAGTGTCAGAAAGGATGAATGCATTCCGAGATCGAATTAGC CCCTTACATCTTAGAACATTTTATACAAGGAATGTGTGTGACCTCTCTGATAGTAAGAGCGCACTAACGGAAAGAGAAATTGTTATAAGGAAAGAGAACACACTAGGGTAGAGTGGAAAGGGAACAGGAAAAAACTTTAGTCGACTAA CTCTAGTATTCATGCTAGAACAGAGCTCCCGAAATAAAATATATCAATTATAGCGCTTCATCACTTGAAATAGGATCTTGCCTACGGCCCTAGTACTTTACTTTAGTCGATCGACATCTCATTAGCAAACAAACATAGAAGAGTCAGCTT CCTCAGTCTTGGTTATCGAGTTATCTTACCTGACAGGGTCGGCTAGGTGAGTTTGATTCCATTCCCGTGGCAAAAGGAAAAGAGCTTGATATCCGGGCTTCTATCGGTGAAGAAATGTTATGCCCACGGTTCCGTACTAAAGAATGAG CCAACAGCTATCTCCTTAGCTTCTTAAGGCACTCTTTTTCTGTTTAGTTATTGGTAATCCATCCGAGTGATCTATCTTATCGATAAAGAAATTCTCTCCCCTTACCGATCTTGTTATGCCTCCCGCGGTACATACAAAGGAACCTTCTATC CCATCGGTTAATCAAAGAAATTAGGTGCTCCTACGCCTGAAGTTATCGGTGAAGGCTTCCCCTCCATTTGATCTGTAGGATATCGAGTTTTCTTACCGCCTCTATCGGCTATGGGATATGCAATTCTCTTCTCTGACTTAACACAGAGC AAAGTAGACTGATTTCGCGCTAGTGCTAGTACACGAGTAGACCGCTTTCACCTAGCTATTGCTCACTAACAGAACCTTCTCGTACTGGAGAAAAGAACTTGAGCTCTGCTTCGAGGAACTAGCAGTCGAAGGGTGACGATTTCTGATC ACTGGATTCAAGAGCTTTTAGGGTGTTCGGAACAGTTATTAGTAGAAGATAAGACTTTCTCGGCTTGTTTACTAAGTCTCTGATTCGAATAAGCGACTCGGAACTCTGTTCGCGGTTAGCTGAGAATGTTCTTGCTTCTTGCCAGTTAG ATTAGCTTGAAAGGGAATGAGTGAGTCGAAAGTATGACAACGGGCATAGATAGAGGAGTTCCTGATCCCGGTACTAGGGCGAATGGCAT GGGTGCCCAAAAGCCCGGTTTGTTAGCCCCTTTCCGATTCCCTCACCCAATCTCATTAAAAGCAAGCCCAGCAGGCCCTGCCTTAACCTGTCCCCAGACAGCCAGCCCTCACCAGGCCGCTGGCATTACTCAATGCTCCGCCACGA AGCAAGCTCTCCCGAATACGACAGATGCGGAAGTGGCTCAAGAAGTCGGAGGAATCAAGTAGTTGGAAAACTGTATGCACGAGGGGACATGAGTCTTCTGGGAATTGGCAACATTGGCAGAAAATAAAGGGGAATACAAGGGGGGT AGGAATCCACTTTGTTAGGTGTAGCTATACTCACGTAAGTAGTCGGCCTAACCTTCGGTTCCCGTAACCAAGTTGTTCTTTCTCACTCCTGATTGACTTTTGATTACTGAATCCATACTTTTTTACTTTTTTTGAATTTGAAGTGTGGGGA AAAGGGCGCCCTCTACTTCTACTTCTAACTACAGGCGAAAAGCTGGCATTGCAAGCAAATAGAGAGCCCCCGCCCGTTTGAGTCGTTGCGAGCCGGAAAGCGTACCAGCGGTTTGAGTCGCGAAAGGGCCGCTTGCTTAATTATAT TATAATATAATATATATAATCTTCTATCTCTATCTATCAACAATAAAATCAGAAGAAAGTAAAAAAAATATAAAAAAGAAAATCATTTTTTGTATCCAATTTTGCATTCCTGGGAAGAGGAAGAAGCAGATAGAGCAAAGGCCTCCTCTTTC CGTCCGCTCTTCCCGAAGTGAGCGAATTGCATGTAGAGATCCGTAGGGGCTTATAGTTTAATTGGTTGAAACGTACCGCTCATAACGGTGATATTGTAGGTTCGAGCCCTACTAAGCCTACCACCCCCTTCTCTTCACCCGATACAAG GCAGTCGAAGTCCCCGCCACCCTGCAGATCTCAATCTAGCGACGGCACCTAGAACCACACTGCTGCCGCTGCCCGAAGGGCACGCCTCCTACGCTCTTGCAGCATGCCCCCTTCGGGGCAGATGTTACTATACTAAAAAAGAAGG CCCTCGCTAAGCGCTGGTTCTATCCCGGCCAAGCAACCAAGGTGGGAATAGTGAACGAAAGAGAAGGACATTGTTCAGAGTGAAACTGAACCCCCTTGATCAATCCTGTAAGAACGAAGACTTCACCAATCGACCAATGGGCCTTTC CTTGTAGGCGGCGAAGGGCAGGTGAACACTCTTCCCTTGGAACCTGCGCATAATGAAATATAACATTTTTTACTTCCATGGTCATACTATATTTATCTTTATATTGCGAATGAGTCTGGACCATCTCCTATTGTAGTATCAAAATGAATA TGACTTTACTTTGAAGTTTAGCCCTCTTTCAACAGTATGACAACCTTCCCAATCACTCGGTTCAATCCTTACCTGAGGATGACAAGGCTTGGCTGATAGGCCGAGGACGAAGCATGCACCTTCGCTTAACCTTCGATGTTGTCATCAC GCTGCCTTTCGCATGTCGGGCCTATACACGCTCGTCAAGTTACACCTTAACTGCTTTCTCAACGCGCGGCTCTTATAGATAACCCTTCCTTATCAATCAAATAAGCATTTGTGAGTTGAGATTCCTTCCCTATGTTTCAAAGCTAGCTTC TCTAGCTATACTGTGTGACCCACCTCCTCCCTTCGCTCTCTTGCTAGAGCTGGTTCTAAGCCTACCTTTTCCTTCCCCACCCTCTGTCTGACCAACCTCTGACTTCGATAATGACCTATAAACAATTATTCCAAGTGAAACGATAAGCAT GTTGGCTTAGACCTTATCTTACCAGACAAGACATTGATGTCTGCCCGAACATCGAAATGAATCTTTCATATGCGGATTTTCACTTCCCCTCATTAAGCTAGCTAGCGCAAGTGTCAGAAAGGATGAATGCATTCCGAGATCGAATTAGC CCCTTACATCTTAGAACATTTTATACAAGGAATGTGTGTGACCTCTCTGATAGTAAGAGCGCACTAACGGAAAGAGAAATTGTTATAAGGAAAGAGAACACACTAGGGTAGAGTGGAAAGGGAACAGGAAAAAACTTTAGTCGACTAA CTCTAGTATTCATGCTAGAACAGAGCTCCCGAAATAAAATATATCAATTATAGCGCTTCATCACTTGAAATAGGATCTTGCCTACGGCCCTAGTACTTTACTTTAGTCGATCGACATCTCATTAGCAAACAAACATAGAAGAGTCAGCTT CCTCAGTCTTGGTTATCGAGTTATCTTACCTGACAGGGTCGGCTAGGTGAGTTTGATTCCATTCCCGTGGCAAAAGGAAAAGAGCTTGATATCCGGGCTTCTATCGGTGAAGAAATGTTATGCCCACGGTTCCGTACTAAAGAATGAG CCAACAGCTATCTCCTTAGCTTCTTAAGGCACTCTTTTTCTGTTTAGTTATTGGTAATCCATCCGAGTGATCTATCTTATCGATAAAGAAATTCTCTCCCCTTACCGATCTTGTTATGCCTCCCGCGGTACATACAAAGGAACCTTCTATC CCATCGGTTAATCAAAGAAATTAGGTGCTCCTACGCCTGAAGTTATCGGTGAAGGCTTCCCCTCCATTTGATCTGTAGGATATCGAGTTTTCTTACCGCCTCTATCGGCTATGGGATATGCAATTCTCTTCTCTGACTTAACACAGAGC AAAGTAGACTGATTTCGCGCTAGTGCTAGTACACGAGTAGACCGCTTTCACCTAGCTATTGCTCACTAACAGAACCTTCTCGTACTGGAGAAAAGAACTTGAGCTCTGCTTCGAGGAACTAGCAGTCGAAGGGTGACGATTTCTGATC ACTGGATTCAAGAGCTTTTAGGGTGTTCGGAACAGTTATTAGTAGAAGATAAGACTTTCTCGGCTTGTTTACTAAGTCTCTGATTCGAATAAGCGACTCGGAACTCTGTTCGCGGTTAGCTGAGAATGTTCTTGCTTCTTGCCAGTTAG ATTAGCTTGAAAGGGAATGAGTGAGTCGAAAGTATGACAACGGGCATAGATAGAGGAGTTCCTGATCCCGGTACTAGGGCGAATGGCATAACTGCTTCTTTCTCTTTTTACGGGTAGAATCCGCTATAGTTGAGGAAGCCCAGAGAT GAGGATAAAATCTCTTGTTTAAGAAGCAACTCATGTTTCAGGGGGTGCCCAAAAGCCCGGTTTGTTAGCCCCTTTCCGATTCCCTCACCCAATCTCATTAAAAGCAAGCCCAGCAGGCCCTGCCTTAACCTGTCCCCAGACAGCCAG CCCTCACCAGGCCGCTGGCATTACTCAATGCTCCGCCACGAAGCAAGCTCTCCCGAATACGACAGATGCGGAAGTGGCTCAAGAAGTCGGAGGAATCAAGTAGTTGGAAAACTGTATGCACGAGGGGACATGAGTCTTCTGGGAAT TGGCAACATTGGCAGAAAATAAAGGGGAATACAAGGGGGGTAGGAATCCACTTTGTTAGGTGTAGCTATACTCACGTAAGTAGTCGGCCTAACCTTCGGTTCCCGTAACCAAGTTGTTCTTTCTCACTCCTGATTGACTTTTGATTACT GAATCCATACTTTTTTACTTTTTTTGAATTTGAAGTGTGGGGAAAAGGGCGCCCTCTACTTCTACTTCTAACTACAGGCGAAAAGCTGGCATTGCAAGCAAATAGAGAGCCCCCGCCCGTTTGAGTCGTTGCGAGCCGGAAAGCGTAC CAGCGGTTTGAGTCGCGAAAGGGCCGCTTGCTTAATTATATTATAATATAATATATATAATCTTCTATCTCTATCTATCAACAATAAAATCAGAAGAAAGTAAAAAAAATATAAAAAAGAAAATCATTTTTTGTATCCAATTTTGCATTCCTG GGAAGAGGAAGAAGCAGATAGAGCAAAGGCCTCCTCTTTCCGTCCGCTCTTCCCGAAGTGAGCGAATTGCATGTAGAGATCCGTAGGGGCTTATAGTTTAATTGGTTGAAACGTACCGCTCATAACGGTGATATTGTAGGTTCGAGC CCTACTAAGCCTACCACCCCCTTCTCTTCACCCGATACAAGGCAGTCGAAGTCCCCGCCACCCTGCAGATCTCAATCTAGCGACGGCACCTAGAACCACACTGCTGCCGCTGCCCGAAGGGCACGCCTCCTACGCTCTTGCAGCAT GCCCCCTTCGGGGCAGATGTTACTATACTAAAAAAGAAGGCCCTCGCTAAGCGCTGGTTCTATCCCGGCCAAGCAACCAAGGTGGGAATAGTGAACGAAAGAGAAGGACATTGTTCAGAGTGAAACTGAACCCCCTTGATCAATCCT GTAAGAACGAAGACTTCACCAATCGACCAATGGGCCTTTCCTTGTAGGCGGCGAAGGGCAGGTGAACACTCTTCCCTTGGAACCTGCGCATAATGAAATATAACATTTTTTACTTCCATGGTCATACTATATTTATCTTTATATTGCGA ATGAGTCTGGACCATCTCCTATTGTAGTATCAAAATGAATATGACTTTACTTTGAAGTTTAGCCCTCTTTCAACAGTATGACAACCTTCCCAATCACTCGGTTCAATCCTTACCTGAGGATGACAAGGCTTGGCTGATAGGCCGAGGAC GAAGCATGCACCTTCGCTTAACCTTCGATGTTGTCATCACGCTGCCTTTCGCATGTCGGGCCTATACACGCTCGTCAAGTTACACCTTAACTGCTTTCTCAACGCGCGGCTCTTATAGATAACCCTTCCTTATCAATCAAATAAGCATT TGTGAGTTGAGATTCCTTCCCTATGTTTCAAAGCTAGCTTCTCTAGCTATACTGTGTGACCCACCTCCTCCCTTCGCTCTCTTGCTAGAGCTGGTTCTAAGCCTACCTTTTCCTTCCCCACCCTCTGTCTGACCAACCTCTGACTTCGA TAATGACCTATAAACAATTATTCCAAGTGAAACGATAAGCATGTTGGCTTAGACCTTATCTTACCAGACAAGACATTGATGTCTGCCCGAACATCGAAATGAATCTTTCATATGCGGATTTTCACTTCCCCTCATTAAGCTAGCTAGCGC AAGTGTCAGAAAGGATGAATGCATTCCGAGATCGAATTAGCCCCTTACATCTTAGAACATTTTATACAAGGAATGTGTGTGACCTCTCTGATAGTAAGAGCGCACTAACGGAAAGAGAAATTGTTATAAGGAAAGAGAACACACTAGGG TAGAGTGGAAAGGGAACAGGAAAAAACTTTAGTCGACTAACTCTAGTATTCATGCTAGAACAGAGCTCCCGAAATAAAATATATCAATTATAGCGCTTCATCACTTGAAATAGGATCTTGCCTACGGCCCTAGTACTTTACTTTAGTCGA TCGACATCTCATTAGCAAACAAACATAGAAGAGTCAGCTTCCTCAGTCTTGGTTATCGAGTTATCTTACCTGACAGGGTCGGCTAGGTGAGTTTGATTCCATTCCCGTGGCAAAAGGAAAAGAGCTTGATATCCGGGCTTCTATCGGT GAAGAAATGTTATGCCCACGGTTCCGTACTAAAGAATGAGCCAACAGCTATCTCCTTAGCTTCTTAAGGCACTCTTTTTCTGTTTAGTTATTGGTAATCCATCCGAGTGATCTATCTTATCGATAAAGAAATTCTCTCCCCTTACCGATC TTGTTATGCCTCCCGCGGTACATACAAAGGAACCTTCTATCCCATCGGTTAATCAAAGAAATTAGGTGCTCCTACGCCTGAAGTTATCGGTGAAGGCTTCCCCTCCATTTGATCTGTAGGATATCGAGTTTTCTTACCGCCTCTATCGG CTATGGGATATGCAATTCTCTTCTCTGACTTAACACAGAGCAAAGTAGACTGATTTCGCGCTAGTGCTAGTACACGAGTAGACCGCTTTCACCTAGCTATTGCTCACTAACAGAACCTTCTCGTACTGGAGAAAAGAACTTGAGCTCTG CTTCGAGGAACTAGCAGTCGAAGGGTGACGATTTCTGATCACTGGATTCAAGAGCTTTTAGGGTGTTCGGAACAGTTATTAGTAGAAGATAAGACTTTCTCGGCTTGTTTACTAAGTCTCTGATTCGAATAAGCGACTCGGAACTCTGT TCGCGGTTAGCTGAGAATGTTCTTGCTTCTTGCCAGTTAGATTAGCTTGAAAGGGAATGAGTGAGTCGAAAGTATGACAACGGGCATAGATAGAGGAGTTCCTGATCCCGGTACTAGGGCGAATGGCATAACTGCTTCTTTCTCTTTT TACGGGTAGAATCCGCTATAGTTGAGGAAGCCCAGAGATGAGGATAAAATCTCTTGTTTAAGAAGCAACTCATGTTTCAGGGGGTGCCCAAAAGCCCGGTTTGTTAGCCCCTTTCCGATTCCCTCACCCAATCTCATTAAAAGCAAGC CCAGCAGGCCCTGCCTTAACCTGTCCCCAGACAGCCAGCCCTCACCAGGCCGCTGGCATTACTCAATGCTCCGCCACGAAGCAAGCTCTCCCGAATACGACAGATGCGGAAGTGGCTCAAGAAGTCGGAGGAATCAAGTAGTTGG AAAACTGTATGCACGAGGGGACATGAGTCTTCTGGGAATTGGCAACATTGGCAGAAAATAAAGGGGAATACAAGGGGGGTAGGAATCCACTTTGTTAGGTGTAGCTATACTCACGTAAGTAGTCGGCCTAACCTTCGGTTCCCGTAA CCAAGTTGTTCTTTCTCACTCCTGATTGACTTTTGATTACTGAATCCATACTTTTTTACTTTTTTTGAATTTGAAGTGTGGGGAAAAGGGCGCCCTCTACTTCTACTTCTAACTACAGGCGAAAAGCTGGCATTGCAAGCAAATAGAGAG CCCCCGCCCGTTTGAGTCGTTGCGAGCCGGAAAGCGTACCAGCGGTTTGAGTCGCGAAAGGGCCGCTTGCTTAATTATATTATAATATAATATATATAATCTTCTATCTCTATCTATCAACAATAAAATCAGAAGAAAGTAAAAAAAATA TAAAAAAGAAAATCATTTTTTGTATCCAATTTTGCATTCCTGGGAAGAGGAAGAAGCAGATAGAGCAAAGGCCTCCTCTTTCCGTCCGCTCTTCCCGAAGTGAGCGAATTGCATGTAGAGATCCGTAGGGGCTTATAGTTTAATTGGTT GAAACGTACCGCTCATAACGGTGATATTGTAGGTTCGAGCCCTACTAAGCCTACCACCCCCTTCTCTTCACCCGATACAAGGCAGTCGAAGTCCCCGCCACCCTGCAGATCTCAATCTAGCGACGGCACCTAGAACCACACTGCTGC CGCTGCCCGAAGGGCACGCCTCCTACGCTCTTGCAGCATGCCCCCTTCGGGGCAGATGTTACTATACTAAAAAAGAAGGCCCTCGCTAAGCGCTGGTTCTATCCCGGCCAAGCAACCAAGGTGGGAATAGTGAACGAAAGAGAAG GACATTGTTCAGAGTGAAACTGAACCCCCTTGATCAATCCTGTAAGAACGAAGACTTCACCAATCGACCAATGGGCCTTTCCTTGTAGGCGGCGAAGGGCAGGTGAACACTCTTCCCTTGGAACCTGCGCATAATGAAATATAACATT TTTTACTTCCATGGTCATACTATATTTATCTTTATATTGCGAATGAGTCTGGACCATCTCCTATTGTAGTATCAAAATGAAT Transforming genomes of information into knowledge Biologist IS5gndwbbKwbbJ wbbL ~1kb Lifecycle of Data  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish

9 End Users Computational Users iPlant Layered Services and Access iPlant Data Store Scalable Reliable Redundant High-Performance iPlant Data Store Scalable Reliable Redundant High-Performance

10 iPlant Data Store Free Your Data Different Users, Different Access Needs: One Data Store Different Users, Different Access Needs: One Data Store

11 iPlant Data Store (iDS) WebDAV DE i-commandsiDrop API

12 iPlant Data Store Web-Integrated High Performance Big Data Transfers

13 iPlant Data Store: Metadata Data About Data Preview of Next Version of DE

14 iPlant Data Store: Metadata Data About Data More Data; Smarter Data

15 iPlant Data Store Texas Replication Arizona Grid Computing Cloud Computing HPC Community Super Computing iDrop WebDAV FoundationAPI DE i-commands iPlant Data Store Scalable Reliable Redundant High-Performance Connected iPlant Data Store Scalable Reliable Redundant High-Performance Connected

16 The journey of data to iDS and challenges along the way ! Hard Drive Network card Building network Campus network Internet UA/TACC network iDS Network card Hard Drive http://en.wikipedia.org/wiki/List_of_device_bandwidths Check: USB, HDD, Network capabilities

17 iPlant Data Store Performance UC Berkeley to iDS Dec 5th, 2011: 100GB: 29m15s Dec 5th, 2011: 100GB: 29m15s 36,000 Students 2000 Faculty 36,000 Students 2000 Faculty 39,000 Students 2900 Faculty/Staff 39,000 Students 2900 Faculty/Staff

18 100GB: 29m15s iPlant Data Store Performance UC Berkeley to iDS https://pods.iplantcollaborative.org/wiki/display/start/How+fast+is+the+iPlant+Data+Store 1 GB / 17.5 seconds Desktop PC (UA): Mac OS X with 7.2K Internal Hard Drive External Drive: USB 2.0: 5.4k Hard Drive Flash Drive: USB 2.0 Patriot XT

19 iPlant Data Store Connecting people with data and computation: Lifecycle of Data  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish Cyberinfrastructure for Life Sciences Scalable Capable Extensible Cyberinfrastructure for Life Sciences Scalable Capable Extensible

20 Where to Get Information Data Store Quick Start: http://www.iplantcollaborative.org/Zki Data Store Manual: http://www.iplantcollaborative.org/Zko iPlant Forums: http://forums.iplantcollaborative.org

21 Exercise Your Data Store https://pods.iplantcollaborative.org/wiki/x/e4hy Go to http://data.iplantcollaborative.org Login and click on “home” icon Upload any file you like (small) Explore menu to the right Now download idrop.jar (find it from the wiki) Drag and drop folders


Download ppt "1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1."

Similar presentations


Ads by Google