The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.

Slides:



Advertisements
Similar presentations
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Data Store.
Advertisements

Managing Data with iPlant Introduction to Uploading, Downloading, Sharing, and Metadata in the Data Store.
The Act Tab (Project). Please select a button to learn more. Welcome to the Project Act Tab. Here you can Add Team Members, provide and receive Feedback,
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
1 Box Overview Session Getting Started on Box. 2 Agenda What is Box? Box Basics Live Q&A.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1.
Proprietary & Confidential The Thread That Ties it All Together Voicethread and Discovery Education Jennifer Dorman denblogs.com/jendorman.
Customized cloud platform for computing on your terms !
Extending the Discovery Environment: Tool Integration and Customization.
Mindy Gigantelli Rebecca Zdon Gloria Queeno-Chamberlain.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Building and Using Workflows Within the DE; Phylogenetics.
Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop iCommands and Other Data Store Resources.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Objectives.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
NGS data analysis CCM Seminar series Michael Liang:
The iPlant Collaborative Community Cyberinfrastructure for Life Science Network for Integrating Bioinformatics into Life Sciences Education April, 2014.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Building and Using Workflows Within the DE; Phylogenetics.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop – Part 2 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 29, 2015,
Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop iPlant Data Store.
The iPlant Collaborative Using iPlant for sharing, managing, and analyzing ecological data Ramona Walls Presented at ESA 2014 – Ignite session August 12,
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Atmosphere.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Data Store.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop GWAS/QTL Apps Overview.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop iPlant Data Store – Managing Your ‘Big’ Data.
Build an Automated Workflow Visual Workflow Creator Discovery Environment.
IPlant Discovery Environment An Overview. What is it? The Discovery Environment has been described in many ways… “It’s a virtual workbench…” “It’s where.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
The iPlant Collaborative
Discovery Environment Tool Integration High Level Overview.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
Extending the Discovery Environment: Tool Integration and Customization.
IPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment Sriram Srinivasan.
Transforming Science Through Data-driven Discovery Genomics in Education University of Delaware – February 2016 Jason Williams, Education, Outreach, Training.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Building and Using Workflows Within the DE; Phylogenetics.
Transforming Science Through Data-driven Discovery Tools and Services Workshop Atmosphere Joslynn Lee – Data Science Educator Cold Spring Harbor Laboratory,
Transforming Science Through Data-driven Discovery Tools and Services Workshop Data Store Overview.
CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.
Transforming Science Through Data-driven Discovery Workshop Overview Ohio State University MCIC Jason Williams – Lead, CyVerse – Education, Outreach, Training.
Transforming Science Through Data-driven Discovery Tools and Services Workshop Data Store – Managing your ‘Big’ Data Joslynn Lee, Ph.D. – Data Science.
Transforming Science Through Data-driven Discovery Tools and Services Workshop Data Store – Managing your ‘Big’ Data Joslynn Lee – Data Science Educator.
CyVerse Data Store Managing Your ‘Big’ Data. Welcome to the Data Store Manage and share your data across all CyVerse platforms.
Transforming Science Through Data-driven Discovery Using CyVerse Cyberinfrastructure to Enable Data Intensive Research, Collaboration, and Education Joslynn.
Transforming Science Through Data-driven Discovery Using CyVerse Cyberinfrastructure to Enable Data Intensive Research, Collaboration, and Education Atmosphere.
Joslynn S. Lee, PhD, Data Science Educator Cold Spring Harbor Laboratory, DNA Learning Center Transforming Science Through Data-driven Discovery.
Transforming Science Through Data-driven Discovery Bringing your Bioinformatics tools to CyVerse’s Discovery Environment using Docker Upendra Kumar Devisetty.
Progress Apama Fundamentals
Core ELN Training: Office Web Apps (OWA)
Scaling Compute with R in CyVerse
CyVerse Tools and Services
Tools and Services Workshop
University of Chicago and ANL
Joslynn Lee – Data Science Educator
CyVerse Discovery Environment
Tools and Services Workshop
Tools and Services Workshop Overview of the iPlant Data Store
Data uploading and sharing with CyVerse
SRA Submission Pipeline
Cyberinfrastructure for the Life Sciences
Academy Hub An eUnomia Factory Solution.
Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy
Yating Liu July 2018 G-OnRamp workshop
MCBIOS 2016 – University of Memphis, TN
Academy Hub An eUnomia Factory Solution.
Presentation transcript:

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview

Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful Computing, and Data

A bench-biologist’s view on the evolution of computing Discovery Environment Overview Image From: ? It can be difficult to keep up! Investing in newer ‘better’ tools and resources is expensive.

The costs of keeping up with technology Discovery Environment Overview Image From:

Access your computational science through a single portal Discovery Environment Overview

Benefits Discovery Environment Overview Get Science Done Reproducibility Productivity Use hundreds of bioinformatics Apps without the command line Add your own applications – an extensible, scalable platform Create and publish Apps and workflows so anyone can use them Analysis history and provenance – “avoid forensic bioinformatics” High-performance computing – not dependent on your hardware Manage a secure data repository and share data easily

Upload / Download files and folders Share files via URL (Public Links) Share files/folders with other users Data Manage data Discovery Environment Overview

Apps Run hundreds of bioinformatics Apps Build automated workflows Modify Apps or integrate new ones Analyze data and customize Applications Discovery Environment Overview

Analyses Monitor job status and find results Cancel jobs or re-launch jobs Detailed job history View history, find results, reproduce analyses, optimize parameters Discovery Environment Overview

Support iPlant Ask forums Tell iPlant about your needs Leverage dedicated support and training Discovery Environment Overview

Quick Tour 1 – Navigating the DE and running analyses Discovery Environment Overview

Hands-on demo: Create a multiple alignment Discovery Environment Overview Navigate the components of the DE Access and manipulate data (upload, download, move, etc.) Run an analysis Track your analysis and see your results By the end of this demo you should be able to:

Hands-on demo: Create a multiple alignment Discovery Environment Overview Please login to the Discovery Environment. Follow along with the instructor or with the handouts on your own

Hands-on demo: Create a multiple alignment Workshop packet page 16 – ‘Example Analysis in the Discovery Environment’ Discovery Environment Overview 1.Find a file in the Community Data folder 2.Download a small file of unaligned DNA sequences 3.Upload a small file 4.Use the MUSCLE App to align the sequences 5.Monitor the job status and export its parameters 6.View results

Additional advantages: At a glance, options for data analysis may seem similar Discovery Environment Overview Web services Local compute Discovery Environment

Additional advantages: Limitations may not appear with ‘casual’ use Discovery Environment Overview Web services Local compute Discovery Environment Little or none Some: dependent on funding or institutional resources (and how much hardware you are comfortable sitting on) Scalable: From a single CPU job to >500K core machine – you don’t bear the pain and cost of scaling Scalability ? $

Built for bioinformatics best practices: data stewardship, reproducibility, reliability Discovery Environment Overview An extensible platform that scales with your science

User perspectives and possible applications Discovery Environment Overview Bench Scientist Bioinformatician Does most of his data uploads/downloads/sharing here He pushes results from his lab’s workflow into a common folder Installed an HPC application here so that anyone can use it Creates custom applications with default parameters exposed Developed a workflow to QC and Filter reads for his users Teaches about genome assembly with examples in the DE Core Facilities Images from personas based on: Bioinformatics Curriculum Guidelines: Toward a Definition of Core Competencies PLOS Biology DOI: /journal.pcbi

Tips Apps are linked to iPlant wiki for documentationApps Mark an App as a favorite and it will appear in your workspace Use the Apps menu to: Rate Apps to provide feedback Click the info icon to see the user manual for an App Re-launch a job with identical, or customized parameters by clicking on the App name in the Analyses tab

Tips View a file containing metadata (settings, etc.) connected to your analysis. Select the a job and click View Parameters.

Tips Can customize tools in the DE (simplifying here) App installation / modification involves happens at two levels: Apps (and dependencies) are installed on DE Cluster (done by iPlant support) DE Interface (created by App integrator/user) and published to DE Use the DE as a ‘ready to use’ interface for your open source software!

Detailed instructions with videos, manuals, documentation in Learning Center Keep asking: ask.iplantcollabortive.org

The iPlant Collaborative is funded by a grant from the National Science Foundation Plant Cyberinfrastructure Program (#DBI ).