Data to Discovery The iPlant Collaborative Community Cyberinfrastructure for Life Science Nirav Merchant iPlant / University.

Slides:



Advertisements
Similar presentations
Cloud Computing Computer Science Innovations, LLC.
Advertisements

1 The phone in the cloud Utilizing resources hosted anywhere Claes Nilsson.
Introduction to Mendeley. What is Mendeley? Mendeley is a reference manager allowing you to manage, read, share, annotate and cite your research papers...
Introduction to Web Services and Web API’s Richard Holowczak Baruch College December, 2014.
Interacting with a computer (in general). Before we can program a computer... Before we can learn to instruct a computer, we must first learn to: Devices.
Using the Google Docs word processor Skills: getting a Google account, creating a text document and sharing it on the Internet Concepts: stand-alone applications.
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
Asst.Prof.Dr.Ahmet Ünveren SPRING Computer Engineering Department Asst.Prof.Dr.Ahmet Ünveren SPRING Computer Engineering Department.
What Is A Web Page? An Introduction to the Internet.
Amazon EC2 Quick Start adapted from EC2_GetStarted.html.
1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1.
Introduction to UNIX/Linux Exercises Dan Stanzione.
MCB Lecture #3 Sept 2/14 Intro to UNIX terminal.
IT 210 The Internet & World Wide Web introduction.
CS490 Web Design, AJAX, JQuery
These materials are prepared only for the students enrolled in the course Distributed Software Development (DSD) at the Department of Computer.
Classroom User Training June 29, 2005 Presented by:
Tutorial 1: Getting Started with Adobe Dreamweaver CS4.
BISQUE: Enabling Cloud and Grid Powered Image Analysis Ramona Walls iPlant Collaborative
Data to Discovery The iPlant Collaborative Community Cyberinfrastructure for Life Science Nirav Merchant iPlant / University.
XP New Perspectives on Browser and Basics Tutorial 1 1 Browser and Basics Tutorial 1.
Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative
1 Session 1: Introduction to HTML Spring Today’s Agenda Cover useful terminology for today’s session HTML, browsers, servers, etc. HTML Tags Get.
WEB API: WHY THEY MATTER ECOL 453/ Nirav Merchant
Python and REST Kevin Hibma. What is REST? Why REST? REST stands for Representational State Transfer. (It is sometimes spelled "ReST".) It relies on a.
DUE Introduction to the Android Platform Working Connections 2011.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
CPSC 203 Introduction to Computers Lab 23 By Jie Gao.
Customized cloud platform for computing on your terms ! Nirav Merchant
Chapter 8 Browsing and Searching the Web. Browsing and Searching the Web FAQs: – What’s a Web page? – What’s a URL? – How does a browser work? – How do.
Module 5 A system where in its parts perform a unified job of receiving inputs, processes the information and transforms the information into a new kind.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop – Part 2 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 29, 2015,
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.
The iPlant Collaborative Using iPlant for sharing, managing, and analyzing ecological data Ramona Walls Presented at ESA 2014 – Ignite session August 12,
IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,
Unix and Samba By: IC Labs (Raj Kidambi). What is Unix?  Unix stands for UNiplexed Information and Computing System. (It was originally spelled "Unics.")
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
1 Applied CyberInfrastructure Concepts ISTA 420/520 Fall Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons.
Google Apps and Education Jack Nieporte St James of the Valley
1 KaaShiv InfoTech  Presents  INTEL XDK For Inplant Training / Internship, please download the "Inplant training registration form" from our website.
| nectar.org.au NECTAR TRAINING Module 10 Beyond the Dashboard.
BIF713 Operating System Concepts MS Windows. Agenda 1. What is an Operating System (definition)? 2. Types of Operating Systems 3. Basic Operations: –
Unleash your inner (data) scientist : The ability and audacity to scale your science with extensible cyberinfrastructure Nirav Merchant The University.
Bringing your favorite analysis applications to iPlant using Docker containers Nirav Merchant
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
Using Your Chromebook for Google Apps Canyon Middle School.
Microsoft Office 2008 for Mac – Illustrated Unit D: Getting Started with Safari.
IPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment Sriram Srinivasan.
Bluemix for Domino Developers Niklas Heidloff, heidloff.net.
International Planetary Data Alliance Registry Project Update September 16, 2011.
Web Page Design The Basics. The Web Page A document (file) created using the HTML scripting language. A document (file) created using the HTML scripting.
Transforming Science Through Data-driven Discovery Workshop Overview Ohio State University MCIC Jason Williams – Lead, CyVerse – Education, Outreach, Training.
1 Applied CyberInfrastructure Concepts 1 Nirav Merchant Bio Computing & iPlant Collaborative Eric Lyons
Open OnDemand: Supporting your HPC needs now more than ever
Operating System Concepts
Applied Cyber Infrastructure Concepts Fall 2017
Storing, Sending, and Tracking Files Recitation 2
An Introduction to Collaborative Online Documents
In this session… Introduce what we’re talking about
Web Programming: Course Overview
$, $$, $$$ API testing Edition
Intro to iCloud.
1. Azure Data Explorer Azure Data Explorer enables rich data exploration over raw, structured, and semi-structured data delivering fast time to insight.
Windows Operating System
An Introduction to the Internet
Presentation transcript:

Data to Discovery The iPlant Collaborative Community Cyberinfrastructure for Life Science Nirav Merchant iPlant / University of Arizona Introduction to iPlant Science API

Data to Discovery Topic Coverage API: What why and ….who cares Why do we need API’s Connecting parts of iPlant with API Hands on work with API – Login/get tokens – See your files – Submit a tasks (on Docker) – Inspect results – Play with commands on your own

Data to Discovery The iPlant Collaborative: Vision Enable life science researchers and educators to use and extend cyberinfrastructure

Data to Discovery iPlant: Layer Cake

Data to Discovery iPlant Architectural Motivation We strive to be the CI Lego blocks Danish 'leg godt' - 'play well’ Also translates as 'I put together' in Latin If a solution is not available you can craft your own using iPlant CI components

Data to Discovery API’s are everywhere API = Application Programming Interface We will focus on web API (and what is that ?) They help others do creative things with your applications/platform (without you having to build it for them) You will find the used in your phone to your TV and everywhere in between (facebook, google or any company providing service) It is the window into their platform (but with monkey/safety bars)

Data to Discovery So how do you use Web API’s ? Use the same protocol as web url’s i.e http Everything is called as a URL We call that REST interface RES What ? Things that do not fit on a url are provided as JSON J What ? You have to know some basic scripting or programming to benefit from it

Data to Discovery Why did iPlant build API ? Data Store Computing Options HPC Cloud HTC Security

Data to Discovery Really why did you build it ? More people sharing applications/pipelines Not enough resources available at authors home institution/lab to share analysis with world HPC was not a web friendly world Lab with HPC access wanted web interfaces (like DE) No one else was building generic CI API We want people to extend our platform

Data to Discovery Your tool box Command line access on a linux, mac or PC cURL Text editor Familiarity with shell (say what ?) Lots of patience (level = Sage) Creativity !

Data to Discovery Prepare you environment If you do not have a mac or linux box with curl and bash, please ssh using UA netid to: research.u.arizona.edu Go to We will explore the live docs (say what) (Documentation | REST API DOCS) Log into iPlant DE using your browser (de.iplantc.org)

Data to Discovery Some terminology Tokens Keys Secrets Agave-cli (you will like it) Template (read some json and visit DE) Now lets review Agav-cli options (in bin dir) and jump to live docs

Data to Discovery Hands on Steps ssh research.u.arizona.edu or use your own mac, linux box bash git clone agave-cli export PATH=$PATH:`pwd`/agave-cli/bin tenants-init choose iplant clients-create -N cli-demo -S files-list jobs-template -AV demo-pyplot-demo-advanced-0.1.0u1 > submit.json edit submit.json to "line" and remove.0 for size jobs-submit -V -W -F submit.json