Lars Ailo Bongo NBS meeting Tromsø, Jan 23, 2016 NeLS Norwegian e-Infrastructure for Life Sciences Overview and recent developments https://nels.bioinfo.no/

Slides:



Advertisements
Similar presentations
Experiences In Building Globus Genomics Using Galaxy, Globus Online and AWS Ravi K Madduri University of Chicago and ANL.
Advertisements

Dawei Lin, Ph.D. Director, Bioinformatics Core UC Davis Genome Center July 20, 2008, SLIMS (Solexa sequencing.
eGovernance Under guidance of Dr. P.V. Kamesam IBM Research Lab New Delhi Ashish Gupta 3 rd Year B.Tech, Computer Science and Engg. IIT Delhi.
TGAC Training Coordination for the BBSRC Strategically-Funded Institutes Tanya Dickie: Bioinformatics & Biomathematics Training.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Office 365: Efficient Cloud Solutions Wednesday March 12, 9AM Chaz Vossburg / Gabe Laushbaugh.
Building Data-intensive Pipelines Ravi K Madduri Argonne National Lab University of Chicago.
GenSAS: Genome Sequence Annotation Server, a Tool for Online Annotation and Curation Dorrie Main, Taein Lee, Ping Zheng, Sook Jung, Stephen P. Ficklin,
GMOD in the Cloud Genome Informatics November 3, 2011 Scott Cain GMOD Project Coordinator Ontario Institute for Cancer Research
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Overview of SQL Server Alka Arora.
Trimble Connected Community
Bioinformatics Core Facility Ernesto Lowy February 2012.
Genomics Virtual Lab: analyze your data with a mouse click Igor Makunin School of Agriculture and Food Sciences, UQ, April 8, 2015.
Computer Lab (I) Introduction of galaxy and UCSC genome browser.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Galaxy for Bioinformatics Analysis An Introduction TCD Bioinformatics Support Team Fiona Roche, PhD Date: 31/08/15.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Objectives.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
NGS data analysis CCM Seminar series Michael Liang:
Jodi Humann, Stephen Ficklin, Taein Lee, Chun-Huai Cheng, Sook Jung, Jill Wegrzyn, David Neale and Dorrie Main An easy to use, web-based solution for specialty.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Bioinformatics Core Facility Guglielmo Roma January 2011.
European Life Sciences Infrastructure for Biological Information META-pipe WP6 Kick-off Lars Ailo Bongo, ELIXIR-NO.
Sackler Medical School
Tsute (George) Chen Bioinformatics Core Department of Microbiology The Forsyth Institute March 24 th, 2015 HOMD A Tour to the Data and Tools.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
OSIsoft High Availability PI Replication
Afresco Overview Document management and share
The iPlant Collaborative
Features Of SQL Server 2000: 1. Internet Integration: SQL Server 2000 works with other products to form a stable and secure data store for internet and.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
UCSC Genome Browser Zeevik Melamed & Dror Hollander Gil Ast Lab Sackler Medical School.
Learning Outcomes 1. Know software installation processes 2. Be able to prepare for software installation 3. Be able to install and configure software.
Data Hosting and Security Overview January, 2011.
TSD: a Secure and Scalable Service for Sensitive Data and eBiobanks Gard Thomassen, PhD Head of Research Support Services Group University Center for Information.
CCRC Cancer Conference November 8, 2015.
Canadian Bioinformatics Workshops
Apache Hadoop on Windows Azure Avkash Chauhan
A worldwide e-Infrastructure and Virtual Research Community for NMR and structural biology Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for.
© CGI Group Inc. User Guide Subversion client TortoiseSVN.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
bioinformatics NeLS workshop Dept of Informatics, UiO 20 th April 2016
CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.
OSIsoft High Availability PI Replication Colin Breck, PI Server Team Dave Oda, PI SDK Team.
Transforming Science Through Data-driven Discovery Workshop Overview Ohio State University MCIC Jason Williams – Lead, CyVerse – Education, Outreach, Training.
Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Data Analytics Challenges Some faults cannot be avoided Decrease the availability for running physics Preventive maintenance is not enough Does not take.
BEST CLOUD COMPUTING PLATFORM Skype : mukesh.k.bansal.
CyVerse Tools and Services
Tools and Services Workshop
University of Chicago and ANL
MMG: from proof-of-concept to production services at scale (part II)
Joslynn Lee – Data Science Educator
CyVerse Discovery Environment
WP6: Marine metagenomics
Our cloud usage - and not
ELIXIR activities in Norway (and Europe)
Introduction to G-OnRamp
ELIXIR Competence Center
Overview of Projector 4.1 (712) , access code
A web-based platform for structural and functional annotation of model and non-model organisms Jodi Humann, Taein Lee, Stephen Ficklin,
Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy
Yating Liu July 2018 G-OnRamp workshop
MMG: from proof-of-concept to production services at scale
Distributing META-pipe on ELIXIR compute resources
MCBIOS 2016 – University of Memphis, TN
Presentation transcript:

Lars Ailo Bongo NBS meeting Tromsø, Jan 23, 2016 NeLS Norwegian e-Infrastructure for Life Sciences Overview and recent developments

Acknowledgements  Many of the slides are copied (and somewhat edited) from presentations by: Sveinung Gundersen (UiO) Kidane M. Tekle (UiB) Kjell Petersen / Wei Zhang (UiB) David Fredman (UiB) Kjetil Klepper (NTNU)

ELIXIR.NO  Norwegian node of the european ELIXIR project  Financed by the Norwegian Research Council until 2017

NeLS - Norwegian e-Infrastructure for Life Science

Use case data CPUtool ? Collaborators Access rights Accounting … Backup Archiving Sensitive Transfer … Scalability Wait time Accounting Cost … Best tool(s) Quality management Installation Upgrade Repeatability … Who to ask Where to learn …

Use case data CPUresults ! NeLS Norwegian e-Infrastructure for Life Sciences

User view data tool ? CPU

User view data tool ? CPU

User view data tool ? CPU (transparent)

User view data tool ? CPU

User view data tool ? CPU

Technology view data CPUtool ? TSD

Project status and future plans 1. Development Key services Selected pipelines Key infrastructure 2. Production Initial users 3. Scale-out More users More pipelines Better services Integration with more infrastructures

NeLS portal  Current status Access NeLS storage and core NeLS functionality File upload & download Share files in project areas Privileged access for help desk users  Current work Up/downloading to/from StoreBioInfo

NeLS pipelines RNA-seq Eukaryote (paired and single-end) Prokaryote Variant calling Germline Somatic Metagenomics

Pipelines to be developed ChIP-seq small RNA (incl. miRNA) annotation miRNA prediction (mirMiner) Update RNA-seq pipelines with Quality Control, and downstream analyses (GO term enrichment...) Better visualization options (e.g. genome browsers) Possibly: DNA metylation EBI/Ensembl genome annotation pipeline Proteomics Sequence assembly

Other pipeline work Making sure that the pipelines are being used and are relevant for users Quality assurance Keeping the pipelines up to date Making sure that parameters/tools make sense User support

NeLS galaxies Main platform for running workflows (pipelines) Web-based platform Tools run on single server or computer clusters 5 national Galaxy installations Single authentication for users: Use NeLS portal to share data between Galaxies

Galaxy within TSD  Prototype Galaxy within TSD  More streamlined Galaxy deployment solution is under development

Collaboration with sequencing providers Main ambition for spring 2016: – Allow sequencing providers (core facilities) to transfer sequencing data to NeLS – Help researchers to further analyze their data using Galaxy tools/pipelines or other solutions, – Help with archiving using StoreBioInfo 21

Data flow overview scp / sshfs Dropbox Customer info, Data, [Analysis] Shared NeLS project 1. Core facility 2. Elixir Helpdesk Durable archive 3. User Online Access

Ease of use StoreBioInfoGalaxy TSD NeLS Storage NeLS portal NeLS enables you on one place to access all your data

3-layer design and different user roles ensure data safety archive project NeLS storage NeLS portal Galaxy StoreBioinfo NorStore TSD TSD file lock server 1. Users work on active data here Data curation into structured storage 2. Structured data to keep

Summary  In production use  Key services for data management and analysis Hide messy and boring details  Help desk and training  We want (and need) more users  Many new, and useful, features in production