Some thoughts on data, software and tools and who knows how to do what Rhys Francis Executive Director The Australian eResearch Infrastructure Council.

Slides:



Advertisements
Similar presentations
UI_PRI Communication Concept Service Robotics Group Institute of System Engineering and Robotics Bulgarian Academy of Sciences.
Advertisements

Storage Services Let the data flow! NorduNet 2008,.fi, 9 April 2008 Jan Meijer.
Danny Powell Executive Director
Instructional Materials: The Future is Here.. What is Happening Nationally?
E-Science Data Information and Knowledge Transformation Thoughts on Education and Training for E-Science Based on edikt project experience Dr. Denise Ecklund.
Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
A centre of expertise in digital information management UKOLN is supported by: Data Publishing: Challenges for HEIs and Libraries Dr Liz.
Hello i am so and so, title/role and a little background on myself (i.e. former microsoft employee or anything interesting) set context for what going.
NCRIS Activities 2: Common Services and Operations User Support Nectar Research Software Projects Workshop June 2014.
AeRO – Australian eResearch Organisations IT User Support Project Developing a connected support community Service Connect Conference – 09 May 2014 Hamish.
QCloud Queensland Cloud Data Storage and Services 27Mar2012 QCloud1.
E-Research Coordinating Committee report to CAUL April 2006 Cathrine Harboe-Ree.
Joint Information Systems Committee WIS Workshop on Information Access Enablers Matthew J. Dovey JISC Programme Director (e-Research)
An Overview of eResearch Activities in Australia Paul Davis, GrangeNet Jane Hunter, Uni of Qld.
1 Research in the 3rd Millennium AD from research by the knowledge poor to research by the knowledge rich (a work in progress) Rhys Francis Executive Director.
Microsoft Technical Computing Modeling the world with greater fidelity Wolfgang Dreyer, TC - Microsoft Germany.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
The University of Texas Research Data Repository : “Corral” A Geographically Replicated Repository for Research Data Chris Jordan.
Australian Partnership for Sustainable Repositories AUSTRALIAN PARTNERSHIP FOR SUSTAINABLE REPOSITORIES Caul Meeting 2005/2 Brisbane 15.
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.
The International Higher Education University Research Performance Forum April 2013 – Pan Pacific Orchard, Singapore Case Study – 2.00pm – 2.45pm.
1 | CSIRO ASKAP Science Data Archive (CASDA) – Stage 0 Project Intent Statement Confirm the necessary requirements, use cases, workflows, business processes,
CONTENTS Arrival Characters Definition Merits Chararterstics Workflows Wfms Workflow engine Workflows levels & categories.
Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, SCAPE Scalable Preservation Environments.
SCAPE Scalable Preservation Environments. 2 Its all about scalability! Scalable services for planning and execution of institutional preservation strategies.
Information Security Research and Education Network INSuRE Dr. Melissa Dark Purdue University Award #
Niagara Framework in the Clouds Scott Boehm. … what the heck does that mean??
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
Issues in (Financial) High Performance Computing John Darlington Director Imperial College Internet Centre Fast Financial Algorithms and Computing 4th.
E Science USA/Australia Paul Sheehan Director of Library Services Dublin City University JSCG IATUL Seminar on e science 21 November 2008.
Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
A Data Centre for Science and Industry Roadmap. INNOVATION NETWORKING DATA PROCESSING DATA REPOSITORY.
| nectar.org.au NECTAR TRAINING Module 1 Overview of cloud computing and NeCTAR services.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
| nectar.org.au NECTAR TRAINING Module 4 From PC To Cloud or HPC.
3May20111QCIF ENABLING RESEARCH HIGH PERFORMANCE INFRASTRUCTURE & SERVICES QUESTnet ARCS Tools Workshop 3May2011.
© Copyright 2012 EMC Corporation. All rights reserved. CLOUD TRANSFORMS IT BIG DATA TRANSFORMS BUSINESS.
Qualities of an Aligned Lesson Aligning Content and Process.
Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.
TOWARDS A FRENCH -SCIENCE ? Results of the e-Biogenouest project ( ) Coordination : Olivier Collin – Yvan Le Bras (IRISA) e -Test an e-Science.
The Global Scene Wouter Los University of Amsterdam The Netherlands.
Nci.org.au © National Computational Infrastructure 2016 Virtual Laboratories in Australia Lesley Wyborn (NCI) With contributions from:
Kathleen Shearer Data management: The new frontier for libraries.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
ARCHER Building data and information management tools for the complete research life-cycle July 2006.
A Technology Pathway eRSA’s Next Five Years Mary Hobson CEO.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Accessing the VI-SEEM infrastructure
OpenStack Swift Where do big data go? Eben van Zyl
GISELA & CHAIN Workshop Digital Cultural Heritage Network
Scaling Science Communities Lessons learned by and future plans of the Open Science Grid Frank Würthwein OSG Executive Director Professor of Physics UCSD/SDSC.
Tools and Services Workshop
Joslynn Lee – Data Science Educator
Themes in Geosciences.
Steven Newhouse EGI-InSPIRE Project Director, EGI.eu
NRF Knowledge Management Corporate
University of Technology
3.2 Virtualisation.
EGI – Organisation overview and outreach
File Manager for Microsoft Office 365, SharePoint, and OneDrive: Extensible Via Custom Connectors in Enterprise Deployments, Ideal for End Users OFFICE.
Mixed Reality Server under Robot Operating System
Australia's National Information Infrastructure for Research Markus Buchhorn Director, ICT Environments, The Australian National University (and APAC,
DLCF Enabling technologies
Knowledge Management Grid
RDSI: changing the face of research data storage in Australia
GISELA & CHAIN Workshop Digital Cultural Heritage Network
The story so far ANDS (2009), Nectar (2011), RDS (2014)
Presentation transcript:

Some thoughts on data, software and tools and who knows how to do what Rhys Francis Executive Director The Australian eResearch Infrastructure Council

eResearch capability in 2014… Dozens of virtualised research tools and applications - In use and shared by many researchers A peta scale national research cloud Labs using digital work flows Increased connectivity and bandwidth Single Sign On, High reliance services, High reliability servers New data centres Peta scale systems and software New data products Five fold growth in computing power above Moores law Data systems automated Data repositories 100s of petabytes of storage capacity Data publication made possible A corpus of Australian data

Infrastructure Elements – Push & Pull Infrastructure Co-ordination Better data management, description and access Extended Bandwidth Better HPC modelling Larger data collections Shared Access Methods Improved research tools, environments and workflows Research Integration + $144.5M National Capabilities + $246M NeCTAR ANDS

Infrastructure – Major Challenges Infrastructure Co-ordination Better data management, description and access Extended Bandwidth Better HPC modelling Larger data collections Shared Access Methods Improved research tools, environments and workflows Research Outputs - skills & expertise - methods & techniques - findings & results Software -Encode new research methods -Create 'shoulders' for others to stand on Data -Allows us to research the real world -Connects reality to experiment & theory Expertise -Operate world class infrastructure -Provide skills and tools to researchers

To west coast United States To Singapore The Australian national e-infrastructure platform (2013) Primary Node 15 participants Additional Node 4 participants Primary Node 11 participants Primary Node 4 participants Primary Node 8 participants Primary Node 6 participants Additional Node 7 participants Primary Node 6 participants Data10-20 PB fast growing Data1-2 PB more focused NetworkNx100 Gb/s layer-1 Network10 Gb/s layer-3

To west coast United States To Singapore The Australian national e-infrastructure platform (2013) Primary Node 15 participants Additional Node 4 participants Primary Node 11 participants Primary Node 4 participants Primary Node 8 participants Primary Node 6 participants Additional Node 7 participants Primary Node 6 participants Cloud50,000 concurrent tasks Data10-20 PB fast growing Data1-2 PB more focused HPC> 1 Pf/s capability HPC~100 Tf/s specialised NetworkNx100 Gb/s layer-1 Network10 Gb/s layer-3

To west coast United States To Singapore Primary Node 15 participants Additional Node 4 participants Primary Node 11 participants Primary Node 4 participants Primary Node 8 participants Primary Node 6 participants Additional Node 7 participants Primary Node 6 participants 40 Software tools and laboratory integration projects 250 Data improvement projects engaging all institutions Single sign-on for all researchers across the entire infrastructure 40 Software tools and laboratory integration projects 250 Data improvement projects engaging all institutions Single sign-on for all researchers across the entire infrastructure Astronomy Geoscience Astronomy Geoscience Life Science Life Science Climate Science Climate Science Cloud50,000 concurrent tasks Data10-20 PB fast growing Data1-2 PB more focused HPC> 1 Pf/s capability HPC~100 Tf/s specialised NetworkNx100 Gb/s layer-1 Network10 Gb/s layer-3 A national Research Data Commons of published and accessible research data A national Research Data Commons of published and accessible research data

Some messages… MIND the GAPs visions of data & tools | | reality Data and software as infrastructure data => interpretation => people Four things to Send to the Future (results + expertise) + (data + software)

eResearch Infrastructure We are here to help Thank you