Some Odds and Ends About Computational Infrastructure Kyle Gross – Operations Support Manager - Open Science Grid Research Technologies.

Slides:

Advertisements

Similar presentations

Joint CHAIN/EU-IndiaGrid2 Workshop on e-Infrastructures Interoperation and Interoperability across Europe and the Asia-Pacific Region, 23/3, ISGc2011-OGF31,

Advertisements

Campus Grids & Campus Infrastructures Community Rob Gardner Computation Institute / University of Chicago July 17, 2013.

Introduction on Science Gateway Understanding access and functionalities Catania, 09/06/2014Riccardo Rotondo

Towards a European Training Network in Scientific Computing Pekka Manninen, PhD CSC – IT Center for Science Ltd.

Introduction to Grids and Grid applications Gergely Sipos MTA SZTAKI

Scientific Computing Laboratory I NSTITUTE OF P HYSICS B ELGRADE WWW. SCL. RS.

1. 2 Welcome to HP-CAST-NTIG at NSC 1–2 April 2008.

Introduction to Analysis Example tutorial D. Greenwood For P. Skubic 8/21-22/20141ASP2014 Grid School.

High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.

April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.

OSG Grid Workshop in KNUST, Kumasi, Ghana August 6-8, 2012 following the AFRICAN SCHOOL OF FUNDAMENTAL PHYSICS AND ITS APPLICATIONS July 15-Aug 04, 2012.

SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.

Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison.

EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.

Introduction to Analysis Example tutorial P. Skubic 8/6-8/20121ASP2012 Grid School.

What is EGI? The European Grid Infrastructure enables access to computing resources for European scientists from all fields of science, from Physics to.

Science Clouds and FutureGrid’s Perspective June Science Clouds Workshop HPDC 2012 Delft Geoffrey Fox

UNIT - 1Topic - 2 C OMPUTING E NVIRONMENTS. What is Computing Environment? Computing Environment explains how a collection of computers will process and.

EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director.

A short introduction to the Worldwide LHC Computing Grid Maarten Litmaath (CERN)

The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.

Where to go and what to do next — resources, funding, mentors Thursday afternoon Ruth Pordes, Executive Director Fermilab.

Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.

Turning science problems into HTC jobs Wednesday, July 29, 2011 Zach Miller Condor Team University of Wisconsin-Madison.

The Swiss Grid Initiative Context and Initiation Work by CSCS Peter Kunszt, CSCS.

Intermediate Condor: Workflows Rob Quick Open Science Grid Indiana University.

Condor: BLAST Rob Quick Open Science Grid Indiana University.

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n

Award # funded by the National Science Foundation Award #ACI Jetstream: A Distributed Cloud Infrastructure for.

A Trust Framework for Security Collaboration among Infrastructures David Kelsey (STFC-RAL, UK) 1 st WISE, Barcelona 20 Oct 2015.

EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director Technical Director EGEE-III 1GDB - December 2009.

ISTeC Research Computing Open Forum: Using NSF or National Laboratory Resources for High Performance Computing Bhavesh Khemka.

Switzerland joining EGEE 7 March, 2005, GSI- Darmstadt by CSCS, the Swiss National Supercomputing Centre.

DIRAC 4 EGI: Report on the experience R.G. 1,3 & A.Tsaregorodtsev 2,3 1 Universitat de Barcelona 2 Centre de Physique des Particules de Marseille 3 DIRAC.

© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Grant Agreement n

Helix Nebula Workshop On Interoperability among Public And Community Clouds Session 2: Networking Connectivity Convener: Carmela ASERO, EGI.eu19 September.

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.

1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.

Building critical mass in ICT research and innovation Finding the synergies Building collaborations Prof Derek W. Keats Deputy Vice Chancellor (Knowledge.

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n

HPC Training Perspectives and Collaborations PRACE Advanced Training Centres.

A worldwide e-Infrastructure and Virtual Research Community for NMR and structural biology Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for.

March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.

J. Templon Nikhef Amsterdam Physics Data Processing Group Large Scale Computing Jeff Templon Nikhef Jamboree, Utrecht, 10 december 2012.

EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu

EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.

INTRODUCTION TO HIGH PERFORMANCE COMPUTING AND TERMINOLOGY.

How to get the needed computing Tuesday afternoon, 1:30pm Igor Sfiligoi Leader of the OSG Glidein Factory Operations University of California San Diego.

Ways to Connect to OSG Tuesday, Wrap-Up Lauren Michael, CHTC.

EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.

EGI towards H2020 Feedback (from survey)

Accessing the VI-SEEM infrastructure

Status of WLCG FCPPL project

Operations Support Manager - Open Science Grid

RDA US Science workshop Arlington VA, Aug 2014 Cees de Laat with many slides from Ed Seidel/Rob Pennington.

Advanced Communication Skills Training

The Landscape of Academic Research Computing

Grid infrastructure development: current state

Introduction to Analysis Example Tutorial

User Support and Training Unit in IGI

XSEDE’s Campus Bridging Project

Connecting the European Grid Infrastructure to Research Communities

ELIXIR Competence Center

Nordic High Performance Computing & Applications Workshop 2018

The EGI.eu Organisation

Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”

User Accounting Integration Spreading the Net.

Welcome to (HT)Condor Week #19 (year 34 of our project)

Presentation transcript:

Some Odds and Ends About Computational Infrastructure Kyle Gross – Operations Support Manager - Open Science Grid Research Technologies - Indiana University Slide contributions by Rob Quick

2012 Africa Grid School Computing Infrastructures Local Laptop/Desktop – Short jobs with small data Local Cluster – Larger jobs and larger data but subject to availability HPC – Prime performance with parallelized code HTC – Sustained computing over a long period for serialized workflows Cloud – Need deeper permission on an OS and/or have deeper pockets 2

2012 Africa Grid School Some Examples of Academic CIs Worldwide HTC  EGI (formally European Grid Initiative)  OSG (Open Science Grid)  ASGI (Asia Pacific Grid Initiative)  NorduGrid  Earth System Grid (ESG)  Many other regional and national infrastructures 3

2012 Africa Grid School Some Examples of Academic CIs Worldwide HPC  XSEDE (eXtreme Science and Engineering Discovery Environment)  PRACE (Partnership for Advanced Computing in Europe)  Compute Canada  Greek Research and Technology Network (GRNET)  Centre for HPC (South Africa)  Many other national infrastructures 4

2012 Africa Grid School Some Examples of Academic CIs Worldwide Cloud  EGI Federated Cloud  NeCTaR – National eResearch Collaboration Tools and Resources  Jetstream (Part of XSEDE)  SwissACC (Swiss Academic Computing Cloud)  Many other national cloud infrastructures 5

2012 Africa Grid School Let’s take one step at a time Can you run one job on one computer? Can you run one job on another computer? Can you run 10 jobs on a set of computers? Can you run a multiple job workflow? How do we put this all together? This is the path we’ll take 6 Small Large Local Distributed

2012 Africa Grid School What happens when you go home? DOSAR: Distributed Organization for Scientific and Academic Research You are welcome to join our bi- ‐ weekly video (Vidyo) meetings. Send request to be added to DOSAR list to Prof. Greenwood: reference you attended the Data Science Summer School in Trieste If you want long ‐ term grid access, you can request membership in the DOSAR VO 7

2012 Africa Grid School Questions? Questions? Comments?  Feel free to ask me questions now or later: Kyle Gross – Rob Quick Exercises start here: SP2016/AfricaGridSchoolMaterials Presentations are also available from this URL. 8