Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison.

Slides:



Advertisements
Similar presentations
Building Campus HTC Sharing Infrastructures Derek Weitzel University of Nebraska – Lincoln (Open Science Grid Hat)
Advertisements

ESolutions Service Desk IT Services for Students.
Go to Slide Master View to edit Footer 1 Introduction to the Online Help Desk Unit Liaison Meeting June 19, 2009.
May 12, 2015 XSEDE New User Tutorials and User Support: Lessons Learned Marcela Madrid.
Campus High Throughput Computing (HTC) Infrastructures (aka Campus Grids) Dan Fraser OSG Production Coordinator Campus Grids Lead.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Services and Operations in Polish NGI M. Radecki,
Technology on the NGS Pete Oliver NGS Operations Manager.
6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal.
Communicating with Users about HTCondor and High Throughput Computing Lauren Michael, Research Computing Facilitator HTCondor Week 2015.
SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.
© 2015 MONASH SOUTH AFRICA CONFIDENTIAL & PROPRIETARY.
September 10, 2015 XSEDE and OSG Kim Dillman Alain Roy
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
LARK Bringing Distributed High Throughput Computing to the Network Todd Tannenbaum U of Wisconsin-Madison Garhan Attebury
CILogon OSG CA Mine Altunay Jim Basney TAGPMA Meeting Pittsburgh May 27, 2015.
Connect.usatlas.org ci.uchicago.edu ATLAS Connect Technicals & Usability David Champion Computation Institute & Enrico Fermi Institute University of Chicago.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Overview of the Computer Resource Team (CRT) Blaise Barney (LLNL) Rob Cunningham (LANL) Barbara Jennings (Sandia) PSAAP Kickoff Meeting July 8, 2008 Albuquerque,
Campus Grids Report OSG Area Coordinator’s Meeting Dec 15, 2010 Dan Fraser (Derek Weitzel, Brian Bockelman)
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
The Research Computing Center Nicholas Labello
Use of Condor on the Open Science Grid Chris Green, OSG User Group / FNAL Condor Week, April
October 21, 2015 XSEDE Technology Insertion Service Identifying and Evaluating the Next Generation of Cyberinfrastructure Software for Science Tim Cockerill.
Discussion Topics DOE Program Managers and OSG Executive Team 2 nd June 2011 Associate Executive Director Currently planning for FY12 XD XSEDE Starting.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
The II SAS Testbed Site Jan Astalos - Institute of Informatics Slovak Academy of Sciences.
Center for Research Computing at Notre Dame Jarek Nabrzyski, Director
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
15-Dec-04D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Update (Report from the Joint Security Policy Group) CERN 15 December 2004 David Kelsey CCLRC/RAL,
In order to better understand the possible requirements for TeraGrid to accommodate the needs of users who would like to use multiple resources across.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
Debbie Becker  Source code PHP  Database MySQL  Minimal jscript  No cookies, flash animation, add-ons.
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
| nectar.org.au NECTAR TRAINING Module 5 The Research Cloud Lifecycle.
Mar 27, gLExec Accounting Solutions in OSG Gabriele Garzoglio gLExec Accounting Solutions in OSG Mar 27, 2008 Middleware Security Group Meeting Igor.
Open Science Grid as XSEDE Service Provider Open Science Grid as XSEDE Service Provider December 4, 2011 Chander Sehgal OSG User Support.
Where to go and what to do next — OSG, resources, help, mentors Thursday afternoon, 4:30pm Jim Weichel OSG Special Projects Fermi National Laboratory,
Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.
Remote & Collaborative Visualization. TACC Remote Visualization Systems Longhorn – Dell XD Visualization Cluster –256 nodes, each with 48 GB (or 144 GB)
Campus Grid Technology Derek Weitzel University of Nebraska – Lincoln Holland Computing Center (HCC) Home of the 2012 OSG AHM!
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
March 2014 Open Science Grid Operations A Decade of HTC Infrastructure Support Kyle Gross Operations Support Lead Indiana University / Research Technologies.
Job submission overview Marco Mambelli – August OSG Summer Workshop TTU - Lubbock, TX THE UNIVERSITY OF CHICAGO.
HTCondor-CE. 2 The Open Science Grid OSG is a consortium of software, service and resource providers and researchers, from universities, national laboratories.
Academic Technology Services The UC Grid Project OSG Consortium All-Hands Meeting Bill Labate & Joan Slottow Research Computing Technologies UCLA Academic.
How to get the needed computing Tuesday afternoon, 1:30pm Igor Sfiligoi Leader of the OSG Glidein Factory Operations University of California San Diego.
Ways to Connect to OSG Tuesday, Wrap-Up Lauren Michael, CHTC.
Virtual Organisations and the NGS Mike Jones Research Computing Services e-Science & “The Grid” for Bio/Health Informaticians, IT January 2008.
Large Input in DHTC Thursday PM, Lecture 1 Lauren Michael CHTC, UW-Madison.
Large Output and Shared File Systems
Introduction to the Online Help Desk
Volunteer Computing for Science Gateways
Place a hold on a checked out item
Brief overview on GridICE and Ticketing System
“The HEP Cloud Facility: elastic computing for High Energy Physics” Outline Computing Facilities for HEP need to evolve to address the new needs of the.
OSG Connect and Connect Client
Introduction to XSEDE Resources HPC Workshop 08/21/2017
XSEDE’s Campus Bridging Project
OSG Rob Gardner • University of Chicago
Using Microsoft LiveMeeting to Teach Online
Advanced Computing Facility Introduction
Place a hold on a checked out item
Introduction to Free HPC Resources: XSEDE
Brian Lin OSG Software Team University of Wisconsin - Madison
The Design of a Grid Computing System for Drug Discovery and Design
Material for today’s workshop is at:
ACI-Ref Virtual Residency 2019
EGI High-Throughput Compute
Presentation transcript:

Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison

2015 OSG User School Overview Types of OSG submit points OSG Virtual Organizations (members of OSG consortium) Other OSG submit points  OSG Connect  OSG Connect Client  OSG via XSEDE 2

2015 OSG User School Overview Types of OSG submit points OSG Virtual Organizations (members of OSG consortium) Other OSG submit points  OSG Connect  OSG Connect Client  OSG via XSEDE 3

2015 OSG User School HTC Submit Point Submit Node HTCondor Pool (or other type of Cluster)

2015 OSG User School HTC Submit Point Submit Node HTCondor Pool (or other type of Cluster) osg-ss-submit

2015 OSG User School OSG Submit Points 6 OSG (>120 sites) Submit Node HTCondor Pool (or other Cluster) OSG entry point specific to VO

2015 OSG User School OSG Submit Points 7 OSG (>120 sites) Submit Node HTCondor Pool (or other Cluster) Submit Node OSG entry point

2015 OSG User School OSG Submit Points 8 OSG (>120 sites) Submit Node HTCondor Pool (or other Cluster) Submit Node OSG entry point osg-ss-glidein-submit

2015 OSG User School OSG Submit Points 9 OSG (>120 sites) Submit Node HTCondor Pool (or other Cluster) Submit Node OSG entry point

2015 OSG User School Accessing an OSG Submit Point – 4 Ways Local Virtual Organization (VO)  campus, national lab, or research organization that is part of the OSG consortium OSG Connect  an OSG VO for individuals without a local VO  OSG Connect Client  use another cluster submit/head node as an OSG submit point XSEDE  collection of HPC clusters available to U.S. academics via allocations of compute hours 10

2015 OSG User School OSG entry point Access Methods: Local VO 11 OSG (>120 sites) Submit Node HTCondor Pool Submit Node

2015 OSG User School HTCondor Pool (or other type of Cluster) OSG entry point Other Access Methods: 12 OSG (>120 sites) Submit Node OSGConnect XSEDE Connect Client

2015 OSG User School *not all XSEDE Campus Champions will have experience with HTC or OSG Accessing an OSG Submit Point – 4 Ways 13 Local VOOSG ConnectConnect ClientXSEDE Available to users with a campus/org VO affiliates of U.S. research orgs users of cluster with Connect Client users with XSEDE allocation Cost unlikelyFREEunlikely NO (but need allocation) Limit on CPU hrs unlikelyNO YES (per allocation) Local Help very likely (local staff) unlikely possibly (cluster staff) possibly* (Campus Champion) Online Guides likelyYES limited Submit Point Type submit server (or direct OSG entry server) direct OSG entry server cluster submit node to OSG entry server submit node to OSG entry server

2015 OSG User School Accessing an OSG Submit Point – 4 Ways Local Virtual Organization (VO)  campus, national lab, or research organization that is part of the OSG consortium OSG Connect  an OSG VO for individuals without local OSG support  OSG Connect Client  use another cluster submit server as a submit point XSEDE  collection of HPC clusters available to U.S. academics via allocations of compute hours 14

2015 OSG User School Virtual Organization (VO) institution or research project that is part of the OSG consortium accounts and access determined by local VO administrators most offer user support or specialized interfaces for their specific setup and population of users How do I determine whether my organization is/has a VO? 15

2015 OSG User School … to the real world 16

2015 OSG User School … to the real world 17

2015 OSG User School … to the real world 18

2015 OSG User School 19

2015 OSG User School Using OSG through a VO 1.Determine whether there is a local VO for your institution/organization. 2.Get an account Contact the administrators to get an account on their glidein server (or submit node tied to a glidein server). 3.Submit jobs Follow site-specific guides and/or submit jobs as you have been at the OSG School. 20

2015 OSG User School Accessing an OSG Submit Point – 4 Ways Local Virtual Organization (VO)  campus, national lab, or research organization that is part of the OSG consortium OSG Connect  an OSG VO for individuals without local OSG support  OSG Connect Client  use another cluster submit server as a submit point XSEDE  collection of HPC clusters available to U.S. academics via allocations of compute hours 21

2015 OSG User School OSG Connect 22 Essentially, a VO available to those without a Local VO Free for affiliates/partners of U.S. research institutions Submit from OSG Connect server or use Connect Client on another cluster OSG ConnectBook has online guide information and contact info for help

2015 OSG User School 23

2015 OSG User School 24 Details and hands-on exercises after this coming next!

2015 OSG User School Accessing an OSG Submit Point – 4 Ways Local Virtual Organization (VO)  campus, national lab, or research organization that is part of the OSG consortium OSG Connect  an OSG VO for individuals without local OSG support  OSG Connect Client  use another cluster submit server as a submit point XSEDE  collection of HPC clusters available to U.S. academics via allocations of compute hours 25

2015 OSG User School OSG via 26 XSEDE: a consortium of HPC clusters and other computational services available to academics in the U.S. free accounts, but you must request an XSEDE allocation of compute hours limited online guides specific to OSG- XSEDE, but similar to submission via osg-ss-glidein-submit

2015 OSG User School Using OSG via 27 1.Sign up for an XSEDE account. 2.Request an OSG allocation via the XSEDE User Portal to request a startup (or long-term) allocation of compute hours for OSG. 3.Follow XSEDE’s guides for connecting to and using the OSG submit server. 4.Submit jobs as you have been at the school, making sure to indicate your XSEDE project name (allocation code).

2015 OSG User School 28

2015 OSG User School … to the real world 29

2015 OSG User School … to the real world 30

2015 OSG User School Overview Types of OSG submit points OSG Virtual Organizations (members of OSG consortium) Other OSG submit points  OSG Connect  OSG Connect Client  OSG via XSEDE 31

2015 OSG User School Questions? Feel free to contact me:  Next: OSG Connect and Connect Client  3:30-4:00pm, Intro by David Then:  4:00pm-5:00pm, Using OSG Connect and Connect Client (hands-on)  End, Day 2 32