Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –

Slides:

Advertisements

Similar presentations

 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.

Advertisements

S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.

Introduction to Network Administration. Objectives.

Minerva Infrastructure Meeting – October 04, 2011.

OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.

Linux & UNIX Version 5.3 (Power) Version 6.1 (Power) Version 7.1 (Power) AIX Version 11iv2 (PA-RISC/IA64) Version 11iv3 (PA-RISC/IA64) HP-UX Version.

Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.

Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.

Connect.usatlas.org ci.uchicago.edu ATLAS Connect Technicals & Usability David Champion Computation Institute & Enrico Fermi Institute University of Chicago.

SRM at Clemson Michael Fenn. What is a Storage Element? Provides grid-accessible storage space. Is accessible to applications running on OSG through either.

October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.

OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.

OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.

Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.

OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.

INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.

OSG Fundamentals Scot Kronenfeld - Marco Mambelli –

May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,

1 © 2004, Cisco Systems, Inc. All rights reserved. CCNA 4 v3.1 Module 6 Introduction to Network Administration.

How to Install and Use the DQ2 User Tools US ATLAS Tier2 workshop at IU June 20, Bloomington, IN Marco Mambelli University of Chicago.

A. Sim, CRD, L B N L 1 OSG Applications Workshop 6/1/2005 OSG SRM/DRM Readiness and Plan Alex Sim / Jorge Rodriguez Scientific Data Management Group Computational.

G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.

Mine Altunay OSG Security Officer Open Science Grid: Security Gateway Security Summit January 28-30, 2008 San Diego Supercomputer Center.

Overview of Monitoring and Information Systems in OSG MWGS08 - September 18, Chicago Marco Mambelli - University of Chicago

OSG Software and Operations Plans Rob Quick OSG Operations Coordinator Alain Roy OSG Software Coordinator.

Mar 28, 20071/9 VO Services Project Gabriele Garzoglio The VO Services Project Don Petravick for Gabriele Garzoglio Computing Division, Fermilab ISGC 2007.

10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab

Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”

Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.

UMD TIER-3 EXPERIENCES Malina Kirn October 23, 2008 UMD T3 experiences 1.

March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.

OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.

CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.

Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.

MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos

1 Development of a High-Throughput Computing Cluster at Florida Tech P. FORD, R. PENA, J. HELSBY, R. HOCH, M. HOHLMANN Physics and Space Sciences Dept,

INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

Overview of Privilege Project at Fermilab (compilation of multiple talks and documents written by various authors) Tanya Levshina.

US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.

Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.

GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.

PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.

OSG Integration Activity Report Rob Gardner Leigh Grundhoefer OSG Technical Meeting UCSD Dec 16, 2004.

6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.

Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:

The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.

Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.

OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.

OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider.

Scientific Computing in PPD and other odds and ends Chris Brew.

Sep 17, 20081/16 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Sep 17, 2008 Gabriele Garzoglio.

The GridPP DIRAC project DIRAC for non-LHC communities.

INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.

Discussion on data transfer options for Tier 3 Tier 3(g,w) meeting at ANL ASC – May 19, 2009 Marco Mambelli – University of Chicago

Integration TestBed (iTB) and Operations Provisioning Leigh Grundhoefer.

The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.

OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.

SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,

OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.

OSG Fundamentals Adapted from: Alain Roy Terrence Martin Suchandra Thapa.

Defining the Technical Roadmap for the NWICG – OSG Ruth Pordes Fermilab.

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

Jean-Philippe Baud, IT-GD, CERN November 2007

System Center 2012 Configuration Manager

Extended OSG client for WLCG

gLite The EGEE Middleware Distribution

Installation/Configuration

CCNA 4 v3.1 Module 6 Introduction to Network Administration

Module 02 Operating Systems

Presentation transcript:

Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –

August US ATLAS Tier2/Tier3 Workshop at UChicago What is OSG? Abstraction  Provides ways to refer, discover and use heterogeneous and distributed resources (Grid) Software stack  Implementation, supporting resources, processes Services and support  GOC, monitoring and accounting A community  Virtual Organizations, developers, integrators, Site administrators 2

August US ATLAS Tier2/Tier3 Workshop at UChicago Principle: Autonomy Sites and VOs are autonomous  You make decisions about your site  We provide software  You decide when to install, upgrade  You make operational decisions  We help out, but you are responsible for your site: we expect you to care about your site. 3

August US ATLAS Tier2/Tier3 Workshop at UChicago What is the role of ATLAS? An OSG site administrator should  Keep in touch with OSG for operation  Plan how your site works  Attempt to keep up to date with software  Be part of the OSG community  Request to support software you need  Validate releases against your software  Suggest directions  Manage users and membership 4

August US ATLAS Tier2/Tier3 Workshop at UChicago What does OSG do for ATLAS? We should provide:  Up to date grid software  An easy installation and upgrade process  Assistance in times of need  A community of site administrators to share experiences with  Possibility to access and offer resources 5  An exciting, cutting-edge, 21st-century collaborative distributed computing grid cloud buzzword-compliant environment

August US ATLAS Tier2/Tier3 Workshop at UChicago Release cycle Software becomes available Validation Testbed (VTB) checks that new components work with the current/new release VDT and OSG prepare a release candidate Integration Testbed (ITB) tests the release candidate (e.g. OSG 1.1) on a larger scale OSG is released Updates and support are available 6

August US ATLAS Tier2/Tier3 Workshop at UChicago What can offer to Tier 3 Client Computing Element Local Resource Manager (Condor) Storage Element Network client diagnostic tools 7

August US ATLAS Tier2/Tier3 Workshop at UChicago WLCG-Client Thin level on top of OSG Client  Tested with ATLAS software  Compatibility problems solved Provides  (VOMS) proxy management  Data movement: srmcp, lcg-cp, globus-url-copy, …  Job submission: globus-job-run, condor_submit  Catalog access: lfc-ls Provides Grid and catalog (LFC) support for  DQ2Clients  Pathena

August US ATLAS Tier2/Tier3 Workshop at UChicago WLCG-Client supported platforms VDT supported platforms:   Operating System in 1.10Architectures AIX 5ppc CentOS 5x86, x86-64 Debian 3.1 (Sarge)x86 Debian 4x86, x86-64 Mac OS X 10.4x86 ROCKS Linux 3.3x86 Red Hat Enterprise Linux 3 AS x86, x86-64, x86 on x86-64, IA- 64 Red Hat Enterprise Linux 4 ASx86, x86-64, x86 on x86-64 Red Hat Enterprise Linux 5 APx86, x86-64, x86 on x86-64 SUSE Linux 9x86-64, IA-64 Scientific Linux 4IA-64 Scientific Linux Fermi 3x86 Scientific Linux Fermi 4x86, x86-64, x86 on x86-64 Operating System in 2.0Architectures AIX 5.3ppc CentOS 5x86, x86-64 Debian 4x86, x86-64 Debian 5x86, x86-64 Mac OS X 10.4x86 ROCKS Linux 3.3x86 Red Hat Enterprise Linux 3 ASx86, x86-64, IA-64 Red Hat Enterprise Linux 4 ASx86, x86-64 Red Hat Enterprise Linux 5 APx86, x86-64 SUSE Linux 9x86-64, IA-64 Scientific Linux 4IA-64 Scientific Linux Fermi 3x86 Scientific Linux Fermi 4x86, x86-64

August US ATLAS Tier2/Tier3 Workshop at UChicago Network client diagnostic tools Use perfSONAR services Troubleshoot network problems Server installed at Tier 1 and Tier 2 Clients: NDT, OWAMP, BWCTL, NPAD Documentation/NetworkPerformanceHa ndsOn

August US ATLAS Tier2/Tier3 Workshop at UChicago Computing Element The head node to your site. Users submit jobs to the CE Well-defined set of software VDT Subset:  Globus  RSV  PRIMA  Gratia… and another dozen OSG bits:  Information about OSG VOs  OSG configuration script (configure-osg) 11

August US ATLAS Tier2/Tier3 Workshop at UChicago Condor Simple installation Packaging Testing Documentation  Manual  Use cases Support

August US ATLAS Tier2/Tier3 Workshop at UChicago Storage Element Manages large set of data at your site SRM protocol Multiple implementations  dCache  BeStMan-xrootd  BeStMan-Hadoop  BeStMan (gateway) over FS

August US ATLAS Tier2/Tier3 Workshop at UChicago Discussion, Questions Questions? Thoughts? Comments? Requests? 14