1 Meeting Location: LBNL Sept. 1-2, 2004 SRM Annual Meeting Attendees Olof Barring, CERN Jean-Philippe Baud, CERN James Casey, CERN Peter Kunszt, CERN.

Slides:



Advertisements
Similar presentations
CASTOR SRM v1.1 experience Presentation at HEPiX MSS Forum 28/05/2004 Olof Bärring, CERN-IT.
Advertisements

HEPiX GFAL and LCG data management Jean-Philippe Baud CERN/IT/GD.
Jens G Jensen CCLRC/RAL hepsysman 2005Storage Middleware SRM 2.1 issues hepsysman Oxford 5 Dec 2005.
Reusable Test Case For Login Module Author: Ashwin C Reference: Q-Patterns by Vipul Kocher from PureTesting.com Version No: 1.0 Created Date: 02/08/2007.
CASTOR SRM v1.1 experience Presentation at SRM meeting 01/09/2004, Berkeley Olof Bärring, CERN-IT.
1 CHEP 2003 Arie Shoshani Experience with Deploying Storage Resource Managers to Achieve Robust File replication Arie Shoshani Alex Sim Junmin Gu Scientific.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
Intelligent Grid Solutions 1 / 18 Convergence of Grid and Web technologies Alexander Wöhrer und Peter Brezany Institute for Software.
Grid Collector: Enabling File-Transparent Object Access For Analysis Wei-Ming Zhang Kent State University John Wu, Alex Sim, Junmin Gu and Arie Shoshani.
1 Storage Resource Management WG meeting, Sept Storage Resource Management: Functional and Operational Specifications September 14-15, 2005 Meeting.
Scientific Data Management (SDM)
A. Sim, CRD, L B N L GIN-Data : SRM Island Inter-Op Testing With SRM-TESTER Alex Sim, Vijaya Natarajan Computational Research Division Lawrence Berkeley.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 5: Managing File Access.
DPM CCRC - 1 Research and developments DPM status and plans Jean-Philippe Baud.
CERN, 29 August 2006 Status Report Riccardo Zappi INFN-CNAF, Bologna.
A. Sim, CRD, L B N L 1 Oct. 23, 2008 BeStMan Extra Slides.
Data management in grid. Comparative analysis of storage systems in WLCG.
Process Management Working Group Process Management “Meatball” Dallas November 28, 2001.
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
Mass Storage System Forum HEPiX Vancouver, 24/10/2003 Don Petravick (FNAL) Olof Bärring (CERN)
Data Management The GSM-WG Perspective. Background SRM is the Storage Resource Manager A Control protocol for Mass Storage Systems Standard protocol:
EGEE Catalogs Peter Kunszt EGEE Data Management Middleware Service Grids NeSC, July 2004 EGEE is a project funded by the.
4 Oct 04Storage Resource Manager, Timur Perelmutov, Don Petravick, Fermilab 1 Storage Resource Management at Fermilab Timur Perelmutov Don Petravick Fermi.
D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.
Enabling Project Communication, Collaboration & Workflow (CCW)
1 Meeting Location: LBNL Sept 18, 2003 The functionality of a Replica Registration Service Attendees Michael Haddox-Schatz, JLAB Ann Chervenak, USC/ISI.
1 CCSDS Information Architecture Working Group Daniel J. Crichton, Chair NASA/JPL 14 September 2005.
Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.
Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.
1 Grid File Replication using Storage Resource Management Presented By Alex Sim Contributors: JLAB: Bryan Hess, Andy Kowalski Fermi: Don Petravick, Timur.
Computing Sciences Directorate, L B N L 1 CHEP 2003 Standards For Storage Resource Management BOF Co-Chair: Arie Shoshani * Co-Chair: Peter Kunszt ** *
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
SRM & SE Jens G Jensen WP5 ATF, December Collaborators Rutherford Appleton (ATLAS datastore) CERN (CASTOR) Fermilab Jefferson Lab Lawrence Berkeley.
1 LHCb File Transfer framework N. Brook, Ph. Charpentier, A.Tsaregorodtsev LCG Storage Management Workshop, 6 April 2005, CERN.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/03/08 An update on SRM Mumbai & subsequent discussion summary –
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/06/07 SRM v2.2 working group update Results of the May workshop at FNAL
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
CERN SRM Development Benjamin Coutourier Shaun de Witt CHEP06 - Mumbai.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
Authorization GGF-6 Grid Authorization Concepts Proposed work item of Authorization WG Chicago, IL - Oct 15 th 2002 Leon Gommans Advanced Internet.
Online Submission and Management Information -- Authors AMS Annual Conference / AMS WMC Click on play to begin show.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
SDM Center Coupling Parallel IO to SRMs for Remote Data Access Ekow Otoo, Arie Shoshani and Alex Sim Lawrence Berkeley National Laboratory.
1 Use of SRM File Streaming by Gateway Alex Sim Arie Shoshani May 2008.
C O M P U T A T I O N A L R E S E A R C H D I V I S I O N SRM Basic/Advanced Spec Issues Arie Shoshani, Alex Sim, Junmin Gu Scientific Data Management.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
PPDG meeting, July 2000 Interfacing the Storage Resource Broker (SRB) to the Hierarchical Resource Manager (HRM) Arie Shoshani, Alex Sim (LBNL) Reagan.
INFSO-RI Enabling Grids for E-sciencE SRMv2.2 in DPM Sophie Lemaitre Jean-Philippe.
WLCG Grid Deployment Board CERN, 14 May 2008 Storage Update Flavia Donno CERN/IT.
1 Xrootd-SRM Andy Hanushevsky, SLAC Alex Romosan, LBNL August, 2006.
CEG 2400 FALL 2012 Windows Servers Network Operating Systems.
A. Sim, CRD, L B N L 1 SRM Collaboration Meeting, Sep , 2005 SRM v3.0 LBNL Implementation Status Report Scientific Data Management Research Group.
Data Breakout. OGSA Architecture – databases Eldas, OGSA-DAI and GridMiner implement a slightly old version of OGSA / DAIS –Architecture doc describes.
1 SRM v2.2 Discussion of key concepts, methods and behaviour F. Donno CERN 11 February 2008.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
1 Scientific Data Management Group LBNL SRM related demos SC 2002 DemosDemos Robust File Replication of Massive Datasets on the Grid GridFTP-HPSS access.
SRM 2.2: experiment requirements, status and deployment plans 6 th March 2007 Flavia Donno, INFN and IT/GD, CERN.
Return to Home! Go To Next Slide! Return to Home! Go To Next Slide!
Arie Shoshani – Dec 2002 Arie Shoshani meeting held at CERN December, 2002 Comments and Observations SRM + GLUE.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Status of SRB/SRM interface development Fu-Ming Tsai Academia Sinica Grid Computing.
Bologna, March 30, 2006 Riccardo Zappi / Luca Magnoni INFN-CNAF, Bologna.
9/20/04Storage Resource Manager, Timur Perelmutov, Jon Bakken, Don Petravick, Fermilab 1 Storage Resource Manager Timur Perelmutov Jon Bakken Don Petravick.
OGSA-WG Program Execution Status Update GGF9 Chicago, USA October, 2003 GLOBALGRIDFORUM.ORG.
1 Web Time Entry Information Session August 3, 2007.
StoRM: a SRM solution for disk based storage systems
SRM v2.2 / v3 meeting report SRM v2.2 meeting Aug. 29
SRM v2.2 planning Critical features for WLCG
SRM Developers' Response to Enhancement Requests
SRM V2.1: Additional Design Issues
GIN-Data : SRM Island Inter-Op Testing
Presentation transcript:

1 Meeting Location: LBNL Sept. 1-2, 2004 SRM Annual Meeting Attendees Olof Barring, CERN Jean-Philippe Baud, CERN James Casey, CERN Peter Kunszt, CERN Andy Kowalski, Jlab Don Petravick, Fermilab Timur Perelmutov, Fermilab Matteo Melani, SLAC Junmin Gu, LBNL Alex Sim, LBNL Arie Shoshani, LBNL

2 Agenda Wednesday, September 1: 9:00 am - 12:30 pm Session 1: SRM-Basic Presentations and discussions on the desirability and features of an SRM-Basic. This is a concept submitted to GGF in the GSM-WG charter. We will also discuss what features should SRM-Advanced include. The relationship of SRM-Basic and SRM- Advanced to SRM v1.1 and v2.1, and future SRM versions will be discussed as well. 10:30 am – Break 12:30 pm - 2:00 pm Lunch Break 2:00 pm - 5:30 pm Session 2: Experience with SRM implementations Presentations and discussions on implementations of SRMs, including SRM v1.1 and SRM v2.1. Discussion should include: missing features, unnecessary features, enhancement to current specs, features that are hard to implement, etc. 3:30 pm - Break 5:30 pm - Adjourn Thursday, September 2: 9:00 am - 12:30 pm Session 3: SRM v3.0 This session is open for discussion of advanced features we currently do not have in SRM v2.1. This includes, but not limited to the interaction of SRMs with Virtual Organization Managers (VOMS), authorization, ACLs, accounting, and storage usage optimization. 10:30 am - Break 12:30 pm - 2:00 pm Lunch Break 2:00 pm - 5:30 pm Session 4: SRM and WSRF WSRF is a framework that includes multiple services (such as notification service). Specifying an SRM interface in this framework depends on which services one assumes to use. The issues to be discussed are how to specify generic SRM interfaces, and have specific WSRF interfaces interoperate. We may also discuss the possibility of interoperability of web- services-based SRM interfaces and WSRF- based interfaces. 3:30 pm - Break 5:30 pm - Adjourn

3 Experience with SRM Implementations Problem with spec implementation difficulties

4 SRM-Basic SRM-BasicSRM-Basic Presentations/discussion Arie (Alex’s slides) – general approach to versions Olof – Basic proposal Alex – combined Olof’s and other enhancement Arie – features discussion (original table) Peter - suggestion

5 Experience with current versions Maturity and experienceMaturity and experience Don/Timur Andy on Alex with SRM 1.1with SRM 1.1 Presentations/discussions Alex Sim Olof Barring Need guidelines for how long to keep requests after they are finished Get involved in Glue schema Reference GSI module Reference test suites Peter Kunszt with SRM 2.1with SRM 2.1 Presentations/discussions Junmin Gu + Alex Sim Jean-Philippe Baud/James Casey

6 SRM-Basic Relationship to SRM v1.x, v2.x and SRM-Advanced

7 SRM v3.0 AuthorizationAuthorization AccountingAccounting Late binding of get and copyLate binding of get and copy Provide an ordered list of source SURLs)

8 SRM and WSRF How to take advantage of framework?How to take advantage of framework? What is the effect on the SRM interfaceWhat is the effect on the SRM interface Advantages to SRM?Advantages to SRM?

9 Problems with SRM 2.1 How to assign directories to Permanent space (e.g. HPSS)How to assign directories to Permanent space (e.g. HPSS) x y z F1(V) F2 (v) F3 (v)F4 (P) x y z home Foo1Foo2Foo3 Volatile Space SRM logical directory HPSS permanent Space

10 Problems with SRM 2.1 Size of returns from SRMSize of returns from SRM e.g. status, ls Given {offset,count} – what is default size limit? If size limit exceed – what is error (too many results?) A dedicated port for SRMA dedicated port for SRM add recursiveLevel etc in get/copy requests since they take directories.add recursiveLevel etc in get/copy requests since they take directories.