1. 1 Scientific Data Management Group LBNL SRM related demos SC 2002 DemosDemos Robust File Replication of Massive Datasets on the Grid GridFTP-HPSS access Provided through HRM HRM enables NCAR’s MSS to be accessed on the Grid Uniform Grid Access to Different Mass Storage Systems ProjectsProjects Earth Science Grid: Use of HRMs in ESG Demo, new HRM-NCAR included Particle Physics Data Grid: File replication for STAR project – Demo

2. 2 Junmin Gu, Vijaya Natarayan, Alex Sim, Arie Shoshani LBNL http://sdm.lbl.gov/srm Demo: Robust File Replication of Massive Datasets on the Grid This demo illustrates: Replicating Thousands of Files Robustly between Two remote HPSS installations Using a single command for a request to replicate all files Using an intermediate middleware storage management (called Hierarchical Storage Manager - HRM) Using a client HRM command-line module Without any modifications to the MSS Synchronizing pre-staging, file transfer, and archiving Robustness: recovers from MSS and network transient failures

3. 3 SRMs in Action : PPDG Disk Cache Disk Cache HRM-COPY (thousands of files) HRM-GET (one file at a time) HRM-Client Command-line Interface HRM (performs writes) HRM (performs reads) LBNL BNL GridFTP GET (pull mode) Anywhere stage files archive files Network transfer

4. 4 Web-Based File Monitoring Tool Shows: -Files already transferred - Files during transfer - Files to be transferred Also shows for each file: -Source URL -Target URL -Transfer rate

5. 5 Recent Measurements of large multi-file replication Shows that the network is the bottleneck

6. 6 Alex Romosan,Alex Sim, Junmin Gu,Arie Shoshani Alex Romosan, Alex Sim, Junmin Gu, Arie Shoshanihttp://sdm.lbl.gov/srm Demo: GridFTP-HPSS Access Provided through HRM This demo illustrates the capability of: Providing GridFTP access to Mass Storage Systems (MSSs) Using an intermediate middleware storage management (called Hierarchical Storage Manager - HRM) Without any modifications to the MSS Managing queues of multiple requests to the MSS Minimizing tape mounts Recovers from MSS transient failures

7. 7 Where does this service belong in the Grid architecture? Compute Systems Networks Other Storage systems Hierarchical Resource Manager Compute Resource Management General Data Discovery Services Community Authorization Services Application- Specific Data Discovery Services Storage Management (Brokering) Compute Scheduling (Brokering) Data Filtering or Transformation Services Database Management Services Request Interpretation and Planning Services File Transfer Service (GridFTP) Data Transport Services Monitoring/ Auditing Services Workflow or Request Management Services Consistency Services (e.g., Update Subscription, Versioning, Master Copies) Data Federation Services R E S O U R C E : S H A R I N G S I N G L E R E S O U R C E S C O L L E C T I V E 1 : G E N E R A L S E R V I C E S F O R C O O R D I N A T I N G M U L T I P L E R E S O U R C E S C O L L E C T I V E 2 : S E R V I C E S S P E C I F I C T O A P P L I C A T I O N D O M A I N O R V I R T U A L O R G. Resource Monitoring/ Auditing F A B R I C C O N N E C T I V I T Y Communication Protocols (e.g., TCP/IP stack) Authentication and Authorization Protocols (e.g., GSI) Data Filtering or Transformation Services C O L L E C T I V E This figure based on the Grid Architecture paper by Globus Team Mass Storage System (HPSS)

8. 8 HRMs and GridFTP HRM GridFTP SRM-API GridFTP-API Client HRM GridFTP move SRM-API GridFTP-API Client Using HRM protocol New: GridFTP-HPSS through HRM GridFTP entry

9. 9 GridFTP-HRM-Layer implementation detail HRM GridFTP-API Client GridFTP entry GridFTP move GridFTP exit FTP- HRM Layer Shared memory Corba 1a1b 2a 2b 3a 3b 1a: stor/retv 1b: hrm_get/hrm_put 2b: call_back 2a: unblock semaphore 3a: success_code 3b: hrm_release

10. 10 Alex Romosan,Junmin Gu,Alex Sim, Arie Shoshani Alex Romosan, Junmin Gu, Alex Sim, Arie ShoshaniLBNLhttp://sdm.lbl.gov/srm Demo: HRM enables NCAR’s MSS to be accessed on the Grid This demo illustrates: The application of Storage Resource Management (SRM) technology to make NCAR’s MSS Grid-enabled NCAR’s MSS is a unique system developed in house Making HRM-HPSS grid-enabled is a big task HRM is a specialized SRM designed for Mass Storage Systems (MSS). HRM-HPSS already exists Adapting HRM-HPSS to work with HRM-HPSS is a small task Demo illustrates success and ease of this approach

11. 11 How Was It Done? only MSS-specific module modified Disk Resource Manager (DRM) Tape Resource Manager (TRM) HPSS-specific Access Module Disk Cache HRM-HPSS Disk Resource Manager (DRM) Tape Resource Manager (TRM) NCAR-specific Access Module Disk Cache HRM-HPSS Specialize for NCAR-MSS

12. 12 Demo details: File Replication from NCAR MSS to NERSC HPSS controlled at NCAR

13. 13 SRMs in Action : ESG Tomcat servlet engine Tomcat servlet engine MCS Metadata Cataloguing Services MCS Metadata Cataloguing Services RLS Replica Location Services RLS Replica Location Services SOAP RMI MyProxy server MyProxy server MCS client RLS client MyProxy client GRAM gatekeeper GRAM gatekeeper CAS Community Authorization Services CAS Community Authorization Services CAS client disk MSS Mass Storage System HPSS High Performance Storage System disk HPSS High Performance Storage System disk SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management SRM Storage Resource Management gridFTP server gridFTP server gridFTP server gridFTP server gridFTP server gridFTP server gridFTP server gridFTP server openDAPg server openDAPg server gridFTP Striped server gridFTP Striped server LBNL LLNL ISI NCAR ORNL ANL

14. 14 Contributors: JLAB: Bryan Hess, Andy Kowalski FNAL: Don Petravick, Timur Perelmutov, Rich Wellner LBNL: Junmin Gu, Vijaya Natarayan,Ekow Otoo, LBNL: Junmin Gu, Vijaya Natarayan, Ekow Otoo, Alex Romosan,Alex Sim, Arie Shoshani Alex Romosan, Alex Sim, Arie Shoshani Demo: Uniform Grid Access to Different Mass Storage Systems This demo illustrates: Uniform Grid Access to: three MSSs: HPSS, Enstore, JASMine Using the Storage Resource Manager (SRM) interface SRM modules were developed independently for the 3 MSSs Shows the power of standard SRM functionality

15. 15 High Level View of Demo Setup SRM Enstore JASMine Client (USER/APPLICATIONS)

16. 16 Where do SRMs belong in the Grid architecture? Compute Systems Networks Other Storage systems Storage Resource Manager Compute Resource Management General Data Discovery Services Community Authorization Services Application- Specific Data Discovery Services Storage Management (Brokering) Compute Scheduling (Brokering) Data Filtering or Transformation Services Database Management Services Request Interpretation and Planning Services File Transfer Service (GridFTP) Data Transport Services Monitoring/ Auditing Services Workflow or Request Management Services Consistency Services (e.g., Update Subscription, Versioning, Master Copies) Data Federation Services R E S O U R C E : S H A R I N G S I N G L E R E S O U R C E S C O L L E C T I V E 1 : G E N E R A L S E R V I C E S F O R C O O R D I N A T I N G M U L T I P L E R E S O U R C E S C O L L E C T I V E 2 : S E R V I C E S S P E C I F I C T O A P P L I C A T I O N D O M A I N O R V I R T U A L O R G. Resource Monitoring/ Auditing F A B R I C C O N N E C T I V I T Y Communication Protocols (e.g., TCP/IP stack) Authentication and Authorization Protocols (e.g., GSI) Data Filtering or Transformation Services C O L L E C T I V E This figure based on the Grid Architecture paper by Globus Team Mass Storage System (HPSS)

17. 17 Main advantages of using SRMs Same uniform interface to all types of storage systemsSame uniform interface to all types of storage systems Disk Storage System Mass Storage System For Mass Storage Systems it provides:For Mass Storage Systems it provides: Queuing and pre-staging Queued multi-file “get” requests (avoid flooding MSS) Pre-staging of files (concurrent with transfer) Queued archiving of “put” requests (avoid flooding MSS) Robustness and efficiency Recover in case of transient failures from MSS Reorders pre-staging requests to minimize tape mounts Recovery from failed GridFTP transfers Re-issues requests in case of failure