1. Trust & File Systems Rick Wagner HPC Systems Manager

2. IDI: Building the Digital University Rick Wagner Frank K. Wuerthwein Rob Knight “…integrates compute & storage resources at SDSC with instruments and labs across campus…” 2 Focuses Integrative Omics Seamless Data & Computing 3 Components High-performance, scalable, central storage Campus backbone and the Prism network as a Science DMZ Core and embedded IT staff in a tiered model

3. Why Will This Succeed? Tiered Staffing Model Project funds central storage engineers and lab admins Labs are not customers, they’re part of the team! storage engineer lab admin researcher Project Team Lab ALab B

4. On Campus c = ∞ Parallel File System Lab A Lab B Comet ScienceDMZ

5. Lab ALab B Comet Scalable Parallel File System

6. OSS MDS ost0/labA-ost0 ost0/labB-ost0 ost0/comet-ost0 ost1/labA-ost1 ost1/labB-ost1 ost1/comet-ost1 mdt0/labA-mdt0 mdt0/labB-mdt0 mdt0/comet-mdt0 Lab A Lab B Comet /oasis/projects/labA /oasis/projects/labB /oasis/comet/scratch /oasis/projects/labA /oasis/projects/labB NID0 NID1 ZFS is magical! zpool dataset

7. Lack of Trust

8. Lustre nodemap Steve Simms, IU LUG2015 +shared keys!

9. Lab A Lab B Comet Scalable Parallel File System Lab C virtual cluster FIONA

10. Lab A Lab B Comet Scalable Parallel File System Lab C virtual cluster Lab D c != ∞ ∴ streaming IO FIONA