Your university or experiment logo here GridPP Storage Future Jens Jensen GridPP workshop RHUL, April 2010

Your university or experiment logo here Roadmap <1 year of GridPP3 Then GridPP4 –Hopefully full steam ahead A test of the Grid’s core data model –guid:931b5c f14-8b80-63aa –guid:c769954c-1ba6-4cd b2a4d496dab5 –guid:55323b16-2e2e-49fa-9bfd-41ab8099a88c –guid:f64ec9ab-f03f-46bb-9e c3a3 –guid:81aa5bed-febd-40ef-8b f16f –guid:0d4e652e-38ef-41db-8d05-372f2f5bbf6b

Your university or experiment logo here Metapoints For now: –Ongoing operations –“Issues” –New milestones For GridPP4: –Revisit strategy –Revisit metrics –Revisit risks (last updated Feb 07)

Your university or experiment logo here Strategic View “The GridPP storage group will provide and support storage middleware necessary and sufficient to Grid-enable storage at every GridPP site.” Strategic view needs to change for GridPP4

Your university or experiment logo here (GridPP3) Goals 1.Storage Element interfaces (SRM+GridFTP+IS) 1.GridFTP performance 2.IS accuracy 2.Deployment/upgrade/maintenance/ debugging 3.Standards compliance, interoperable 4.Usable storage

Your university or experiment logo here Dealing with Change

Your university or experiment logo here Middleware Support dCache – supported by DESY and FNAL DPM – supported by CERN StoRM – supported by INFN EGI, EMI, IGE –More TLAs Cloud computing

Your university or experiment logo here Operations Issues Upgrades Coping with change Core work area –Storage middleware Scope –Optimisation and tuning, operations, troubleshooting, monitoring,

Your university or experiment logo here Operations Issues Upgrades Coping with change Expanding range of work –Catalogues –Data management –Storage middleware –Distributed filesystems –Filesystems –Hardware –Networks Scope –Optimisation and tuning, operations, troubleshooting, monitoring,

Your university or experiment logo here Issues Specific frequent problems –Maybe need a better name Difficult to solve –Require some sort of planning to address correctly –Deliverables

Your university or experiment logo here Issues File Integrity Testing –Planning: –Outcome: discussed in weekly EVO –Status: closed(ish) Access Patterns –Planning: loose set of pages in wiki –Outcome (so far): see all the nice presentations –Status: ongoing file:// –Related to Access Patterns Testing –Planning:

Your university or experiment logo here Issues Middleware –{StoRM,BeStMan} on {Hadoop,Lustre,GPFS} –Re-evaluating dCache –Development priorities for dCache Information Systems –Fully compliant with WLCG Installed Capacity –GLUE 2.0 –Accurate accounting data SSD Evaluation Syncat – coping with orphaned files Use of virtual machines Filesystems evaluations (ext4, ZFS) Distributed filesystems evaluations (NFS4, Lustre, GPFS)

Your university or experiment logo here Conclusion Lots of challenges, still –Storage is hard –Adapting to changes –Have learned caution Good people –Combined expertise covers a lot –Friendly group –Seventy something members of group, in 9 countries –Some more active than others (~20)