Presentation on theme: "Panel B1 Summary The Present Looms Large D. Petravick A Cluster is an Excellent Error Amplifier. C. Boeheim."— Presentation transcript:
Panel B1 Summary The Present Looms Large D. Petravick A Cluster is an Excellent Error Amplifier. C. Boeheim
Ensembl Large funded Genome community project for data movement. Concern in selecting tools that can be readily distributed (free) to collaborators. Datasets are multiGB files. Tried to use multicast methods for data distribution, but having reliability problems at any interesting rates.
Condor Distributed Data Themes are to hide errors from the end users (retry) where possible, but make sure the system propagates errors properly. Survey of 3 elements –DAGman – persistent make –Kangaroo – ensemble buffer –?
NIKHEF 1 Collaborator working on simulation will generate 10**7 events annually (20 TB). FNAL currently weak link in network chain (will this recur with global processing) Network much preferable to dealing with tape transfers. Should one store intermediate results or just recalculate ?
Genomics in Minnesota –Planning horizon muched compressed over HEP. Goal for 2008 (genome) in hand today. –Review of search types that differ. –Doing analysis using opportunistic scheduling on desktops using Condor
Question List: What protocols/software to use to access the data ? How to deal with free storage ? Should we presume there will always be need for local storage ? Is there interest in alternates to FC SANs (iSCSI, etc.)