Presentation is loading. Please wait.

Presentation is loading. Please wait.

ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.

Similar presentations


Presentation on theme: "ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader."— Presentation transcript:

1 ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader scope u E.g., international collaboration u E.g., GriPhyN in the large (GriPhyN-2) u E.g., Terascale l Creating a national cyberinfrastructure u What is our appropriate role

2 ARGONNE  CHICAGO Ian Foster Discussion Points l Outreach to other disciplines u Biology, NEES, … l Virtual data toolkit u Inclusive or focused? u Resource issue, again l Achieving critical mass of resources to deliver on the complete promise

3 ARGONNE  CHICAGO Ian Foster Planning l Review of Year 1 milestones l Top 10 research challenges l Demonstration projects l Research projects + goals l Workshops

4 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: Virtual Data l Develop basic information model to represent data elements, relationships between different data types, characteristics of data elements l Develop protocols for storing, discovering, and retrieving these models l Design and develop tools for creating, accessing and manipulating these models by interactive tools, & planning and scheduling tools l Deploy centralized metadata and replica catalog services. Develop tools for managing catalogs

5 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: Request Planning Develop generic models for representing execution plans. Define API and tools for constructing, traversing, and manipulating plan data structures. Develop protocols and formats for storing and exchanging execution plans. Develop uniform policy representation for code, data, and resource access. Develop a set of global and local policy scenarios that reflect the requirements of the user communities of the four physics experiments. l Develop simple optimization heuristics. Initial thrust will be on data movement only and focus on the use of alternative, or branching plans to compensate for both resource failure and changes in resource performance. Implement planning heuristics in prototype planning module. Evaluate performance of alternatives with simulation and model based studies, as well as execution on GriPhyN testbed.

6 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: Request Execution l Develop and evaluate a task control language capable of capturing the requirements, preferences and dependencies of a PVDG request. Implement prototype of an interpreter to a basic subset of the language l Enhance the "Gang Matching" capabilities of the ClassAd language and add these enhancements to the run-time support library l Explore ways to enhance the ClassAd language to support events and triggers l Develop a protocol for information exchange between the execution and planning agents

7 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: Virtual Data Toolkit l VDT-1 (Basic Grid Services) provides an initial set of grid enabling services and tools, including security, information, metadata, CPU scheduling, and data transport. VDT-1 will support efficient operation on O(10 TB) datasets, O(100) CPUs, and O(100 MB/s) wide area networks and will build extensively on existing technology.

8 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: CMS & LIGO l CMS u Build basic services and 1-2 prototype Tier 2 centers u Complete High Level Trigger milestones and perform studies with ORCA, the CMS object- oriented reconstruction & analysis software l LIGO u Develop a cataloging approach for data access methods & data location (metadata definition, design) u Develop an access and use model for LIGO data across the GriPhyN system

9 ARGONNE  CHICAGO Ian Foster Year 1 Milestones: ATLAS and SDSS l SDSS u Build a prototype distributed analysis system l ATLAS u Connect the Athena analysis framework to a set of prototype virtual data services l Start with Globus replica catalog service l Athena EventSelector service to a replica catalog (reading) l Athena Replica catalog update service u Testing of basic file replication and transport using 500 GB testbeam data sets. u Develop Condor interface to the ATLAS testbed u Build basic services and 1-2 prototype Tier 2 centers

10 ARGONNE  CHICAGO Ian Foster Schedule FebDoc: Data grid reference architecture v1 Doc: Virtual data architecture v1 Doc: LIGO application summary and virtual data requirements v1 Doc: CMS application summary and virtual data requirements v1 MarDoc: CAS policy architecture v0 AprVDT: GSI, GRAM, GridFTP, replica catalog, Condor-G Doc: SDSS application summary and virtual data requirements v1 App: CMS data analysis v1 [tests GSI, GRAM, Condor-G] MayDocs: Architecture, virtual data, appln requirements v2 JuneDoc: Data grid failure models and fault management research plan Doc: GriPhyN simulation architecture and integrated simulation R&D plan Doc: Proto: CAS policy architecture prototype App: LIGO data analysis v1 [tests replica catalog]

11 ARGONNE  CHICAGO Ian Foster Schedule JulyProto: Virtual data catalog Proto: Request scheduler App: ATLAS data analysis AugTbed: Initial joint testbed with EDG SeptTbed: Joint testbed with EDG established with UC, ISI, CIT resources App: CMS data analysis over EDG-GriPhyN[-PPDG?] testbed

12 ARGONNE  CHICAGO Ian Foster Breakouts/Workshops? l Virtual data representations u Naming, etc. l Simulation strategies and tools u UC, CIT, UCB, others? l Architecture u What are the essential (and missing) pieces l Failure models

13 ARGONNE  CHICAGO Ian Foster Workloads l Three types: queries, objects, files l Koen Holtman’s modeling work l LIGO workloads (says Valerie)


Download ppt "ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader."

Similar presentations


Ads by Google