Presentation on theme: "Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction."— Presentation transcript:
Resource WG Breakout
Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction of current status of data grid testbed (Cindy) –Identify some Gfarm applications –Set milestones Report from routine-basis drivers to get feedback –1 st day: Call for presenters from routine-basis drivers –2 nd day: presentation Dedicate use of PRAGMA Grid testbed for specific purposes (1 st day) –Motivation to dedicated use (Yoshio) –Ask comments from resource providers Mid- to long-term direction of PRAGMA Grid –More applications? –Integrate with data grid testbed? –Meta scheduler? Co-allocator? Main focuses and works between PRAGMA11-12 –Should be based on the discussion on the previous agenda
WG Agenda Monday –Moving towards data grid Resource & Data WG are now one WG Gfarm intro / discussion Status of AIST/UCSD Gfarm production Grid FS Applications and milestones –Dedicated use of PRAGMA for specific purposes –Mid to Long Term Planning Data applications Scheduling ??? Tuesday –Presentations from Application Drivers –Plan for work from now to next meeting Other issues?
Status of GFram deployment Latest version: AIST, SDSC: New version done ASGCC, KISTI, NCSA, TITECH, UZurich –Need to be upgraded NECTEC, BII, NCHC, Tsukuba, Osaka, APAC, NGO, ThaiGrid, CNIC, MIMOS –Have interests
To Do Identify applications –GriddLeS (MU), –iGap –Savanna Milestones? –All sites upgrade or deploy Gfarm at least by Jan. ~ Feb. including monitoring by SCMSWeb. –Contact to MU soon.
National Institute of Advanced Industrial Science and Technology Dedication of PRAGMA Grid for specific purposes Yoshio Tanaka
Motivation PRAGMA Grid is used routinely as a shared infrastructure. No reservation, dedication is supported. Users cannot estimate when his job will be running. Users cannot expect co-allocation. PRAGMA Grid is expected to be dedicated for specific purposes. Experiments Demonstration
Agenda Should PRAGMA Grid allow dedicated use? Do resource providers agree to allow dedication? How is the procedure for the dedication? Application by the driver. Should the application reviewed and approved? Who will review and approve? Policies? Maximum time/sites/processors for the dedication?Implementation How the reservation is implemented. Start with manually, then consider to use software for advance reservation. Just asking the other drivers not to use resources enough? I think NO. Re-configuration of queues or clean up the jobs may increase the load of site admins. Any suggestion?
Do we allow dedicated use? Yes or NO
Procedure: Application Application form (proposal) Name(s) / Affiliation(s) Resources (Sites) Duration the start time / end time (time zone must be indicated) Proposal Purpose Expected outcomeExample Yoshio Tanaka / AIST AIST, SDSC, USM, KISTI, NECTEC, NCHC Nov. 6 18:00 - Nov. 9 18:00 (JST) Proposal (should be more detailed) Purpose: QM/MD experiments on PRAGMA/TeraGrid Expected outcome: Scientific results and contribution to GIN
Procedure: approval Is approval necessary? By whom? By each resource owner What is the criteria? According to the site s policy
Todo How to prioritize multiple requests.
Implementation In case of AIST (SGE) Temporary remove all accounts except the driver. All existing jobs will be killed. In case of PSC (Torque) Give us the dedicated queue. In case of NCSA (Torque) No dedicate queue ??? Other choices? Gentleman s agreement? Easy, but should have troubles …
Implementation Site admin should decide how to provide dedication. PRAGMA admin will announce the other application drivers the schedule of the dedication. PRAGMA admin will remind the other application drivers the dedication is approaching.