Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.

Slides:

Advertisements

Similar presentations

PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.

Advertisements

National Institute of Advanced Industrial Science and Technology Asia Pacific Grid PMA Yoshio Tanaka APGrid PMA, Chair Grid Technology Research Center,

National Institute of Advanced Industrial Science and Technology Experiences through Grid Challenge Event Yoshio Tanaka.

Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.

PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.

Reports from Resource Breakout PRAGMA 16 KISTI, Korea.

Resources WG Update PRAGMA 10. Interoperability PRAGMA TG (ANL) Moving onto EGEE GGF GIN group Trust Enabled by APGrid PMA.

Resources WG Report Back. Account Creation Complaint –Too difficult to obtain user account on all resources Observations –Just ask Cindy and she will.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG Update PRAGMA 8 Singapore. Routine Use - Users make a system work.

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.

Steering Committee Meeting Summary PRAGMA 18 4 March 2010.

Reports from Resource Breakout PRAGMA 15 USM, Malaysia.

The Future of PRAGMA Challenges for the Working Groups, PRAGMA Members, and the PRAGMA Community Active Participation.

PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

National Institute of Advanced Industrial Science and Technology Status report on the large-scale long-run simulation on the grid - Hybrid QM/MD simulation.

Thanks to All of the Sponsors: –APAC, QPSF, AARNET, Grangenet, SGI, Nexium, ReefHQ, Sun Local Coordinators: Ian Atkinson and his many helpers Kathryn Ottaway.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Slides Please send to Arun

Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.

Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.

Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.

National Institute of Advanced Industrial Science and Technology Meta-scheduler based on advanced reservation Grid Technology Research Center, AIST Atsuko.

Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.

Demonstrations at PRAGMA demos are nominated by WG chairs Did not call for demos. We will select the best demo(s) Criteria is under discussion. Notes.

Resource/data WG Summary Yoshio Tanaka Mason Katz.

2 nd APGrid PMA F2F Meeting Osaka University Convention Center October 15 09: :20 # Participants: 26.

Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly

Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.

Resource WG Report. Projects Applications EOL Ninf-G Climate model GridBlast GOC Gangla / SCMSWeb => Uniform Database Goodness Status map (e.g. IVDGL)

National Institute of Advanced Industrial Science and Technology Advance Reservation-based Grid Co-allocation System Atsuko Takefusa, Hidemoto Nakada,

A Proposal of Capacity and Performance Assured Storage in The PRAGMA Grid Testbed Yusuke Tanimura 1) Hidetaka Koie 1,2) Tomohiro Kudoh 1) Isao Kojima 1)

Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,

CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.

Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.

ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,

Updates of the APGrid PMA Catania March 3, 2009 Yoshio Tanaka APGridPMA Chair, AIST, Japan.

International Grid Trust Federation Session GGF 20 Manchester, UK Wednesday, May CAOPS-WG session #2.

Quality Assurance (QA) Working Group Update February 11, 2010 Kate Ericson (SDSC) Shava Smallen (SDSC)

User Introduction to the TeraGrid 2007 SDSC NCAR TACC UC/ANL NCSA ORNL PU IU PSC.

PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.

An OpenFlow based virtual network environment for Pragma Cloud virtual clusters Kohei Ichikawa, Taiki Tada, Susumu Date, Shinji Shimojo (Osaka U.), Yoshio.

PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.

National Institute of Advanced Industrial Science and Technology Auditing, auditing template and experiences on being audited Yoshio Tanaka

LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.

PRAGMA21 – PRAGMA 22 Collaborative Activities Resources Working Group.

PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.

PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)

PRAGMA 25 Working Group Report Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD)

Status of PRAGMA Activities at KISTI Jongbae Moon 1.

Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.

National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka

National Institute of Advanced Industrial Science and Technology Updates of the APGrid PMA Yoshio Tanaka Grid Technology Research.

PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.

Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)

National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,

Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.

SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.

International Grid Trust Federation Session GGF 20 Manchester, UK Wednesday, May CAOPS-WG session #2.

Kento Aida, Tokyo Institute of Technology Grid Working Group Aug. 29 th, 2003 Tokyo Institute of Technology Kento Aida.

Opening Remarks and Updates of the APGrid PMA 5 th APGridPMA September 16, 2008 Yoshio Tanaka APGridPMA Chair, AIST, Japan.

APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly

Kento Aida, Tokyo Institute of Technology Joint Meeting Grid activities committee and Grid working group Jan. 28 th, 2004 Honolulu.

PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.

Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,

International Grid Trust Federation Session GGF 19 Chapel Hill, NC, USA Thursday, Feb CAOPS-WG session #1.

Updates of the APGrid PMA

Report on SLA progress Ioannis Liabotis <ilaboti at grnet.gr>

Software Measurement Process ISO/IEC

Presentation transcript:

Resource WG Breakout

Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction of current status of data grid testbed (Cindy) –Identify some Gfarm applications –Set milestones Report from routine-basis drivers to get feedback –1 st day: Call for presenters from routine-basis drivers –2 nd day: presentation Dedicate use of PRAGMA Grid testbed for specific purposes (1 st day) –Motivation to dedicated use (Yoshio) –Ask comments from resource providers Mid- to long-term direction of PRAGMA Grid –More applications? –Integrate with data grid testbed? –Meta scheduler? Co-allocator? Main focuses and works between PRAGMA11-12 –Should be based on the discussion on the previous agenda

WG Agenda Monday –Moving towards data grid Resource & Data WG are now one WG Gfarm intro / discussion Status of AIST/UCSD Gfarm production Grid FS Applications and milestones –Dedicated use of PRAGMA for specific purposes –Mid to Long Term Planning Data applications Scheduling ??? Tuesday –Presentations from Application Drivers –Plan for work from now to next meeting Other issues?

Status of GFram deployment Latest version: AIST, SDSC: New version done ASGCC, KISTI, NCSA, TITECH, UZurich –Need to be upgraded NECTEC, BII, NCHC, Tsukuba, Osaka, APAC, NGO, ThaiGrid, CNIC, MIMOS –Have interests

To Do Identify applications –GriddLeS (MU), –iGap –Savanna Milestones? –All sites upgrade or deploy Gfarm at least by Jan. ~ Feb. including monitoring by SCMSWeb. –Contact to MU soon.

National Institute of Advanced Industrial Science and Technology Dedication of PRAGMA Grid for specific purposes Yoshio Tanaka

Motivation PRAGMA Grid is used routinely as a shared infrastructure. No reservation, dedication is supported. Users cannot estimate when his job will be running. Users cannot expect co-allocation. PRAGMA Grid is expected to be dedicated for specific purposes. Experiments Demonstration

Agenda Should PRAGMA Grid allow dedicated use? Do resource providers agree to allow dedication? How is the procedure for the dedication? Application by the driver. Should the application reviewed and approved? Who will review and approve? Policies? Maximum time/sites/processors for the dedication?Implementation How the reservation is implemented. Start with manually, then consider to use software for advance reservation. Just asking the other drivers not to use resources enough? I think NO. Re-configuration of queues or clean up the jobs may increase the load of site admins. Any suggestion?

Do we allow dedicated use? Yes or NO

Procedure: Application Application form (proposal) Name(s) / Affiliation(s) Resources (Sites) Duration the start time / end time (time zone must be indicated) Proposal Purpose Expected outcomeExample Yoshio Tanaka / AIST AIST, SDSC, USM, KISTI, NECTEC, NCHC Nov. 6 18:00 - Nov. 9 18:00 (JST) Proposal (should be more detailed) Purpose: QM/MD experiments on PRAGMA/TeraGrid Expected outcome: Scientific results and contribution to GIN

Procedure: approval Is approval necessary? By whom? By each resource owner What is the criteria? According to the site s policy

Todo How to prioritize multiple requests.

Implementation In case of AIST (SGE) Temporary remove all accounts except the driver. All existing jobs will be killed. In case of PSC (Torque) Give us the dedicated queue. In case of NCSA (Torque) No dedicate queue ??? Other choices? Gentleman s agreement? Easy, but should have troubles …

Implementation Site admin should decide how to provide dedication. PRAGMA admin will announce the other application drivers the schedule of the dedication. PRAGMA admin will remind the other application drivers the dedication is approaching.