Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.

Slides:

Advertisements

Similar presentations

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.

Advertisements

CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or

PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.

Reports from Resource Breakout PRAGMA 16 KISTI, Korea.

Resources WG Report Back. Account Creation Complaint –Too difficult to obtain user account on all resources Observations –Just ask Cindy and she will.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.

Steering Committee Meeting Summary PRAGMA 18 4 March 2010.

Reports from Resource Breakout PRAGMA 15 USM, Malaysia.

PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.

Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.

Demonstrations at PRAGMA demos are nominated by WG chairs Did not call for demos. We will select the best demo(s) Criteria is under discussion. Notes.

Resource/data WG Summary Yoshio Tanaka Mason Katz.

1 Bio Applications Virtualization using Rocks Nadya Williams UCSD.

Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.

CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding or College of Computer.

A Proposal of Capacity and Performance Assured Storage in The PRAGMA Grid Testbed Yusuke Tanimura 1) Hidetaka Koie 1,2) Tomohiro Kudoh 1) Isao Kojima 1)

Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,

Updates of the APGrid PMA Catania March 3, 2009 Yoshio Tanaka APGridPMA Chair, AIST, Japan.

NAREGI CA BoF Summary. Production CA Service Leads Shinichi Mineo Okuno Takuto Three security levels Anonymous (none, good for testbed) Password License.

1 Applications Virtualization in VPC Nadya Williams UCSD.

CSF4, SGE and Gfarm Integration Zhaohui Ding Jilin University.

GENI Experiment Control Using Gush Jeannie Albrecht and Amin Vahdat Williams College and UC San Diego.

CNIC Grid CA/SDG CA Self Audit Kejun (Kevin) Dong Computer Network Information Center (CNIC) Chinese Academy of Sciences APGridPMA F2F.

PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.

An OpenFlow based virtual network environment for Pragma Cloud virtual clusters Kohei Ichikawa, Taiki Tada, Susumu Date, Shinji Shimojo (Osaka U.), Yoshio.

PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.

National Institute of Advanced Industrial Science and Technology Auditing, auditing template and experiences on being audited Yoshio Tanaka

© UC Regents 2010 Extending Rocks Clusters into Amazon EC2 Using Condor Philip Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer.

July 18, 2003SA, HRMS, FIN Unit Liaison Meeting1 Training Approach Project Initiative (TAPI) Update Frances Mueller Cathy Handyside July 18, 2003.

Cloud and Virtualization Panel Philip Papadopoulos UC San Diego.

PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.

Personal Cloud Controller (PCC) Yuan Luo 1, Shava Smallen 2, Beth Plale 1, Philip Papadopoulos 2 1 School of Informatics and Computing, Indiana University.

FIM-related activities and issues being discussed in Japan 1.GEO Grid Yoshio Tanaka (AIST) 2.HPCI, GakuNin Eisaku Sakane, Kento Aida (NII)

Cindy Zheng, Pragma Cloud, 3/20/2013 Building The PRAGMA International Cloud Cindy Zheng For Resources Working Group.

1.  PRAGMA Grid test-bed ： Shares clusters which managed by multiple sites Realizes a large-scale computational environment. › Expects as a platform.

OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.

PRAGMA 25 Working Group Report Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD)

Welcome to the San Bernardino County Coach Quarterly Meeting.

HPDC 2007 / Grid Infrastructure Monitoring System Based on Nagios Grid Infrastructure Monitoring System Based on Nagios E. Imamagic, D. Dobrenic SRCE HPDC.

APGrid PMA face-to-face meeting, 4/8/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly

PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.

National Institute of Advanced Industrial Science and Technology Brief status report of AIST GRID CA APGridPMA Singapore September 16 Yoshio.

High Performance File System Service for Cloud Computing Kenji Kobayashi, Osamu Tatebe University of Tsukuba, JAPAN.

Storage Tank in Data Grid Shin, SangYong(syshin, #6468) IBM Grid Computing August 23, 2003.

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

Reports on Resources Breakouts. Wed. 11am – noon - Openflow demo rehearsal - Show physical information. How easily deploy/configure OpenvSwitch to create.

All Hands Meeting 2005 BIRN Portal Architecture: Security Jana Nguyen

Server Performance, Scaling, Reliability and Configuration Norman White.

Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)

1 Development of a High-Throughput Computing Cluster at Florida Tech P. FORD, R. PENA, J. HELSBY, R. HOCH, M. HOHLMANN Physics and Space Sciences Dept,

Academia Sinica Grid Computing Certification Authority (ASGCCA) Jinny Chien.

EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,

SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.

1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.

APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly

The NGS Support Centre Katie Weeks. NGS Support Centre SLD Many areas to NGS Support Centre –SLD defines supported areas including: Certification Authority.

WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.

PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.

The Roadmap of NAREGI Security Services Masataka Kanamori NAREGI WP

PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.

7-May-03D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Issues and Planning or Report from the Security Group CERN, 8 May 2003 David Kelsey CCLRC/RAL, UK.

CSF4 Meta-Scheduler Zhaohui Ding College of Computer Science & Technology Jilin University.

Campus Server & Identity Management Altiris Tickets Month -- March 2012 # closed tickets # resolved tickets Campus Web Services8936 Identity & Access Management.

© 2007 UC Regents1 Rocks – Present and Future The State of Things Open Source Grids and Clusters Conference Philip Papadopoulos, Greg Bruno Mason Katz,

Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.

 Session Objectives:  Understand how to upgrade your private cloud: Windows Server 2008 R2  Windows Server 2012 R2 Windows Server 2012  Windows.

Presentation transcript:

Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka

Homework from P17

Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof of concept almost done). – Next steps – CRAYON will be replaced by VM-based Rocks by PRAGMA18. (by next Jan) – Mason – Upgrade Gfarm to – Increase storage in SDSC. – Cindy – NCHC creates a VM for WebOS and run on VC at UCSD (by Feb.) – Weicheng, Phil and Mason will visit Taichung in February. – Create VM for applications. Start with AvianFlu. Not a cluster but a single node system which automatically joins AvianFlu Grid. Issues: Automatic generation of host cert., etc. Document the processes Wilfred

GEO+Resource breakout Requirements for Tsukuba-GAMA – MyProxy CA, MyProxy Repository, Web server – Gridsphere – Can be installed on a single server – Installation on CentOS 5 must be easy. AIST will complete development and distribute (by SC09) San Diego will host Tsukuba-GAMA Cindy will be the CA (Tsukuba-GAMA) operator Run this on VM Procedure – Yoshio and Ryosuke will summarize procedure for issuing certificates. Draft CP/CPS (By Dec.) Timeline – Everything by PRAGMA 18

P18 Agenda Day 1 – VM-based Infrastructure – Gfarm Day 2 – Tsukuba-GAMA – Migration from traditional Grid to VM-based infrastructure

VC: Status and next steps Applications implemented by VC – Tsukuba GAMA – Gfarm – Nimrod + Condor + EC2 Next steps for Grarm – Gfarm roll release (clsuter fs only for now) Users guide By Mason (by end of March) – Enhance Gfarm roll for Grid Shared secret key copied from gfarm, _gfarmfs user FS nodes require public internet access Single Meta Data server By mason (by end of March) – Gfarm on UCSD Server Solaris server (ordered today) – gfsd can here – Or export iSCSI, NFS – Ability to replicate/snapshot data Gfmd on linux frontend (16GB mem) End of March – Get Gfarm (as grid) running on two UCSD By Mason in 2 months Grow to AIST next

VC: Status and next steps Next steps for Nimrod – Finish EC2 Condor connection on UCSD Nimrod VC – Done yesterday Nimrod / Condor connection – Done yesterday Release Nimrod Roll – Still being developed – Blair, Phil, Mason by PRAGMA 19

Migration from traditional Grid to VM-based Infrastructure How to be a VM-enabled site? – Cluster running Xen. Rocks 5.3 PIAX+OpenVPN+Xen (Osaka) – Add VM-enabled sites Osaka Zurich as soon as migrate to 5.3 Cindy will send s to PRAGMA ML Phil/Mason will write necessary information – VM replicate and move test between (1) UCSD-UCSD, (2) AIST-UCSD Both are using Rocks 5.3 Avian Flu and Nimrod are sample applications In next few weeks – Discuss with Date-sensei if Osaka system is appropriate for PRAGMA-wide VC Test on PRAGMA by PRAGMA19

Tsukuba-GAMA Vlad will ask Sam how to make automatic registration via VOMRS. Cc to Cindy. Implement VOMRS interface in Tsukuba- GAMA (Yamamoto) – Schedule depends on the VOMRS interface Observe what happens in GEO WG. CRL – Sync between front-end and compute node – Cindy

PRAGMA Implementation Day Good experiment – Hadoop/Gfarm demo – Gfarm Roll – to be released – Nimrod/Condor/EC2 demo – Nimrod Roll – to be released Would like to repeat – Focus on local work – This time was Rocks since we are at UCSD – Next time CSF4, Gfarm, AFG?