2005-5-18IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)

Slides:

Advertisements

Similar presentations

Copyright (c) 2002 Japan Network Information Center Introduction of JPNICs New Registry System Izumi Okutani IP Address Section Japan Network Information.

Advertisements

CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or

GT4 Architectural Security Review December 17th, 2004.

On the Use of Service Level Agreements in AssessGrid.

Open Grid Computing Environments Marlon Pierce (IU) & Gopi Kandaswamy (RENCI)

© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.

Grid Tech Team Certificates, Monitoring, & Firewall September 15, 2003 Chiang Mai, Thailand Allan Doyle, NASA With the help of the entire Grid Tech Team.

17 Copyright © 2005, Oracle. All rights reserved. Deploying Applications by Using Java Web Start.

Globus Workshop at CoreGrid Summer School 2006 Dipl.-Inf. Hamza Mehammed Leibniz Computing Centre.

GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.

A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.

Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.

1 GRID applications control based on synchronizers, D. Kopanski *, J. Borkowski *, M. Tudruj The Cracow Grid Workshop 2004 D. Kopanski *, J. Borkowski.

Cross-site data transfer on TeraGrid using GridFTP TeraGrid06 Institute User Introduction to TeraGrid June 12 th by Krishna Muriki

Copyright © 2011 by the Commonwealth of Pennsylvania. All Rights Reserved. Load Test Report.

© 2005 AT&T, All Rights Reserved. 11 July 2005 AT&T Enhanced VPN Services Performance Reporting and Web Tools Presenter : Sam Levine x111.

A3.1 Assignment 3 Simple Job Submission Using GT 4 GRAM.

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.

NorduGrid Grid Manager developed at NorduGrid project.

CERN LCG Overview & Scaling challenges David Smith For LCG Deployment Group CERN HEPiX 2003, Vancouver.

USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:

Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI

Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.

1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.

Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.

Multiple Tiers in Action

Grid Computing, B. Wilkinson, 20046c.1 Globus III - Information Services.

Cross Cluster Migration Remote access support Adianto Wibisono supervised by : Dr. Dick van Albada Kamil Iskra, M. Sc.

Globus Computing Infrustructure Software Globus Toolkit 11-2.

The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.

VueCentric Architecture

Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.

The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.

Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.

High Performance Louisiana State University - LONI HPC Enablement Workshop – LaTech University,

Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.

1. Introduction  The JavaScript Grid Portal is trying to find a way to access Grid through Web browser, while using Web 2.0 technologies  The portal.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.

Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.

Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.

23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29

Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.

Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.

JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

NUG 2004 Grid File Yanker Demo Shreyas Cholia Mass Storage Group, NERSC 06/24/2004.

Communicating Security Assertions over the GridFTP Control Channel Rajkumar Kettimuthu 1,2, Liu Wantao 3,4, Frank Siebenlist 1,2 and Ian Foster 1,2,3 1.

CHEP03 Mar 25Mary Thompson Fine-grained Authorization for Job and Resource Management using Akenti and Globus Mary Thompson LBL,Kate Keahey ANL, Sam Lang.

Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.

© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.

Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.

Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.

SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.

Creating and running an application.

Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.

Cloud-access Author: Riccardo Bruno. cloud-access flow web portal A user accesses through any device to a portal requesting access to an interactive application.

Introduction to Grid Computing and its components.

JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.

Nguyen Tuan Anh Page 1 Grid Computing – Master Course 2007 Grid Computing Dr. Nguyen Tuan Anh Contacts: Tel: (84-8)

1 AHM, 2–4 Sept 2003 e-Science Centre GRID Authorization Framework for CCLRC Data Portal Ananta Manandhar.

Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,

The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.

Dynamic Grid Computing: The Cactus Worm The Egrid Collaboration Represented by: Ed Seidel Albert Einstein Institute

Rocky Mountain User Group Meeting Lawson Security Presented by Craig Needham Technology Services Manager Lawson Software December 5, 2002.

10 March Andrey Grid Tools Working Prototype of Distributed Computing Infrastructure for Physics Analysis SUNY.

Securing Grid Services – OGF19 > Thijs Metsch > securing_grid_services_ogf19.ppt > Slide 1 Application Level Gateway Securing services using.

May 14 (Wed) Masatoshi Ohishi (Japan)

Grid Computing Software Interface

Presentation transcript:

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 2 Development of JVO prototypes Prototype 1 –Globus toolkit ver. 2 Prototype 2 –Globus toolkit ver. 3 Prototype 3 –Web Service

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 3 JVO Prototype 1 Registry Server Metadata Data Servers DB … Web access Portal Server Controller User Interface Data Servers DB Globus Toolkit 2 User UDDI

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 4 Use of Globus toolkit 2 Remote Execution –GRAM (Globus Resource Allocation Manager) globus-job-run command File Transfer –GridFTP

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 5 Problem in using Globus toolkit 2 Very slow –One query took > 10 min Why?: in GRAM: –Polling interval is hard-coded as 30 sec! –Reduced by modifying source codes. --- globus_gram_job_manager_script.c.bak Wed Feb 5 07:41: globus_gram_job_manager_script.c Mon Apr 21 14:23: ,7 +374,7 globus_gram_job_manager_request_log(request, "JMI: in globus_gram_job_manager_submit()\n" ); - request->poll_frequency = 30; + request->poll_frequency = 3; /* * create a file that will be used to pass all parameters to and

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 6 JVO Prototype 2 Registry Server Metadata Data Servers DB … Web access Portal Server Controller User Interface Data Servers DB Globus Toolkit 3 User

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 7 Use of Globus toolkit 3 Remote Execution –Grid Service Polling latency was eliminated. Performance was improved. File Transfer –RFT (Reliable File Transfer) Recoverable GridFTP

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 8 User Management Portal login ID Globus global ID OS local account User grid-mapfile Own user management Multiple User Management; Utilize one or both? Single Grid account

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 9 Still use Globus toolkit? Prototype 1&2 did not always make good use of Globus toolkit security features. Moreover, Globus toolkit was unstable. –Troubles in development Prototype 3 is based on Web Service.

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 10 JVO Prototype 3 Registry Server Metadata Data Servers DB … Web access Portal Server Controller User Interface Data Servers DB User Web Service User management using LDAP

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 11 Summary Globus security features did not always fit to JVO use. So the latest version of JVO employs Web Service.