NUG 2004 Grid File Yanker Demo Shreyas Cholia Mass Storage Group, NERSC 06/24/2004.

Slides:

Advertisements

Similar presentations

GridWorld 2006 Use of MyProxy for the FusionGrid Mary Thompson Monte Goode GridWorld 2006.

Advertisements

MyProxy: A Multi-Purpose Grid Authentication Service

Academic Technology Services The UCLA Grid Portal - Campus Grids and the UC Grid Joan Slottow and Prakashan Korambath Research Computing Technologies UCLA.

Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.

Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.

1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.

Multiple Tiers in Action

Grid Services at NERSC Shreyas Cholia Open Software and Programming Group, NERSC NERSC User Group Meeting September 17, 2007.

Single Sign-On for Java Web Start Applications Using MyProxy Terry Fleury, Jim Basney, and Von Welch November 3, 2006.

1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.

Globus Computing Infrustructure Software Globus Toolkit 11-2.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.

National Computational Science National Center for Supercomputing Applications National Computational Science MyProxy: An Online Credential Repository.

Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.

A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.

Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.

Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.

1. Introduction  The JavaScript Grid Portal is trying to find a way to access Grid through Web browser, while using Web 2.0 technologies  The portal.

TeraGrid Science Gateways: Scaling TeraGrid Access Aaron Shelmire¹, Jim Basney², Jim Marsteller¹, Von Welch²,

Service Architecture of Grid Faults Diagnosis Expert System Based on Web Service Wang Mingzan, Zhang ziye Northeastern University, Shenyang, China.

Web Mashups -Nirav Shah.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.

Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.

ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.

Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.

1 Overview of the Application Hosting Environment Stefan Zasada University College London.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.

Grid NERSC demo Shreyas Cholia Open Software and Programming NERSC User Group Meeting September 19, 2007.

Communicating Security Assertions over the GridFTP Control Channel Rajkumar Kettimuthu 1,2, Liu Wantao 3,4, Frank Siebenlist 1,2 and Ian Foster 1,2,3 1.

Tutorial: Building Science Gateways TeraGrid 08 Tom Scavo, Jim Basney, Terry Fleury, Von Welch National Center for Supercomputing.

Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.

1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.

Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

The MyProxy Online Credential Repository Jim Basney NCSA

Grid, Web services and Taverna Machiel Jansen Richard Holland.

Introduction to The Storage Resource.

Shell Interface Shell Interface Functions Data. Graphical Interface Graphical Interface Command-line Interface Command-line Interface Experiments Private.

Objective What is RFT ? How does it work Architecture of RFT RFT and OGSA Issues Demo Questions.

1 st Generation of Grid portals. 1st Generation Portals The first generation of Grid portals mainly used a three-tier architecture:

© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.

VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.

ALCF Argonne Leadership Computing Facility GridFTP Roadmap Bill Allcock (on behalf of the GridFTP team) Argonne National Laboratory.

National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,

File Transfer And Access (FTP, TFTP, NFS). Remote File Access, Transfer and Storage Networks For different goals variety of approaches to remote file.

File Transfer Protocol (FTP) CIS 130. File Transfer Protocol (FTP) Copy files from one internet host (server) to your account on another host –Need domain.

1 Egrid portal Stefano Cozzini and Angelo Leto. 2 Egrid portal Based on P-GRADE Portal 2.3 –LCG-2 middleware support: broker, CEs, SEs, BDII –MyProxy.

Introduction to Portals.

CPSC 372 John D. McGregor Module 6 Session 4 Sonar.

The Institute of High Energy of Physics, Chinese Academy of Sciences Sharing LCG files across different platforms Cheng Yaodong, Wang Lu, Liu Aigui, Chen.

Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.

Web and Proxy Server.

ArcGIS for Server Security: Advanced

Open OnDemand: Open Source General Purpose HPC Portal

Web Mashups -Nirav Shah.

Data Bridge Solving diverse data access in scientific applications

1st Generation of Grid portals

CRC exercises Not happy with the way the document for testbed architecture is progressing More a collection of contributions from the mware groups rather.

Viet Tran Institute of Informatics Slovakia

Bomgar Remote support software

OGCE OGCE The Open Grid Computing Environments Collaboratory

A Web-Based Data Grid Chip Watson, Ian Bird, Jie Chen,

Grid Computing Software Interface

Condor-G: An Update.

Presentation transcript:

NUG 2004 Grid File Yanker Demo Shreyas Cholia Mass Storage Group, NERSC 06/24/2004

Grid File Yanker Allows users to browse and transfer files, across filesystems served by GridFTP servers, directly from their web browser. Includes a reliable file transfer mechanism, that attempts to restart failed transfer jobs. Provides a convenient interface for submitting and monitoring background file transfer jobs.

GFY Components GFY Server: Java Servlet that runs as a SOAP Service. Users can invoke this via –The GFY Client Applet –Command line tools –Their own SOAP clients that can call the GFY Server API

GFY Components (cont.) GFY Client: This is a Java applet that can run on any web browser that supports Java (or higher). –The applet provides a convenient GUI filesystem interface to access GridFTP servers and transfer files between them. –Users do not have to carry Grid credentials on their client machines. The Applet supplies a username / password combination to the GFY Server which uses this to grab Grid credentials from a MyProxy server.

GFY Screen Shot

How it Works … GFY Client provides username/password combination to GFY Server GFY Server uses combination to acquire a Grid Proxy Credential from a MyProxy Server, and returns a session identifier to the Client. GFY Client makes SOAP request to GFY Server to perform Filesystem operation / File Transfer using the session identifier.

How it Works … (cont.) GFY Server talks to desired GridFTP server(s) with the acquired credential and either –performs the filesystem operation, or –spawns off a background transfer thread to manage the reliable third party transfer between two GridFTP servers. Client can query the server for the state of current transfer jobs

How it works …

Upcoming Features Recursive directory copy Multiple File Transfer / Bulk File operations Integration with NERSC Portal, including common login and credential sharing Command line tools to submit transfer jobs to GFY service

Acknowledgements The GFY was made possible, thanks to the contributions of: –Matt Andrews (NERSC) –Nancy Johnston (NERSC) –Nancy Meyer (NERSC) –Steve Chan (NERSC) –Adam Megacz (XWT Foundation)

Additional Information FSG Homepage: GFY Information: Contact: –Shreyas Cholia (Mass Storage Group) Phone: (510)