University of Illinois at Chicago Who, Where, What, Why, How, and a little When Tom DeFanti October 7, 1999 ESnet/MREN Regional Grid Experimental NGI Testbed.

Slides:



Advertisements
Similar presentations
Electronic Visualization Laboratory University of Illinois at Chicago EVL Optical Networking Research Oliver Yu Electronic Visualization Laboratory University.
Advertisements

Linda Winkler IWS2000/APAN Technology Session Feb 17, 2000 STARTAP QBONE Activities.
University of Illinois at Chicago Current STAR TAP Technical Engineering Activities Full-mesh PVC provisioning IPv4 routing Network statistics.
University of Illinois at Chicago The Future of STAR TAP: Enabling e-Science Research Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic.
University of Illinois at Chicago Annual Update Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic Visualization Laboratory.
C3.ca in Atlantic Canada Virendra Bhavsar Director, Advanced Computational Research Laboratory (ACRL) Faculty of Computer Science University of New Brunswick.
High Performance Computing Course Notes Grid Computing.
Kathy Benninger, Pittsburgh Supercomputing Center Workshop on the Development of a Next-Generation Cyberinfrastructure 1-Oct-2014 NSF Collaborative Research:
1 © 2006 Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID Using the Cisco Technical Support & Documentation Website for Voice Issues.
A Computation Management Agent for Multi-Institutional Grids
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Computational Grids and the Globus Project Ian Foster Argonne National Laboratory The University of Chicago Globus Co-PI: Carl Kesselman, USC/ISI.
Authenticated QoS Project Overview Andy Adamson Research Investigator Center for Information Technology Integration University of Michigan Ann Arbor.
A Service Platform for On-Line Games DebanJan Saha, Dambit Sahu, Anees Shaikh (IBM TJ Watson Research Center, NY) Presented by Gary Huang March 17, 2004.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
14 July 2000TWIST George Brett NLANR Distributed Applications Support Team (NCSA/UIUC)
Simo Niskala Teemu Pasanen
Introduction to Grid Computing Ann Chervenak Carl Kesselman And the members of the Globus Team.
The Globus Toolkit: Description and Applications Review Steve Tuecke & Ian Foster Argonne National Laboratory The University of Chicago Globus Co-PI: Carl.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University.
TeraPaths: A QoS Collaborative Data Sharing Infrastructure for Petascale Computing Research Bruce Gibbard & Dantong Yu High-Performance Network Research.
CS780-3 Lecture Notes In Courtesy of Mengjun Xie.
A Differentiated Services Implementation for High- Performance TCP Flows Volker Sander, Ian Foster, Alain Roy and Linda Winkler Forschungszentrum Jülich.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
Slide 1 Experiences with NMI R2 Grids Software at Michigan Shawn McKee April 8, 2003 Internet2 Spring Meeting.
1 Report from NGI Testbed meeting at Berkeley, Jul 21-22, 1999 Les Cottrell – SLAC,
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
Software-defined Networking Capabilities, Needs in GENI for VMLab ( Prasad Calyam; Sudharsan Rajagopalan;
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
An Integrated Instrumentation Architecture for NGI Applications Ian Foster, Darcy Quesnel, Steven Tuecke Argonne National Laboratory The University of.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
PPDG and ATLAS Particle Physics Data Grid Ed May - ANL ATLAS Software Week LBNL May 12, 2000.
National Computational Science Alliance Tele-Immersion - The Killer Application for High Performance Networks Panel Talk at a Vanguard Meeting in San Francisco,
Electronic Visualization Laboratory University of Illinois at Chicago EMERGE Deep Tech Mtg Oliver Yu, Jason Leigh, Alan Verlo.
The Globus Project: A Status Report Ian Foster Carl Kesselman
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
EMERGE Tech Agenda Oct 7, :30-11Vision (Applications focus) (TD) 11-12:30Describe GARA + Test Results (VS) 12:30-1:30Lunch 1:30-2:15GARNET demo.
Perspectives on Grid Technology Ian Foster Argonne National Laboratory The University of Chicago.
KISTI Supercomputing Center 16 th APAN Meetings (August 27, 2003) Collaborative VR Grid in Meteorology Minsu Joh Head of Supercomputing.
John D. McCoy Principal Investigator Tom McKenna Project Manager UltraScienceNet Research Testbed Enabling Computational Genomics Project Overview.
The Internet2 HENP Working Group Internet2 Spring Meeting April 9, 2003.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Practical Distributed Authorization for GARA Andy Adamson and Olga Kornievskaia Center for Information Technology Integration University of Michigan, USA.
Internet 2 Applications Update Ted Hanss 8 October 1997 Washington D.C. Ted Hanss 8 October 1997 Washington D.C.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
QBone: Building a Testbed for IP Differentiated Services (Update) UCAID Member Meeting 28 April 1999 Washington D.C. Phil Emer.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
University of Illinois at Chicago StarLight: Applications-Oriented Optical Wavelength Switching for the Global Grid at STAR TAP Tom DeFanti, Maxine Brown.
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
TeraPaths: A QoS Enabled Collaborative Data Sharing Infrastructure for Petascale Computing Research The TeraPaths Project Team Usatlas Tier 2 workshop.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
NSF Middleware Initiative Purpose To design, develop, deploy and support a set of reusable, expandable set of middleware functions and services that benefit.
MGRID Architecture Andy Adamson Center for Information Technology Integration University of Michigan, USA.
A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation Presented by Alain Roy, University of Chicago With.
Company LOGO Network Architecture By Dr. Shadi Masadeh 1.
1 Teacher Resource Network A K-20 Initiative Project Concept Greg Marks
Distributed Network Monitoring in the Wisconsin Advanced Internet Lab Paul Barford Computer Science Department University of Wisconsin – Madison Spring,
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
Security for Open Science
GENI Exploring Networks of the Future
Network Architecture By Dr. Shadi Masadeh 1.
SCCM in hybrid world Predrag Jelesijević Microsoft 7/6/ :17 AM
Presentation transcript:

University of Illinois at Chicago Who, Where, What, Why, How, and a little When Tom DeFanti October 7, 1999 ESnet/MREN Regional Grid Experimental NGI Testbed

University of Illinois at Chicago The Two Basic Goals of EMERGE Year 1 Achieve high network performance for some set of interesting applications (i.e., stress the network) –the instrumentation requirement is end-to-end network optimization Achieve guaranteed network performance for a set of interesting applications (i.e., QoS work) –the instrumentation requirement is verifying whether QoS is delivered

University of Illinois at Chicago EMERGE Methodology 1. Identify initial application demonstration targets for these two classes of tests, and the machines that they will run on 2. Obtain detailed descriptions of these end-to-end paths, i.e. network maps 3. Characterize the paths via use of technology like pchar, ttcp, etc., with a view to fixing any immediate problems 4. Get in place low-level infrastructure for continuing to monitor these paths, e.g., NWS, as part of the Grid Services Package deployment 5. Create instrumented versions of the key applications, using Autopilot, NetLogger, whatever – then run them on the characterized paths

University of Illinois at Chicago Measurement Tech/Apps Matrix

University of Illinois at Chicago Northwestern University Status September 23, 1999  Northwestern University International Center for Advanced Internet Research (iCAIR) –iCAIR collaborates with UCAID/Abilene and MREN on QBone and related DiffServ issues Cisco 7507 delivered and installed Interactive Media+ (IM+) performance measurement plan designed Server implemented 100baseT as well as ATM capability Ready to commence tests with ANL

University of Illinois at Chicago UIUC/NCSA Status September 23, 1999  The University of Illinois at Urbana-Champaign to connect to the Center for Simulation of Advanced Rockets (CSAR) –CSAR is an ASCI Center 100Mb service to Michael Heath, CSAR Cisco 7507 on order Focus on: –Grid Services Package –NetLogger

University of Illinois at Chicago University of Wisconsin/Madison Status September 23, 1999 University of Wisconsin-Madison, Engine Research Center (ERC), Space Science and Engineering Center (SSEC), and the Condor Lab in the CS department –ERC and SSEC either currently work with Sandia, LLNL and LBNL, or are included in companion DoE NGI proposals for future collaboration. CS is working with DoE high-energy physicists Cisco 7507 on order 100Mb service to –Christopher Rutland, ERC –Miron Livny, Computer Science Department (in collaboration with high-energy physics)

University of Illinois at Chicago UIC/EVL Status September 23, 1999 The University of Illinois at Chicago Electronic Visualization Laboratory –EVL is part of the Data and Visualization Corridors (DVC) initiative, working with ANL, LLNL, Sandia and LANL, and also part of CorridorOne (C1) Cisco 7507s for EVL and STAR TAP on order 100baseT and direct 155Mb ATM available in lab now 12 students and several faculty/staff Strong interest from internationals to participate via STAR TAP

University of Illinois at Chicago University of Chicago Status September 23, 1999 University of Chicago, to connect Center on Astrophysical Thermonuclear Flashes (FLASH) –FLASH is an ASCI Center with strong research connections to ANL, LANL, SNL, and LLNL 100Mb service to Robert Rosner, FLASH Center Cisco 7507 on order Focus first on improving effective transfer rates to DoE labs (Chuck Salisbury quick success!)

University of Illinois at Chicago EMERGE “Deep Tech” Meeting October 7 Linda Winkler, Leader –Bill Jensen, UW-Madison –Alan Verlo, UIC/EVL –Ron Rusnak, Noam Freedman and Kay Sandacz, UChicago –Tim Ward, Northwestern –Tony Rimovsky, NCSA/UIUC Goal: set up the 7507’s on MREN PVC’s and install GARA (Globus Architecture for Reservation and Allocation) at the 5 above Universities

University of Illinois at Chicago GARA Software From the Beginning Issues relating to configuration of resource managers: –We provide both Web-based and application-level reservation mechanisms –All bandwidth requests are authenticated, hence people need to get credentials –Initially no authorization mechanisms, i.e. all reservation requests are accepted –LDAP-based table for determining which resource managers are contacted for requests. (Do we need to define a mechanism for adding hosts, or work things out on the basis of host names?)

University of Illinois at Chicago GARA Implementation GARA is beta software, not always easy to install We are seeking volunteers to create some Web-based mechanisms for monitoring testbed status: e.g., active reservations We also need some simple logging at each site

University of Illinois at Chicago Streaming Video and Audio

University of Illinois at Chicago CAVERNsoft and GlobusIO GlobusIO will include Netlogger instrumentation Developing New CAVERNsoft G2 in GlobusIO Incorporate DiffServ via Globus Architecture for Reservation & Allocation (GARA) QoS API Upgrade Tele-Immersive Data Exploration environment (TIDE) to G2 Tele-Immersive Data Exploration environment

University of Illinois at Chicago Grid Services Package--The Basic Idea as expressed in the EMERGE Proposal Deploy standard infrastructure across sites participating in EMERGE –Provide maximum capabilities to applications –Increase what can be “taken for granted” when developing applications –Reduce deployment burden at sites For example –Authentication, resource discovery, resource management, instrumentation, …. Call this a “Grid Services Package”

University of Illinois at Chicago Grid Service Package Status Core services –Authentication/authorization--PKI (GSI--done) –Resource management (reserve/allocate bandwidth, perhaps other things) (GARA-- demos and deployment underway) –Instrumentation (discussions underway) –Directory service (publish/query selected information) (MDS--Done)

University of Illinois at Chicago In Summary EMERGE plans to: Build a DiffServ testbed infrastructure –Add to the existing MREN network Implement DiffServ –Purchase suitable DiffServ-capable routers Control DiffServ –Use the Grid Services Package Apply DiffServ –Collect and distribute application toolkits Understand DiffServ –Model, monitor and measure applications