Developing a 100G TestBed for Life Science Collaborations  Taking advantage of existing UM/SURA dark fiber to create a research 100G pathway from St.

Slides:

Advertisements

Similar presentations

Welcome to Middleware Joseph Amrithraj

Advertisements

Cloud Storage in Czech Republic Czech national Cloud Storage and Data Repository project.

Dr. Kalpakis CMSC 621, Advanced Operating Systems. Fall 2003 URL: Distributed System Architectures.

1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation,

1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,

A Computation Management Agent for Multi-Institutional Grids

Scale-out Central Store. Conventional Storage Verses Scale Out Clustered Storage Conventional Storage Scale Out Clustered Storage Faster……………………………………………….

Network-Attached Storage

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

ASP.NET 2.0 Chapter 6 Securing the ASP.NET Application.

What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.

1© Copyright 2015 EMC Corporation. All rights reserved. SDN INTELLIGENT NETWORKING IMPLICATIONS FOR END-TO-END INTERNETWORKING Simone Mangiante Senior.

Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo

CHEP2006 Network Information and Management Infrastructure Igor Mandrichenko, Eileen Berman, Phil DeMar, Maxim Grigoriev, Joe Klemencic, Donna Lamore,

CAMP Med Mapping HIPAA to the Middleware Layer Sandra Senti Biological Sciences Division University of Chicago C opyright Sandra Senti,

Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.

Australian Access Federation Robert Hazeltine Identity and Access Management Enterprise Systems Office.

3 Nov 2003 A. Vandenberg © Second NMI Integration Testbed Workshop on Experiences in Middleware Deployment, Anaheim, CA 1 Shibboleth Pilot Local Authentication.

Version 4.0. Objectives Describe how networks impact our daily lives. Describe the role of data networking in the human network. Identify the key components.

CI Days: Planning Your Campus Cyberinfrastructure Strategy Russ Hobby, Internet2 Internet2 Member Meeting 9 October 2007.

XHTML Introductory1 Linking and Publishing Basic Web Pages Chapter 3.

1 Multi Cloud Navid Pustchi April 25, 2014 World-Leading Research with Real-World Impact!

Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

Software-defined Networking Capabilities, Needs in GENI for VMLab ( Prasad Calyam; Sudharsan Rajagopalan;

 Protocols used by network systems are not effective to distributed system  Special requirements are needed here.  They are in cases of: Transparency.

What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.

Research and Educational Networking and Cyberinfrastructure Russ Hobby, Internet2 Dan Updegrove, NLR University of Kentucky CI Days 22 February 2010.

Enabling Collaborations via a Transformative Virtual Organization Platform Dr. Gordon K. Springer University of Missouri-Columbia CS Department Seminar.

Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.

Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)

Module 3 Configuring File Access and Printers on Windows 7 Clients.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

1 Protection and Security: Shibboleth. 2 Outline What is the problem Shibboleth is trying to solve? What are the key concepts? How does the Shibboleth.

Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.

Community Sign-On and BEN. Table of Contents  What is community sign-on?  Benefits  How it works (Shibboleth)  Shibboleth components  CSO workflow.

Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.

Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]

University of Washington Identity and Access Management IEEAF – RENU Network Design Workshop Seattle - 29 Nov 2007 Lori Stevens, Director, Distributed.

Network Infrastructure Microsoft Windows 2003 Network Infrastructure MCSE Study Guide for Exam

Department of Computing, School of Electrical Engineering and Computer Sciences, NUST - Islamabad KTH Applied Information Security Lab Secure Sharding.

Fundamentals of Information Systems, Second Edition 1 Telecommunications, the Internet, Intranets, and Extranets.

System Center Lesson 4: Overview of System Center 2012 Components System Center 2012 Private Cloud Components VMM Overview App Controller Overview.

NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.

7. Grid Computing Systems and Resource Management

Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.

Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.

GeWorkbench Overview Support Team Molecular Analysis Tools Knowledge Center Columbia University and The Broad Institute of MIT and Harvard.

Copyright © 2002 Pearson Education, Inc. Slide 3-1 Internet II A consortium of more than 180 universities, government agencies, and private businesses.

Active Directory. Computers in organizations Computers are linked together for communication and sharing of resources There is always a need to administer.

Advanced research and education networking in the United States: the Internet2 experience Heather Boyles Director, Member and Partner Relations Internet2.

Administrative Information Systems Shibboleth Install Session Technical Information Session for Developers Datta Mahabalagiri.

File Transfer And Access (FTP, TFTP, NFS). Remote File Access, Transfer and Storage Networks For different goals variety of approaches to remote file.

R. Krempaska, October, 2013 Wir schaffen Wissen – heute für morgen Controls Security at PSI Current Status R. Krempaska, A. Bertrand, C. Higgs, R. Kapeller,

Role Activity Sub-role Functional Components Control Data Software.

Information Initiative Center, Hokkaido University North 11, West 5, Sapporo , Japan Tel, Fax: Management.

Leveraging Campus Authentication to Access the TeraGrid Scott Lathrop, Argonne National Lab Tom Barton, U Chicago.

Canadian Bioinformatics Workshops

HTCondor-CE. 2 The Open Science Grid OSG is a consortium of software, service and resource providers and researchers, from universities, national laboratories.

Community Sign-On and BEN. Table of Contents  What is community sign-on?  Benefits  How it works (Shibboleth)  Shibboleth components  CSO workflow.

Clouding with Microsoft Azure

Accessing the VI-SEEM infrastructure

Grid Computing.

Recap: introduction to e-science

ICT Communications Lesson 1: Using the Internet and the World Wide Web

GRID COMPUTING PRESENTED BY : Richa Chaudhary.

OpenStack Ani Bicaku 18/04/ © (SG)² Konsortium.

Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy

AI Discovery Template IBM Cloud Architecture Center

SCCM in hybrid world Predrag Jelesijević Microsoft 7/6/ :17 AM

Presentation transcript:

Developing a 100G TestBed for Life Science Collaborations  Taking advantage of existing UM/SURA dark fiber to create a research 100G pathway from St Louis to Kansas City via Columbia along Interstate 70  Using InCommon Federated Identities for authentication via Shibboleth; authorizations occur via an autonomous Entitlement Server to provide fine-grained authorizations to/from service providers  Developing distributed resource sharing by mapping needs to resources eligible for assignment depending on geography and resource availability  At 100G some distributed computing latency issues can likely be overcome

Problem Set  High-Throughput Sequencing is producing enormous quantities of data; needing a storage infrastructure as a private cloud  Need to provision collecting, analyzing and using resources according to demand and includes the processing applications being net-aware  Develop security, measurement and analysis tools to efficiently run at 100G across a regional multi-cluster environment using OpenFlow and other specialized protocols

High throughput DNA sequencing at MU DNA Core Facility. Sequence data analyzed at MU on high-speed systems. Patterns of gene expression analyzed with microarrays to reveal mechanisms that contribute to reproduction efficiency. Improved efficiency, quality and profitability is the goal. Gene annotations quickly obtained by access to other data- bases through the MU Internet2 high speed network. Swine female reproductive tissues and embryos are removed at various times of gestation. Iterate microarray & other experiments to focus on gene discovery. Where Does the Data Come From? A High-Volume EST Pipeline For Discovery

Col KC SL I70 Big Data/Big Science Collaboratory

The GPN Network

Grant Writers Professional Development Sessions University of Missouri System

UM InterCampusNetwork with 100G Pathway along I70 100G HtSeq LSC Internet2 UM Portion of MOREnet

Multi-Site Sharing SMP ServersLinux Cluster GPGPUs HPC Storage Visualization & Display IBM H C R U6 IBM H C R U6 IBM H C R U6 IBM H C R U6 HPC Infiniband Network Machine Room GbE Network Protocols CIFS NFS HTTP FTP SCP Managem ent Central Administra tion Monitoring File Mgmt Availabilit y Data Migration Replicatio n Backup Research Data Store Campus GbE Network Instruments (Medical) Instruments (Core Service) Instrument (Research) Lab (Research & Clinical) Mgmt OpenFlow And Other Protocols OpenFlow And Other Protocols LOGINCLOUD Next-GenLinux Cluster GPGPUs HPC Storage Visualization & Display IBM H C R U6 IBM H C R U6 IBM H C R U6 IBM H C R U6 HPC Infiniband Network Machine Room GbE Network Protocols CIFS NFS HTTP FTP SCP Managem ent Central Administra tion Monitoring File Mgmt Availabilit y Data Migration Replicatio n Backup Research Data Store Campus GbE Network Instruments (Medical) Instruments (Core Service) Instrument (Research) Lab (Research & Clinical) Mgmt CLOUDLOGIN Site A Site B

Adapted from: The Stanford Clean Slate Program Controller PC NetStorage Storage Cloud OpenFlow at the packet level OpenFlow-enabled Commercial Switch Flow Table Flow Table Secure Channel Secure Channel Normal Software Normal Datapath NetProcessors Analysis Engines User

11 Collaborative Framework

Bridging the Gaps (Some are very Large) DataProcessors Provider Authenticate (InCommon) Analysis Tools Sharing AppsNets

WAYF Identity Provider Service Provider Identity Directory Handle Service Attribute Authority SHIRE SHAR Resource Manager Reso urce Attributes Credentials Handle Entitlement Server Administrative User Entitlement Client App Command YES/NO Handle VO Entitlement Command Credentials 8 9 Command YES/NO 11 Using Middleware Tools for VO Collaboration ES DB Entitlement Server User

Service Provider Entitlement Server Identity Provider Page or computational results 1: request by URL or command uses public key encryption for authentication and privacy Simplified Design

Getting Authenticated If you belong to a GPN member organization, but do not see your institution in the list, please contact your local GPN representative to request help in authenticating in this environment.

2/24/ Entering the VO Environment

And the story continues … More Data, Resources, People & Knowledge

02/14/2007 Grant Writers Professional Development Sessions 18 UMBC