The GENI Meta-Operations Center (GMOC) If it’s research, why do we care about operations?

Slides:



Advertisements
Similar presentations
INDIANAUNIVERSITYINDIANAUNIVERSITY GENI Global Environment for Network Innovation James Williams Director – International Networking Director – Operational.
Advertisements

The GENI Project and the GMOC Federated Management Infrastructure and Implications Beyond GENI James G. Williams Indiana University Bloomington, Indiana.
TransPAC2 Update Jim Williams Indiana University.
1 Spiral 1 Requirements Demonstrate GENI Clearinghouse & control framework in Spiral 1 projects as a central GENI concept. Demonstrate End-to-end.
Future Internet Research & Experimentation (FIRE+) Integrating experiments & facilities in FIRE+ H2020-ICT/FET National Contact Points Training 23 October.
GENI: Global Environment for Networking Innovations Larry Landweber Senior Advisor NSF:CISE Joint Techs Madison, WI July 17, 2006.
Sponsored by the National Science Foundation Project PrimoGENI Spiral 2 Year-end Project Review Florida International University PI: Jason Liu;
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Sponsored by the National Science Foundation GENI Clearinghouse Panel GEC 12 Nov. 2, 2011 INSERT PROJECT REVIEW DATE.
Systems Engineering in a System of Systems Context
6-7 May 2002 CEOS GRID Workshop 1 “CEOS GRID Proposals” roundtable: Introduction ESRIN, 6-7 May 2002 CEOS Workshop on GRID.
Dave Jent, PI Luke Fowler, Co-PI Ron Johnson, Co-PI
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University
1 GENI: Global Environment for Network Innovations Jennifer Rexford On behalf of Allison Mankin (NSF)
Sponsored by the National Science Foundation netKarma Spiral 2 Year-end Project Review Indiana University Beth Plale (PI) School of Informatics and Computing.
Workshop on Prototyping and Deploying Software Defined Exchanges Chip Elliott, BBN / GENI June 5, 2014.
Sponsored by the National Science Foundation KanseiGenie Spiral 2 Year-end Project Review Ohio State University, Wayne State University PI: Anish Arora.
Sponsored by the National Science Foundation Campus/Experiment Topics in Monitoring and I&M GENI Engineering Conference 15 Houston, TX Sarah Edwards Chaos.
Sponsored by the National Science Foundation PlanetLab and PLFED Spiral 2 Year-end Project Review Princeton University PI: Larry Peterson Staff: Andy Bavier,
The GENI Meta-Operations Center (GMOC) If it’s research, why do we care about operations?
Digital Object Architecture
Sponsored by the National Science Foundation GENI-enabled Campuses Responsibilities, Requirements, & Coordination Bryan Lyles, NSF Mark Berman & Chip Elliott,
Experimenting with Programmable Management Policies over GENI ProtoRINA over GENI Abraham Matta Yuefeng Wang Computer Science Department Boston University.
Sponsored by the National Science Foundation Design of an Information Substrate for Measurement, Monitoring and Inference Spiral 2 Year-end Project Review.
GENI: Global Environment for Networking Innovations Allison Mankin (for the GENI Team) CISE/NSF Rest of GENI Team: Guru Parulkar, Paul.
STORAGE ARCHITECTURE/ EXECUTIVE: Virtualization It’s not what you think you’re buying. John Blackman Independent Storage Consultant.
1 Supporting the development of distributed systems CS606, Xiaoyan Hong University of Alabama.
Sponsored by the National Science Foundation GENI Meta-Operations Center Spiral 2 Year-end Project Review GlobalNOC at Indiana University PI: Jon-Paul.
GEC3 – October 28-30, 20081www.geni.net1 Substrate WORKING GROUP System Engineering Report John Jacob SWG System Engineer groups.geni.net GENI working.
Data Plane Measurements Deniz Gurkan Roopa Krishnappa October 28 th, 2008.
Sponsored by the National Science Foundation Embedded Measurement Framework (ERM) Spiral 2 Year-end Project Review PI: Keren Bergman Students: Michael.
GEC3www.geni.net1 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk Clearing.
Delivering business value through Context Driven Content Management Karsten Fogh Ho-Lanng, CTO.
Sponsored by the National Science Foundation GENI Security Architecture Toolkit (GSAT) Spiral 2 Year-end Project Review SPARTA, Inc. PI: Stephen Schwab.
CPSC 871 John D. McGregor Module 6 Session 3 System of Systems.
E-Science for the SKA WF4Ever: Supporting Reuse and Reproducibility in Experimental Science Lourdes Verdes-Montenegro* AMIGA and Wf4Ever teams Instituto.
Sponsored by the National Science Foundation GENI Registry Services, a.k.a. Digital Object Registry Spiral 2 Year-end Project Review CNRI PI: Larry Lannom.
Modeling and Simulating Software Acquisition Process Architectures James Choi and Walt Scacchi Computer Science Dept. Institute for Software Research California.
OnTimeMeasure-GENI: Centralized and Distributed Measurement Orchestration Software Prasad Calyam, Ph.D. (PI) Paul Schopis, (Co-PI) Weiping Mandrawa (Network.
Sponsored by the National Science Foundation GENI Goals & Milestones GENI CC-NIE Workshop NSF Mark Berman January 7,
Optical Edge / Access Networks for GENI Lokesh Mandvekar Dr. Chunming Qiao (PI)‏ Department of Computer Science.
Connect communicate collaborate GÉANT3 Services Connectivity and Monitoring Services by and for NRENs Ann Harding, SWITCH TNC 2010.
Sponsored by the National Science Foundation GENI Security Architecture What’s Up Next? GENI Engineering Conference 7 Durham, NC Stephen Schwab SPARTA/Cobham.
Sponsored by the National Science Foundation Substrate Working Group GENI Engineering Conference 4 Miami, FL Peter O’Neil April 1,
Sponsored by the National Science Foundation Distributed Identity & Authorization Mechanisms Spiral 2 Year-end Project Review SPARTA, Inc. PI: Stephen.
Sponsored by the National Science Foundation Cluster D Working Meetings GENI Engineering Conference 5 Seattle, WA July ,
Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC.
Sponsored by the National Science Foundation Internet2 OpenFlow Backbone Spiral 2 Year-end Project Review Internet2 PI: Eric Boyd Co-PI: Matt Zekauskas.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
1 GENI International GMOC - dvNOC Cooperative Efforts with Korea (K- GENI) Dongkyun Kim/KISTI Camilo Viecco, Jim Williams/IU
Sponsored by the National Science Foundation Meeting Introduction: Integrating GENI Networks with Control Frameworks Aaron Falk GENI Project Office June.
Sponsored by the National Science Foundation Federating a CRON into ProtoGENI Spiral 2 Year-end Project Review Louisiana State University PI: Seung-Jong.
Cyberinfrastructure: An investment worth making Joe Breen University of Utah Center for High Performance Computing.
Sponsored by the National Science Foundation GENI Aggregate Manager API Tom Mitchell March 16, 2010.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
Use-cases for GENI Instrumentation and Measurement Architecture Design Team members: Paul Barford - University of Wisconsin – Madison Jim Griffioen - Univ.
Sponsored by the National Science Foundation 1 Nov 4, 2010 Cluster-D Mtg at GEC9 Tue, Nov 2, 12noon – 4:30pm Meeting Chair: Ilia Baldine (RENCI) –System.
Virtualization as Architecture - GENI CSC/ECE 573, Sections 001, 002 Fall, 2012 Some slides from Harry Mussman, GPO.
GEC3 – October 28-30, 2008www.geni.net1 Opt-in Working Group System Engineering Report October 29, 2008 Harry Mussman Opt-in WG System Engineer
ProtoRINA over ProtoGENI What is RINA? [1][2] References [1] John Day. “Patterns in Network Architecture: A Return to Fundamentals”. Prentice Hall, 2008.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
The GENI Meta-Operations Center (GMOC) Jon-Paul Herron Global Research NOC.
1 CDC Health Information Exchange (HIE) Accelerating State-wide Public Health Situational Awareness in New York Through Health Information Exchanges August.
Designing a Federated Testbed as a Distributed System Robert Ricci, Jonathon Duerig, Gary Wong, Leigh Stoller, Srikanth Chikkulapelly, Woojin Seok 1.
Clouds , Grids and Clusters
C2CAMP (A Working Title)
GENI Global Environment for Network Innovation
GENI Exploring Networks of the Future
Presentation transcript:

The GENI Meta-Operations Center (GMOC) If it’s research, why do we care about operations?

Project to Build Infrastructure to support greenfield network science NOT Research in itself The Test Track, not the car GENI

GENI Summary Funded by NSF BBN Technologies serves as the GENI Project Office (GPO) 2 Solicitations so far Solicitation #1 had 29 funded projects Solicitation #2 had 33 funded projects

GENI Control Frameworks GPO grouped projects into control framework clusters each cluster is anchored by a project to develop a control plane for the facility 5 clusters initially: PlanetLab TIED ProtoGENI ORCA/BEN ORBIT

GENI Early Focus: “Slicing” In GENI, a slice means a set of virtualized resources connected together to provide a single virtual testbed for a scientist “slicing” across parts of a control framework cluster is main thrust now future will mean inter-cluster slicing & federation with other facilities & networks

GENI Meta-Operations Center

What’s “Meta” mean? GENI is made up of many loosely affiliated projects Many projects have existing means to provide operations But what about operating GENI as a whole? What’s needed? Option 1/NOTHING - each part can operate independently without additional effort for GENI as a whole Option 2/Central GENI Operations Center - all GENI resources should be centrally managed & operated by a GENI operations center Option 3/Meta-operations - GENI projects can best handle most operational tasks. For GENI as a whole, someone should coordinate operations across projects to present a single interface to operators and users.

Cluster 2 Project D Project C Project A Project B Option 1 - Completely Distributed

Option 2 - Centralized Cluster 1Cluster 2 Project D Project C Project A Project B

Cluster 2 Project D Project C Project A Project B Option 3 - Meta-Operations Cluster 1

GMOC Architecture

GENI Meta-Operations Center

GMOC Translator - Translates information from other formats into consistent data format GMOC Repository - Central datastore for operational data from all GENI parts Operations - Watches Data to provide useful functions like Emergency Shutdown GMOC Exchanger - Polls and/or receives operational data from aggregates GENI Meta-Operations Center

GMOC Exchanger - Polls and/or receives operational data from aggregates

GENI Meta-Operations Center GMOC Translator - Translates information from other formats into consistent data format

GENI Meta-Operations Center GMOC Repository - Central datastore for operational data from all GENI parts

GENI Meta-Operations Center Operations - Watches Data to provide useful functions like Emergency Shutdown

Early GMOC Functions

GENI View of Operational Status Give GENI-wide view of operational status maps & graphs prototype other views, such as slice-by-slice views Give Scientists access to their data “What was going on during these 2 weeks I ran my test?”

Emergency Stop Identify & Shut down Misbehaving Slices Protect Other Slices Ensure Stability in Phase1, Emergency Stop will consist of a process for manual contact of projects Emergency Stop Demonstration To be performed in 2010

Challenges for GENI Operations

Challenge #1: Federation GENI has many projects doing different kinds of things with different abilities to provide operational data with different requirements for operational data GMOC depends on cooperation from them all Balance between central visibility and decentralized autonomy will need to evolve (and continue evolving)

Challenge #2: Layers of Visibility GENI Aggregates

Challenge #2: Layers of Visibility GENI Components

Challenge #2: Layers of Visibility

Challenge #3: Virtualized Operations Everything is more temporary what “slices” are out there (NOW, 3 weeks ago)? How do we correlate current slices to future slices for repeatability Everything is more complex Many different groups to serve: Operators, Researchers, “Opt-in” Users Everything is more concurrent How do researchers setting up “slices” know the state of them(and not everything else)? How do we “shut down” the problem parts (and not everything else)?

Challenge #3: Virtualized Operations Everything is more temporary what “slices” are out there (NOW, 3 weeks ago)? How do we correlate current slices to future slices for repeatability Everything is more complex Many different groups to serve: Operators, Researchers, “Opt-in” Users Everything is more concurrent How do researchers setting up “slices” know the state of them(and not everything else)? How do we “shut down” the problem parts (and not everything else)?

Solicitation 2: K-GENI ETRI/KISTI-GENI Collaboration Scope: Investigate international operational sharing and federation strategies Look into interoperability between GMOC and dvNOC for example: should GMOC conform to dvNOC data formats? vice versa? maybe a international “broker” to translate between them?

Does GENI have any relation to “normal” networks? GENIOther R&E Networks (Geant, etc) Federation End-to-end performance (perfSONAR) Multiple-domain Information sharing Virtualized TestbedOperating Dynamic Circuits Multiple LayersWhat Layers are operationally significant?

GMOC PI: Jon-Paul Herron GMOC Team: GMOC Website: