1 Testbeds Breakout Tom Anderson Jeff Chase Doug Comer Brett Fleisch Frans Kaashoek Jay Lepreau Hank Levy Larry Peterson Mothy Roscoe Mehul Shah Ion Stoica.

Slides:



Advertisements
Similar presentations
VINI and its Future Directions
Advertisements

Elastic Provisioning In Virtual Private Clouds
INDIANAUNIVERSITYINDIANAUNIVERSITY GENI Global Environment for Network Innovation James Williams Director – International Networking Director – Operational.
Network Systems Sales LLC
INTRODUCTION TO NETWORK VIRTUALIZATION Mosharaf Chowdhury Member, eNVy Project Wednesday, May 14, 2008 University of Waterloo - eNVy 1.
PlanetLab: An Overlay Testbed for Broad-Coverage Services Bavier, Bowman, Chun, Culler, Peterson, Roscoe, Wawrzoniak Presented by Jason Waddle.
2  Industry trends and challenges  Windows Server 2012: Modern workstyle, enabled  Access from virtually anywhere, any device  Full Windows experience.
2  Industry trends and challenges  Windows Server 2012: Beyond virtualization  Complete virtualization platform  Improved scalability and performance.
1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.
1 Planetary Network Testbed Larry Peterson Princeton University.
PlanetLab Architecture Larry Peterson Princeton University.
The Case for Enterprise Ready Virtual Private Clouds Timothy Wood, Alexandre Gerber *, K.K. Ramakrishnan *, Jacobus van der Merwe *, and Prashant Shenoy.
PlanetLab Operating System support* *a work in progress.
Introduction CSCI 444/544 Operating Systems Fall 2008.
Clouds C. Vuerli Contributed by Zsolt Nemeth. As it started.
Xen , Linux Vserver , Planet Lab
Tunis, Tunisia, 28 April 2014 Business Values of Virtualization Mounir Ferjani, Senior Product Manager, Huawei Technologies 2.
Building Your Own Firewall Chapter 10. Learning Objectives List and define the two categories of firewalls Explain why desktop firewalls are used Explain.
1 In VINI Veritas: Realistic and Controlled Network Experimentation Jennifer Rexford with Andy Bavier, Nick Feamster, Mark Huang, and Larry Peterson
Networks and Distributed Systems: Project Ideas
15-441: Computer Networking Lecture 26: Networking Future.
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University
An Overlay Data Plane for PlanetLab Andy Bavier, Mark Huang, and Larry Peterson Princeton University.
1 Routing as a Service Karthik Lakshminarayanan (with Ion Stoica and Scott Shenker) Sahara/i3 retreat, January 2004.
The Future of Internet Research Scott Shenker (on behalf of many networking collaborators)
Systems Analysis and Design in a Changing World, 6th Edition 1 Chapter 6.
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University See for.
The Future of the Internet Jennifer Rexford ’91 Computer Science Department Princeton University
Operating 24x7 Amin Vahdat on behalf of John Jannotti, Jeff Mogul, Larry Peterson, Joe Touch, Paulo Verissimo, Werner Vogels, Bill Weihl.
© 2010 VMware Inc. All rights reserved VMware ESX and ESXi Module 3.
Wolfgang Schneider NSI: A Client-Server-Model for PKI Services.
SharePoint Farm On Azure IAAS Prepared By : Prakhar Rastogi Premier Field engineer Microsoft India.
Cloud Computing Saneel Bidaye uni-slb2181. What is Cloud Computing? Cloud Computing refers to both the applications delivered as services over the Internet.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Morteza Yousefi University of Science & Technology of Mazandaran Network Virtualization 1 of 22 Network Virtualization.
Virtual Machine Hosting for Networked Clusters: Building the Foundations for “Autonomic” Orchestration Based on paper by Laura Grit, David Irwin, Aydan.
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Version 4.0. Objectives Describe how networks impact our daily lives. Describe the role of data networking in the human network. Identify the key components.
1 COMPSCI 110 Operating Systems Who - Introductions How - Policies and Administrative Details Why - Objectives and Expectations What - Our Topic: Operating.
MDC417 Follow me on Working as Practice Manager for Insight, he is a subject matter expert in cloud, virtualization and management.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Server Performance, Scaling, Reliability and Configuration Norman White.
Welcome to CPS 210 Graduate Level Operating Systems –readings, discussions, and programming projects Systems Quals course –midterm and final exams Gateway.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Virtualization as Architecture - GENI CSC/ECE 573, Sections 001, 002 Fall, 2012 Some slides from Harry Mussman, GPO.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Web Technologies Lecture 13 Introduction to cloud computing.
Service Pack 2 System Center Configuration Manager 2007.
“End to End VoIP“ The Challenges of VoIP Access to the Enterprise Charles Rutledge VP Marketing Quintum Technologies
Hosting Wide-Area Network Testbeds: Policy Considerations Larry Peterson Princeton University.
Chapter 11 – Cloud Application Development. Contents Motivation. Connecting clients to instances through firewalls. Cloud Computing: Theory and Practice.
© 2012 Eucalyptus Systems, Inc. Cloud Computing Introduction Eucalyptus Education Services 2.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
01/27/10 What is PlanetLab? A planet-wide testbed for the R & D of network applications and distributed computing Over 1068 nodes at 493 sites, primarily.
Network Processing Systems Design
Introduction to Mobile-Cloud Computing. What is Mobile Cloud Computing? an infrastructure where both the data storage and processing happen outside of.
Clouding with Microsoft Azure
Chapter 1 Characterization of Distributed Systems
Instructor Materials Chapter 7: Network Evolution
Container-based Operating System Virtualization: A scalable, High-performance Alternative to Hypervisors Stephen Soltesz, Herbert Potzl, Marc E. Fiuczynski,
Elastic Provisioning In Virtual Private Clouds
GGF15 – Grids and Network Virtualization
Software Defined Networking (SDN)
GENI Exploring Networks of the Future
Presentation transcript:

1 Testbeds Breakout Tom Anderson Jeff Chase Doug Comer Brett Fleisch Frans Kaashoek Jay Lepreau Hank Levy Larry Peterson Mothy Roscoe Mehul Shah Ion Stoica Joe Touch Amin Vahdat

2 GENI Requirements Virtualizable –So users can share infrastructure Programmable –So users can provide arbitrary functionality Supports painless user opt-in and opt-out –So we can get real workload Federation –So new devices, clusters, edge networks can be plugged in Software development support –So we can make our stuff real and available to each other –So we can build on each other's work; this includes (especially) management software

3 Questions What do we need? How can we contribute to substrate? What basic services can we provide?

4 What do we need? (1) Significant storage and computation infrastructure  make it possible to deploy Google and Yahoo like services  clusters  > 256 node per cluster  > 256 TB per site Many smaller clusters with heterogeneous connectivity  make it possible to deploy Akamai like services Others: 1000s of hosts, sensor nodes, mobile devices, embedded devices

5 What do we need? (2) Allow users to easily opt-in and opt-out with their resources to/from the testbed Enable testbed to organically grow to include –Wireless networks –Sensor networks –Community Networks –…

6 How can we contribute to substrate? (1) Provide a “virtual network system” abstraction: –Virtualize all resources: CPU. Memory, storage, network –Virtualization within constraints (e.g., 20 ms delay, 2 Mbps links) Challenge: Map virtual system networks onto physical resources while meeting time and resource constraints

7 How can we contribute to substrate? (2) Resource management & allocation –How to allocate resources (virtual network systems) when testbed is oversubscribed? Challenge: Develop flexible policies and mechanisms –E.g., reservation in both time and space, market- based allocation, …

8 How can we contribute to substrate? (3) Support for auditing, debugging –How to discover users with malicious intend, misconfigurations, bugs? Challenges: –Efficient and scalable infrastructure that at limit would allow all nodes to log all messages, virtual machine checkpoints, etc –Extensible monitoring infrastructure; provide hooks for users to add their own monitoring or logging code

9 What services can we provide? (1) PKI infrastructure Certification authority Auditing services Name server (DNS++) Resource location and discovery

10 What service can we provide? (2) Citeseer Source forge Usenet news arXiv.org Conference submission Fastlane Data distribution service Spam filters Distributed firewalls Open search engine (Open Google?)

11

12 Goals Flexibility/Control Isolation Realism Fairness Security Support for tracing, replaying

13 What should a Testbed Include? PlanetLab++ –Large number of node (1000s), heterogeneous connectivity Optical networks Sensor nodes Mobile hosts (PDAs, Phones, etc) Data centers (Google, Yahoo, part of the Internet fabric)

14 Soft-radios Four classes of wireless All things for all people is difficult Configurable testbeds Heterogeneous separate testbed What’s it at this site? –Storage to do management Contribute with software, maintain and support Operational and manage this

15 What we need? Sensornodes Open environment –Organically evolve testbeds Distribution, heterogeneity, scale

16 What else we need (Software)? Databases

17 How can we contribute? Management?

18 Flexibility Need to be have complete control on infrastructure node –Run various OSes –Port numbers –Real-time –Root privileges

19 Isolation One user shouldn’t be able to interfere with the experiments of other users At multiple levels –CPU –Memory –Disk –Bandwidth (both outgoing and ingoing)

20 Realism Real users, real applications Negotiate with ISPs to send traffic across testbed –How to guarantee that ISPs traffic won’t be screwed Recreate catastrophic failures, attacks

21 Security Prevent using testbed to initiate attacks –Malicious users –Misconfigurations Challenge: minimal impact on flexibility, performance

22 Management How to allocate resources to users in a fair and easy to understand (predictable?) way Flexible polices and mechanisms –Reservation in both time and space –Biding, trading resources –Economic-based allocation

23 Support for tracing, replaying Ideally, log everything: –Traffic –Virtual machine checkpoints Enable replaying, forensic Hard

24 Virtualized testbeds –Network and edge devices network –Virtual machine and virtual network –Virtualization within constraints (20ms) Abstract away heterogeneous software Specify requirements  map on real resources

25 Auditing/logging Flexible monitoring Secure hooks for monitoring

26 Extensible testbeds Flexible routing infrastructure Integrate everything Community networks Useful control system

27 Resource allocation Model for incentives Incentives to X add resources PKI infrastructure Certified authority Auditing services Name servers Resource location and discovery