Heavy and lightweight dynamic network services: challenges and experiments for designing intelligent solutions in evolvable next generation networks Laurent.

Slides:



Advertisements
Similar presentations
NetServ Dynamic in-network service deployment Henning Schulzrinne (Columbia University) Srinivasan Seetharaman (Georgia Tech) Volker Hilt (Bell Labs)
Advertisements

Multi-Access Services in Heterogeneous Wireless Networks Kameswari Chebrolu, Ramesh R. Rao Abstract Today's wireless world is characterized by heterogeneity.
Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,
IP Router Architectures. Outline Basic IP Router Functionalities IP Router Architectures.
Agent agent Outline of Presentation Introduction: Inter-Agent Message Passing ARP: Design and Analysis Generalization: A Generic Framework Conclusion.
Distributed Processing, Client/Server and Clusters
System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.
Christian Delbe1 Christian Delbé OASIS Team INRIA -- CNRS - I3S -- Univ. of Nice Sophia-Antipolis November Automatic Fault Tolerance in ProActive.
1 Improving the Performance of Distributed Applications Using Active Networks Mohamed M. Hefeeda 4/28/1999.
Module 8: Concepts of a Network Load Balancing Cluster
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
1 Improving Web Servers performance Objectives:  Scalable Web server System  Locally distributed architectures  Cluster-based Web systems  Distributed.
OSMOSIS Final Presentation. Introduction Osmosis System Scalable, distributed system. Many-to-many publisher-subscriber real time sensor data streams,
RDMA ENABLED WEB SERVER Rajat Sharma. Objective  To implement a Web Server serving HTTP client requests through RDMA replacing the traditional TCP/IP.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts Centralized Systems Run on a single computer system and do not interact with other computer.
An Active Reliable Multicast Framework for the Grids M. Maimour & C. Pham ICCS 2002, Amsterdam Network Support and Services for Computational Grids Sunday,
10/02/2004ELFms meeting1 Linux Virtual Server Miroslav Siket FIO-FS.
Design and Implementation of a Single System Image Operating System for High Performance Computing on Clusters Christine MORIN PARIS project-team, IRISA/INRIA.
LECTURE 9 CT1303 LAN. LAN DEVICES Network: Nodes: Service units: PC Interface processing Modules: it doesn’t generate data, but just it process it and.
PRISM: Proxies for Internet Streaming Media J. Kurose, P. Shenoy, D. Towsley (UMass/Amherst) L. Gao (Smith College) G. Hjalmtysson, J. Rexford (AT&T Research.
Module 13: Network Load Balancing Fundamentals. Server Availability and Scalability Overview Windows Network Load Balancing Configuring Windows Network.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
A brief overview about Distributed Systems Group A4 Chris Sun Bryan Maden Min Fang.
Optimized Java computing as an application for Desktop Grid Olejnik Richard 1, Bernard Toursel 1, Marek Tudruj 2, Eryk Laskowski 2 1 Université des Sciences.
INSTALLING MICROSOFT EXCHANGE SERVER 2003 CLUSTERS AND FRONT-END AND BACK ‑ END SERVERS Chapter 4.
JuxMem: An Adaptive Supportive Platform for Data Sharing on the Grid Gabriel Antoniu, Luc Bougé, Mathieu Jan IRISA / INRIA & ENS Cachan, France Workshop.
Chapter 6 Operating System Support. This chapter describes how middleware is supported by the operating system facilities at the nodes of a distributed.
N. GSU Slide 1 Chapter 02 Cloud Computing Systems N. Xiong Georgia State University.
IWAN 2005 November – Sophia Antipolis, France Towards the Design of an Industrial Network Node M.Chaudier, J.P Gelas, L.Lefèvre INRIA/LIP Ecole.
Dynamic Reconfiguration Dynamic selection of handler functionality: currently through use of parameterizable handlers or by selecting from a set of existing.
1 Liquid Software Larry Peterson Princeton University John Hartman University of Arizona
SPREAD TOOLKIT High performance messaging middleware Presented by Sayantam Dey Vipin Mehta.
Peer-to-Peer Distributed Shared Memory? Gabriel Antoniu, Luc Bougé, Mathieu Jan IRISA / INRIA & ENS Cachan/Bretagne France Dagstuhl seminar, October 2003.
Putting Intelligence in Internetworking: an Architecture of Two Level Overlay EE228 Project Anshi Liang Ye Zhou.
Cracow Grid Workshop, October 27 – 29, 2003 Institute of Computer Science AGH Design of Distributed Grid Workflow Composition System Marian Bubak, Tomasz.
DBAS: A Deployable Bandwidth Aggregation System Karim Habak†, Moustafa Youssef†, and Khaled A. Harras‡ †Egypt-Japan University of Sc. and Tech. (E-JUST)
Network-on-Chip Energy-Efficient Design Techniques for Interconnects Suhail Basit.
A Measurement Based Memory Performance Evaluation of High Throughput Servers Garba Isa Yau Department of Computer Engineering King Fahd University of Petroleum.
Impact of High Performance Sockets on Data Intensive Applications Pavan Balaji, Jiesheng Wu, D.K. Panda, CIS Department The Ohio State University Tahsin.
1 Mobile Networks logica Contents Confidential & Proprietary to Logica © 2001 Application-Level Active Networks Presented at Dublin Breakfast Briefing,
Comparison of Distributed Operating Systems. Systems Discussed ◦Plan 9 ◦AgentOS ◦Clouds ◦E1 ◦MOSIX.
OPERETTA: An Optimal Energy Efficient Bandwidth Aggregation System Karim Habak†, Khaled A. Harras‡, and Moustafa Youssef† †Egypt-Japan University of Sc.
1 CMPE 511 HIGH PERFORMANCE COMPUTING CLUSTERS Dilek Demirel İşçi.
An initial study on Multi Path Routing Over Multiple Devices in Linux 2.4.x kernel Towards CS522 term project By Syama Sundar Kosuri.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
Mobile Agent Migration Problem Yingyue Xu. Energy efficiency requirement of sensor networks Mobile agent computing paradigm Data fusion, distributed processing.
1 BRUSSELS - 14 July 2003 Full Security Support in a heterogeneous mobile GRID testbed for wireless extensions to the.
4/19/20021 TCPSplitter: A Reconfigurable Hardware Based TCP Flow Monitor David V. Schuehler.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
A record and replay mechanism using programmable network interface cards Laurent Lefèvre INRIA / LIP (UMR CNRS, INRIA, ENS, UCB)
DYNAMIC LOAD BALANCING ON WEB-SERVER SYSTEMS by Valeria Cardellini Michele Colajanni Philip S. Yu.
Full and Para Virtualization
AMQP, Message Broker Babu Ram Dawadi. overview Why MOM architecture? Messaging broker like RabbitMQ in brief RabbitMQ AMQP – What is it ?
1 OASIS Team, INRIA Sophia-Antipolis/I3S CNRS, Univ. Nice Christian Delbé Data Grid Explorer 15/09/03 Large Scale Emulation Mobility in ProActive.
Rehab AlFallaj.  Network:  Nodes: Service units: PC Interface processing Modules: it doesn’t generate data, but just it process it and do specific task.
Network Virtualization Sandip Chakraborty. In routing table we keep both the next hop IP (gateway) as well as the default interface. Why do we require.
09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.
Cloud Computing – UNIT - II. VIRTUALIZATION Virtualization Hiding the reality The mantra of smart computing is to intelligently hide the reality Binary->
Cluster Computers. Introduction Cluster computing –Standard PCs or workstations connected by a fast network –Good price/performance ratio –Exploit existing.
Efficient Opportunistic Sensing using Mobile Collaborative Platform MOSDEN.
Running Commodity Operating Systems on Scalable Multiprocessors Edouard Bugnion, Scott Devine and Mendel Rosenblum Presentation by Mark Smith.
SYSTEM MODELS FOR ADVANCED COMPUTING Jhashuva. U 1 Asst. Prof CSE
Atrium Router Project Proposal Subhas Mondal, Manoj Nair, Subhash Singh.
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
Architecture and Algorithms for an IEEE 802
Introduction to Distributed Platforms
Chapter 4: Threads.
Chapter 4: Threads.
Data Path through host/ANP.
Active Networking at Washington Univ.
Presentation transcript:

Heavy and lightweight dynamic network services: challenges and experiments for designing intelligent solutions in evolvable next generation networks Laurent Lefèvre INRIA / LIP (UMR CNRS, INRIA, ENS, UCB) WAGEN Workshop - Jiuzhaigou - April 8,

Challenges Active networks : programmable network equipments which allow deployment of heterogeneous services in data plan (heavy services) In control / management plans (lightweight services) How to urbanize networks with autonomous dynamic services ? How to efficiently manage such heterogeneous services for providing efficient solutions inside the network ?

Patterns Robustness Best effort services Garanted services Personnalized Generic services Dedicated services (application, user, stream…) TTL One-usage service Persistant services

Roadmap Urbanization of dynamic network services Lightweight network functionalities Cluster-based network equipments Load balancing strategies for heterogeneous services

Where to map dynamic autonomous network services? Urbanization is an open problem Mixes networking aspects with service composition Access networks Peering points Front end of clusters LAN ?

Service on data path Proxy mode Dynamic deployment

Replicated network service Same service replicated on several network equipments On the fly deployment with data streams

Distributed network autonomous service Service composition Allow pipelined approach Dealing with fault tolerance / load balancing

Unique service out of the data path Dedicated equipment (legacy solution) Requires intelligent forwarding

Distributed service outside the data path Requires sensors to evaluate cost of multiple fwd operations

Proposing a generic active environment able to handle heterogeneous services : The Tamanoir project Supporting requirements of current networks (Gbits)

Tamanoir Architecture : adapted for heterogeneous services Resources consuming services : distributed storage, streams adaptation, on the fly compression, cryptography… Services deployment / linked with middleware : reliable multicast… Middle services : content based routing, QoS... Light network services : packet marking, QoS… NIC (Programmable) Kernel Execution environment Distributed resources

Active service deployment From application / middleware From TAN From network service Broker

Tamanoir Active Node (TAN) Execution environment

Performance evaluation of middle services

Solution / Problem Simple Java service in user space can support up to 450 Mbits ! (we eat the ants ! ) A stand-alone active node is not enough to fully support and apply active service to Gbit streams  Need to put lightweight network functionalities close to the network Explore kernel services

Kernel support for active node NIC (Programmable) Kernel Execution environment Distributed resources

Kernel Support Module inside Linux kernel : using netfilter Filtering ANEP packets Allowing packet to cross the active node through the kernel space Efficiently put ANEP packets inside the service in user space

Netfilter Protocols define hooks on the packet way inside IP stack Associate hooks and personalized applications /services Routing Local process NF_IP_POST_ROUTING NF_IP_FORWARD NF_IP_LOCAL_OUT NF_IP_LOCAL_IN

Communication between active service and OS module A Tamanoir active service : a java part + kernel module Message control / parameters

Performance evaluation

Solution / Problem Kernel active services greatly reduce latency for transient packets Only applicable to lightweight network functionalities (state, CPU consumption..)  Reduce portability of active services What about CPU consuming services ?

Cluster-based active node NIC (Programmable) Kernel Execution environment Distributed resources

Tamanoir architecture : on a cluster

Pushing performances Improving performances of active nodes : using clustering technology Linux Virtual Server Strategies : Round robin Least connected

Performance evaluation

Solution / Problem We support a full Gbit streams with a small cluster based Tamanoir active node ! We need more resources for CPU consuming active services How to balance workload between internal nodes of an active node without knowing length of streams and needed services ?

Feedback stream based load balancing policy (FBSb) Needs dynamic strategies for heterogeneous deployment FBSb Front-end machine with updated “weight” table (CPU and memory consumption of back-end machines) Back-end machines with feedback agents and sensors

Experiments Heavy service (3-DES encryption) : this service makes an intensive use of CPU (1 stream calling this service saturates a CPU, in our test implementation); Medium service (stateful traffic analysis) : this service uses the CPU in a less intensive way, but its impact is not transparent (3-4 streams calling this service saturate a CPU, in our test implementation).

Experiments 200: composed by 1 stream calling a service of encryption and 11 streams calling for a traffic analysis with different delays of arrival of 1 second (201), 2 seconds (202) and 5 seconds (205). 300: composed by 4 streams calling a service of encryption and 8 streams calling for traffic analysis. with different delays of arrival of 0 second (300), 1 second (301) and 2 seconds (302).

Experiments : FBSb, RR, LC FBSb RR LC TestMAXAVGMINMAXAVGMINMAXAVGMIN RR and LC : efficient if homogeneous dynamic services FBSb : efficient when heterogeneous deployment

Conclusions and future works We propose a gigabit supporting software based active node using kernel module deployment and cluster Providing load balancing support inside cluster-based active equipments is a mandatory aspect for performances Research could also benefit for network processors technology / programmable network interface cards Deployment of large scale active/programmable platform based on emulation : French Grid5000 project