A Cost Driven Approach to Information Collection for Mobile Environments Qi Han Nalini Venkatasubramanian Department of Information and Computer Science.

Slides:



Advertisements
Similar presentations
Energy Efficient Data Collection In Distributed Sensor Environments Qi Han, Sharad Mehrotra, Nalini Venkatasubramanian {qhan, sharad,
Advertisements

Feedback Control Real-Time Scheduling: Framework, Modeling, and Algorithms Chenyang Lu, John A. Stankovic, Gang Tao, Sang H. Son Presented by Josh Carl.
Dissemination-based Data Delivery Using Broadcast Disks.
Scheduling in Web Server Clusters CS 260 LECTURE 3 From: IBM Technical Report.
Hadi Goudarzi and Massoud Pedram
Resource Management §A resource can be a logical, such as a shared file, or physical, such as a CPU (a node of the distributed system). One of the functions.
Dave Bradley Rick Harper Steve Hunter 4/28/2003 CoolRunnings.
Distributed Multimedia Systems
Wenye Wang Xinbing Wang Arne Nilsson Department of Electrical and Computer Engineering, NC State University March 2005 A New Admission Control Scheme under.
1 Routing and Scheduling in Web Server Clusters. 2 Reference The State of the Art in Locally Distributed Web-server Systems Valeria Cardellini, Emiliano.
Kuang-Hao Liu et al Presented by Xin Che 11/18/09.
Towards Feasibility Region Calculus: An End-to-end Schedulability Analysis of Real- Time Multistage Execution William Hawkins and Tarek Abdelzaher Presented.
Karl Schnaitter and Neoklis Polyzotis (UC Santa Cruz) Serge Abiteboul (INRIA and University of Paris 11) Tova Milo (University of Tel Aviv) Automatic Index.
Probabilistic Aggregation in Distributed Networks Ling Huang, Ben Zhao, Anthony Joseph and John Kubiatowicz {hling, ravenben, adj,
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
Resource Provisioning and Bandwidth Brokering for IP-core Networks Chen-Nee Chuah ISRG Retreat Jan 10-12, 2000 Problem: How to provide end-to-end QoS in.
Quality of Service in IN-home digital networks Alina Albu 7 November 2003.
Quality of Service in IN-home digital networks Alina Albu 23 October 2003.
Locality-Aware Request Distribution in Cluster-based Network Servers 1. Introduction and Motivation --- Why have this idea? 2. Strategies --- How to implement?
1 Introduction to Load Balancing: l Definition of Distributed systems. Collection of independent loosely coupled computing resources. l Load Balancing.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
Differentiated Multimedia Web Services Using Quality Aware Transcoding S. Chandra, C.Schlatter Ellis and A.Vahdat InfoCom 2000, IEEE Journal on Selected.
GHS: A Performance Prediction and Task Scheduling System for Grid Computing Xian-He Sun Department of Computer Science Illinois Institute of Technology.
A Prediction-based Real-time Scheduling Advisor Peter A. Dinda Prescience Lab Department of Computer Science Northwestern University
1 Algorithms for Bandwidth Efficient Multicast Routing in Multi-channel Multi-radio Wireless Mesh Networks Hoang Lan Nguyen and Uyen Trang Nguyen Presenter:
Client-Server Computing in Mobile Environments
1 Efficient Management of Data Center Resources for Massively Multiplayer Online Games V. Nae, A. Iosup, S. Podlipnig, R. Prodan, D. Epema, T. Fahringer,
Network File System (NFS) in AIX System COSC513 Operation Systems Instructor: Prof. Anvari Yuan Ma SID:
23 September 2004 Evaluating Adaptive Middleware Load Balancing Strategies for Middleware Systems Department of Electrical Engineering & Computer Science.
COnvergence of fixed and Mobile BrOadband access/aggregation networks Work programme topic: ICT Future Networks Type of project: Large scale integrating.
Alok 1Northwestern University Access Patterns, Metadata, and Performance Alok Choudhary and Wei-Keng Liao Department of ECE,
Client-controlled QoS Management in Networked Virtual Environments Patrick Monsieurs, Maarten Wijnants, Wim Lamotte Expertise Center for Digital Media.
Adaptability for flexible mobile service provision in 3G and beyond Nikos Houssos
Network Aware Resource Allocation in Distributed Clouds.
Low-Power Wireless Sensor Networks
An Integration Framework for Sensor Networks and Data Stream Management Systems.
Ohio State University Department of Computer Science and Engineering 1 Cyberinfrastructure for Coastal Forecasting and Change Analysis Gagan Agrawal Hakan.
A Distributed Clustering Framework for MANETS Mohit Garg, IIT Bombay RK Shyamasundar School of Tech. & Computer Science Tata Institute of Fundamental Research.
Chapter 6 Multiprocessor System. Introduction  Each processor in a multiprocessor system can be executing a different instruction at any time.  The.
A performance evaluation approach openModeller: A Framework for species distribution Modelling.
Scheduling policies for real- time embedded systems.
Covilhã, 30 June Atílio Gameiro Page 1 The information in this document is provided as is and no guarantee or warranty is given that the information is.
OPERETTA: An Optimal Energy Efficient Bandwidth Aggregation System Karim Habak†, Khaled A. Harras‡, and Moustafa Youssef† †Egypt-Japan University of Sc.
Plethora: A Wide-Area Read-Write Storage Repository Design Goals, Objectives, and Applications Suresh Jagannathan, Christoph Hoffmann, Ananth Grama Computer.
1 BRUSSELS - 14 July 2003 Full Security Support in a heterogeneous mobile GRID testbed for wireless extensions to the.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
Performance of Adaptive Beam Nulling in Multihop Ad Hoc Networks Under Jamming Suman Bhunia, Vahid Behzadan, Paulo Alexandre Regis, Shamik Sengupta.
November 4, 2003Applied Research Laboratory, Washington University in St. Louis APOC 2003 Wuhan, China Cost Efficient Routing in Ad Hoc Mobile Wireless.
Self-stabilizing energy-efficient multicast for MANETs.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Improving System Availability in Distributed Environments Sam Malek with Marija Mikic-Rakic Nels.
Network Weather Service. Introduction “NWS provides accurate forecasts of dynamically changing performance characteristics from a distributed set of metacomputing.
Hierarchical Management Architecture for Multi-Access Networks Dzmitry Kliazovich, Tiia Sutinen, Heli Kokkoniemi- Tarkkanen, Jukka Mäkelä & Seppo Horsmanheimo.
1 / 21 Providing Differentiated Services from an Internet Server Xiangping Chen and Prasant Mohapatra Dept. of Computer Science and Engineering Michigan.
1 Traffic Engineering By Kavitha Ganapa. 2 Introduction Traffic engineering is concerned with the issue of performance evaluation and optimization of.
Courtesy Piggybacking: Supporting Differentiated Services in Multihop Mobile Ad Hoc Networks Wei LiuXiang Chen Yuguang Fang WING Dept. of ECE University.
Optimization-based Cross-Layer Design in Networked Control Systems Jia Bai, Emeka P. Eyisi Yuan Xue and Xenofon D. Koutsoukos.
Performance Comparison of Ad Hoc Network Routing Protocols Presented by Venkata Suresh Tamminiedi Computer Science Department Georgia State University.
Optimizing Distributed Actor Systems for Dynamic Interactive Services
Introduction to Load Balancing:
User Interference Effect on Routing of Cognitive Radio Ad-Hoc Networks
Transparent Adaptive Resource Management for Middleware Systems
Qi Han, Matthew Ba Nguyen Sandy Irani, Nalini Venkatasubramanian
High Throughput Route Selection in Multi-Rate Ad Hoc Wireless Networks
Provision of Multimedia Services in based Networks
Web switch support for differentiated services
Load Balancing in Distributed Systems
Quality-aware Middleware
QoS routing Finding a path that can satisfy the QoS requirement of a connection. Achieving high resource utilization.
Towards Predictable Datacenter Networks
Presentation transcript:

A Cost Driven Approach to Information Collection for Mobile Environments Qi Han Nalini Venkatasubramanian Department of Information and Computer Science University of California-Irvine

Quality of Service enhanced resource management at all levels - storage management, networks, applications, middleware QoS Aware Information Infrastructure QoS Enabled Wide Area Network Battlefield Visualization Battlefield Visualization Data servers Collaborative Multimedia Application Mobile hosts Data servers

Motivation Advanced level of tetherless mobile multimedia services requires The development of a wireless network that supports integrated multimedia services Focus of prior work The development of intelligent network management middleware services that provides agile interfaces to mobile multimedia services Our objective: to provide support for mobility and QoS management at the middleware layer independent of the underlying specific network architecture

QoS-based Resource Provisioning Issues Effective middleware infrastructure that must adapt to changing network conditions Resource provisioning algorithms that utilize current system resource availability information to ensure that applications meet their QoS requirements Additional Challenges In mobile environments, system conditions are constantly changing Maintaining accurate and current system information is important to efficient execution of resource provisioning algorithms

The Information Collection Problem Goal To provide information good enough for resource provisioning tasks such as admission control, load balancing etc. Need an information collection mechanism that is aware of multiple levels of imprecision in data is aware of quality requirements of applications makes optimum use of the system (network and server) resources while tolerating imprecision of the information Collected Parameters Network link status, Data server capacity (Remote disk bandwidth, Processor capacity), Mobile host status

Directory Enabled Network Information Collection Provide directory service as an information base for QoS- provisioning algorithms feasible servers for requests, available network and server resources Uses distributed probes to monitor traffic and collect dynamic load state information Directory Enabled Information Collection Information Acquisition Directory Organization and Manipulation Approximation and Cost Scalability: Hierarchical directory organization + Caching

Former Information Collection Approaches for Non-mobile Environments Instantaneous snapshot based techniques (SS) Monitoring module samples residue capacity of network link periodically and updates directory with latest value Static range based intervals Partition link capacity into static intervals and update directory with the interval number Throttle (TR) the directory holds a range-based representation of the monitored parameter, with upper and lower bounds that can vary dynamically Time Series (MA) time series models are used to predict future trends in sample values with some defined level of confidence

Challenges in Information Collection Problem for Mobile Environments Inherent tradeoff between information accuracy and system performance Solutions for non-mobile environments are not appropriate for mobile environments Increased dynamicity Constant change of client access points to fixed network

Our Approach Dynamic range-based representation Mobile host Aggregation driven collection Source and consumer-initiated triggers and updates 2 phase information collection process Address the tradeoff between accuracy of directory information and the update overhead costs for mobile environments

Information Source Information Mediator Information Consumer Information Collection Framework Server selectionMobility management QoS managementMobile QoS management Location managementInformation collection mobile host fixed host serverrouter Information Repository …

Components of Information Collection Framework Information source Managed entities: server, link, mobile or stationary host… Information consumer Consumers data collected from sources Information mediator Decision point of the information collection Information repository Holds system state information about sources

AutoSeC (Automatic Service Composition) Framework

Aggregate Mobility Model X region Region i Mobile host j at (x j (t),y j (t)) Y max X max Aggregation of Region i at time t: Y region

Resource Utilization Factor Resource utilization factor for network links: Resource utilization factor for servers:

Generalized Aggregation Based Information Collection (Gen-ABIC) Use a range R:=[L,U] to represent the monitored parameter Phase 1: Derives the aggregate mobility patterns Utilizes the aggregation status and current resource utilization status to adjust the collection parameters such as sampling frequency SF and range size R Phase 2: Utilizes feedback from the sources (source-initiated triggers and updates) and consumers (consumer-initiated triggers and updates) for further customization of the collection process

Information mediator State Diagram of Information Collection Process Directory service Regular probing Range relaxation Change confirmed Range tightening Change confirmed Range adjustment Current range Noise filtering Value out of range: source-initiated trigger Thrashing avoidance Accuracy not enough: consumer-initiated trigger Information source Information consumer New range New range: consumer-initiated update New range: source-initiated update

Cost Factors in an Information Collection Process Regular sampling overhead C rs Regular directory update overhead C ru Source/consumer-initiated trigger overhead C st and C ct Source/consumer-initiated directory update overhead C su and C cu consumer mediator source C rs C st C ct C cu C ru C su Directory service

Optimal Range Size to Minimize the Cost To minimize the overall cost, a good range size is needed to reduce the need for further updates To avoid source-initiated triggers and updates, R should be big enough P st =K st /R 2, P su =K su /R 2 To avoid consumer-initiated triggers and updates, R should be small enough P ct =K ct *R, P cu =K cu *R To minimize Cost :

The CDIC Algorithm CDIC Algorithm( ) /* invoked periodically */ /* Phase 1 : aggregation driven coarse-grained adjustment of parameters /* Compute host aggregation level; Compute resource utilization level; switch ( resource utilization) { case high: set SF and R to be minimum; case low: set SF and R to be minimum; case medium: increase/decrease SF and R based on current aggregation level; } /* Phase 2 : fine-grained adjustment of range size */ Calculate K st, K su, K ct, K cu based on monitored cost factors appropriately; Set R to be optimal which minimizes the cost.

Issues of CDIC The model parameters such as P st, P su, P ct, P ct need to be monitored Monitoring complexity affects the system performance to a great extent User QoS may be compromised Utilizing mobile host aggregation status to drive the information collection process could sacrifice some individual requests’ QoS, but overall system performance is improved

Optimized Cost Driven Information Collection (Opt-CDIC) Further reduce communication overhead without sacrificing the overall QoS Selective triggering Turn off consumer-initiated triggering Lazy sampling Reduce sampling frequency when The number of source-initiated triggers in a given period is less than a pre-determined value The range is relaxed to exceed a certain value

Simulation Environments Request model Request arrival as a Poisson distribution Request holding time is exponentially distributed Traffic model Uniform pattern Non-uniform pattern Mobility model Incremental individual mobility model High mobility and low mobility Four Scenarios High mobilityLow mobility Uniform trafficHM-UTLM-UT Non-uniform trafficHM-NUTLM-NUT

Simulation Objectives Analyze the impact of information collection mechanisms on the overall resource provisioning performance Information collection mechanisms SS, SR, TR, Gen-ABIC, CDIC, Opt-CDIC Resource provisioning algorithm CPSS (Comined Path and Server Selection) Performance Metrics Request completion ratio Overhead involved Overall efficiency

Simulation Results (Comparison of SS, SR, TR, Gen-ABIC under HM-NUT) Completion ratio Gen-ABIC shows the highest completion ratio SS, SR and TR exhibit similar completion ratios Overhead Increases with the increase of the number of requests SS introduces the highest overhead, while Gen-ABIC has the least overhead Overall Efficiency Gen-ABIC shows the highest overall efficiency

Simulation Results (Comparison of SS, SR, TR, Gen-ABIC under HM-NUT)

Simulation Results (Comparison of Gen-ABIC, CDIC and Opt-CDIC under HM-NUT) For completion ratio Gen-ABIC is marginally higher than Opt-CDIC, but much higher than CDIC Decreases with an increase of the number of requests in the system For overhead CDIC is the highest, and Opt-CDIC is the lowest For overall efficiency Opt-CDIC is the highest

Simulation Results (Comparison of Gen- ABIC, CDIC and Opt-CDIC under HM-NUT)

Simulation Results (Comparison of Gen- ABIC, CDIC and Opt-CDIC under LM-UT)

Conclusions Coarse assignment of collection parameters (e.g. SF and R) is adequate to render satisfactory completion ratios under most traffic workloads and mobility patterns Optimization of turning off consumer-initiated triggers and lazy sampling help reduce overhead to a great extent without lowering the completion ratio Therefore, Opt-CDIC is a desirable strategy to collect network and server information in mobile environments

Future Work Enhance AutoSeC for mobile environments by integrating Opt-CDIC with the other resource provisioning algorithms Develop a scalable information collection architecture suitable for wide-area environments that incorporates distributed directory services