Modeling User Activities in a Large IPTV System Tongqing Qiu, Jun (Jim) Xu (Georgia Tech) Zihui Ge, Seungjoon Lee, Jia Wang, Qi Zhao (AT&T Lab – Research)

Slides:



Advertisements
Similar presentations
© Jim Barritt 2005School of Biological Sciences, Victoria University, Wellington MSc Student Supervisors : Dr Stephen Hartley, Dr Marcus Frean Victoria.
Advertisements

Technische Universität München + Hewlett Packard Laboratories Dynamic Workload Management for Very Large Data Warehouses Juggling Feathers and Bowling.
STATISTICS Joint and Conditional Distributions
STATISTICS Univariate Distributions
Wenke Lee and Nick Feamster Georgia Tech Botnet and Spam Detection in High-Speed Networks.
Sales Forecasting using Dynamic Bayesian Networks Steve Djajasaputra SNN Nijmegen The Netherlands.
Challenge the future Delft University of Technology Overprovisioning for Performance Consistency in Grids Nezih Yigitbasi and Dick Epema Parallel.
Towards Automating the Configuration of a Distributed Storage System Lauro B. Costa Matei Ripeanu {lauroc, NetSysLab University of British.
On Scheduling Vehicle-Roadside Data Access Yang Zhang Jing Zhao and Guohong Cao The Pennsylvania State University.
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science R3: Robust Replication Routing in Wireless Networks with Diverse Connectivity Characteristics.
Internet Measurement Conference 2003 Source-Level IP Packet Bursts: Causes and Effects Hao Jiang Constantinos Dovrolis (hjiang,
1 A. Sshaikh, A. Greenberg; Nov 01 UCSC Sigcomm IMW Experience in Black-box OSPF Measurement Aman Shaikh, UCSC Albert Greenberg, AT&T Labs-Research.
U NDERSTANDING D ATA C ENTER T RAFFIC C HARACTERISTICS Theophilus Benson 1, Ashok Anand 1, Aditya Akella 1, Ming Zhang 2 University Of Wisconsin – Madison.
Pacific Gas and Electric Company Long Term Procurement Plan Proceeding Renewable Integration Model Results and Model Demonstration October 22, 2010 Workshop.
1 DPAS II Process and Procedures for Teachers Developed by: Delaware Department of Education.
Year 6 mental test 10 second questions Numbers and number system Numbers and the number system, fractions, decimals, proportion & probability.
Making the System Operational
On Sequential Experimental Design for Empirical Model-Building under Interval Error Sergei Zhilin, Altai State University, Barnaul, Russia.
Watching Television Over an IP Network & TV-Watching Behavior Research presented by Weiping He.
1 The Impact of Buy-Down on Sell Up, Unconstraining, and Spiral-Down Edward Kambour, Senior Scientist E. Andrew Boyd, SVP and Senior Scientist Joseph Tama,
Doc.: IEEE /1216r1 Submission November 2009 BroadcomSlide 1 Internet Traffic Modeling Date: Authors: NameAffiliationsAddressPhone .
Pattern Finding and Pattern Discovery in Time Series
1 Mobility-Based Predictive Call Admission Control and Bandwidth Reservation in Wireless Cellular Networks Fei Yu and Victor C.M. Leung INFOCOM 2001.
Two-Market Inter-domain Bandwidth Contracting
Akamai Media Analytics: Driving Engagement
1 Quality of Service Issues Network design and security Lecture 12.
Taming User-Generated Content in Mobile Networks via Drop Zones Ionut Trestian Supranamaya Ranjan Aleksandar Kuzmanovic Antonio Nucci Northwestern University.
ACM CIKM 2008, Oct , Napa Valley 1 Mining Term Association Patterns from Search Logs for Effective Query Reformulation Xuanhui Wang and ChengXiang.
1 Sizing the Streaming Media Cluster Solution for a Given Workload Lucy Cherkasova and Wenting Tang HPLabs.
Communications Research Centre (CRC) Defence R&D Canada – Ottawa 1 Properties of Mobile Tactical Radio Networks on VHF Bands Li Li & Phil Vigneron Communications.
© 2005 AT&T, All Rights Reserved. 11 July 2005 AT&T Enhanced VPN Services Performance Reporting and Web Tools Presenter : Sam Levine x111.
IP Multicast Information management 2 Groep T Leuven – Information department 2/14 Agenda •Why IP Multicast ? •Multicast fundamentals •Intradomain.
1 Analysis of Random Mobility Models with PDE's Michele Garetto Emilio Leonardi Politecnico di Torino Italy MobiHoc Firenze.
Junchen Jiang (CMU) Vyas Sekar (Stony Brook U)
Scale Free Networks.
Squares and Square Root WALK. Solve each problem REVIEW:
1 Weiren Yu 1,2, Xuemin Lin 1, Wenjie Zhang 1 1 University of New South Wales 2 NICTA, Australia Towards Efficient SimRank Computation over Large Networks.
Forecasting using Discrete Event Simulation for the NZ Prison Population Dr Jason (Qingsheng) Wang Mr Ross Edney Ministry of Justice.
25 seconds left…...
We will resume in: 25 Minutes.
Chapter 15: Quantitatve Methods in Health Care Management Yasar A. Ozcan 1 Chapter 15. Simulation.
1 McGill University Department of Civil Engineering and Applied Mechanics Montreal, Quebec, Canada.
Introduction into Simulation Basic Simulation Modeling.
Diversity in Smartphone Usage MobiSys ‘10 June 17, 2010 UCLA, Microsoft, USC Hossein Falaki, Ratul Mahajan, Srikanth Kandula Dimitrios Lymberopoulos, Ramesh.
Traversing symmetric NAT with predictable port allocation function SIN 2014 Dušan Klinec, Vashek Matyáš Faculty of Informatics, Masaryk University.
1 Considering Priority in Overlay Multicast Protocols under Heterogeneous Environments Michael Bishop, Sanjay Rao – Purdue University Kunwadee Sripanidkulchai.
An Empirical Study of Real Audio Traffic A. Mena and J. Heidemann USC/Information Sciences Institute In Proceedings of IEEE Infocom Tel-Aviv, Israel March.
On the Self-Similar Nature of Ethernet Traffic - Leland, et. Al Presented by Sumitra Ganesh.
Distributed Servers Architecture for Networked Video Services S.-H. Gary Chan and Fouad Tobagi Presented by Todd Flanagan.
A Hierarchical Characterization of a Live Streaming Media Workload E. Veloso, V. Almeida W. Meira, A. Bestavros, S. Jin Proceedings of Internet Measurement.
A Hierarchical Characterization of a Live Streaming Media Workload IEEE/ACM Trans. Networking, Feb Eveline Veloso, Virg í lio Almeida, Wagner Meira,
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
Exploiting Virtualization for Delivering Cloud based IPTV Services Speaker : 吳靖緯 MA0G IEEE Conference on Computer Communications Workshops.
Can Internet Video-on-Demand Be Profitable? SIGCOMM 2007 Cheng Huang (Microsoft Research), Jin Li (Microsoft Research), Keith W. Ross (Polytechnic University)
1 Proxy-Assisted Techniques for Delivering Continuous Multimedia Streams Lixin Gao, Zhi-Li Zhang, and Don Towsley.
A stepwise approximation for estimations of multilevel hydraulic tests in heterogeneous aquifers PRESENTER: YI-RU HUANG ADVISOR: CHUEN-FA NI DATE:
Self-Similarity of Network Traffic Presented by Wei Lu Supervised by Niclas Meier 05/
Jesse E. Simsarian and Marcus Duelk Bell Laboratories, Alcatel-Lucent, Holmdel, NJ, 15th IEEE Workshop on Local and Metropolitan.
INFOCOM, 2007 Chen Bin Kuo ( ) Young J. Won ( ) DPNM Lab.
CHALLENGING SCHEDULING PROBLEM IN THE FIELD OF SYSTEM DESIGN Alessio Guerri Michele Lombardi * Michela Milano DEIS, University of Bologna.
Chapter 4 – Modeling Basic Operations and Inputs  Structural modeling: what we’ve done so far ◦ Logical aspects – entities, resources, paths, etc. 
Spatio-Temporal Modeling of Traffic Workload in a Campus WLAN Felix Hernandez-Campos 3 Merkouris Karaliopoulos 2 Maria Papadopouli 1,2,3 Haipeng Shen 2.
Multicast instant channel change in IPTV systems 1.
1 On the Levy-walk Nature of Human Mobility Injong Rhee, Minsu Shin and Seongik Hong NC State University Kyunghan Lee and Song Chong KAIST.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
LiTGen, a lightweight traffic generator: application to mail and P2P wireless traffic Chloé Rolland*, Julien Ridoux + and Bruno Baynat* * Laboratoire LIP6.
OPERATING SYSTEMS CS 3502 Fall 2017
Network Traffic Modeling
Modelling IPTV Services
Modelling IPTV Services
Presentation transcript:

Modeling User Activities in a Large IPTV System Tongqing Qiu, Jun (Jim) Xu (Georgia Tech) Zihui Ge, Seungjoon Lee, Jia Wang, Qi Zhao (AT&T Lab – Research)

Motivation Rapid deployment of IPTV – Triple-play package – Interactive capability and functional flexibility System design and engineering tasks for IPTV –E.g. evaluation of design options, system parameter tuning –Highly related to impact of the user activities State of the art –Conventional TV: no strong need –Unrealistic model (e.g. fixed rate Poisson) –Directly use real trace? Our goal –Realistic workload generator 2

Our Contributions Investigation of the user activities A series of mathematic models to capture underlying process Workload generator SIMULWATCH –A small number of parameters as input –Generate realistic trace –Not a predictor 3

Roadmap IPTV architecture overview & data set Empirical observation and modeling Workload generator Conclusion 4

Q1: Timing to turn on/off/ switch the channel Strong time-of-day effect Bursty around hour or half hour boundaries (not fixed rate Poisson) Bursty around hour or half hour boundaries (not fixed rate Poisson) 5 Time varying channel switching rate (per minute)

Model the time varying part: FFT Weibull distribution to capture the general trend. Replace (limited number of) bursty points with observation values. 6

Modeling the time varying part (cont.) 7 5 parameters used

Modeling the time varying part (cont.) Rate moderating function g(t) –Directly scaled from the aforementioned curves –Properties: Time of day property Normalization W is 86, 400 seconds, or 1 day 8

Q2: How long to stay on/off/tuned on a channel? - Very long tail - Off-session has a heavier tail than the on-session 9 ~ 5% of the on-sessions and off-sessions are over 1 day CCDF of session lengths

Model Session Length Distribution Mixture Exponential Model Parameter Estimation (EM, MLE) Insights –e.g. Channel-sessions n=3 three states: surfing, watching and idle 1/λi (inter arrival time) : 30sec, 40 min and 5 hours 10

Q3: Switch to which channel? Sequential-scanning vs. target-switching –56% vs. 44% –Sequential scanning is lower than our expectation Sequential scanning –Up vs. Down: 2:1 Target switching –? 11

Model Channel Popularity (Target Switching) 12

Roadmap IPTV architecture overview & data collection Empirical observation and modeling Workload generator Conclusion 13

Workload Generator SIMULWATCH Event-driven simulator –Timing to turn on and off –Timing to switch channel –Switch to which channel OFF 1 OFF 2 ON1 ON2 Branching probability Moderating function Base rate

Performance Evaluation Settings –2 millions STBs and 700 channels –One day synthetic trace –Compare with real trace on a date (different from training data) Comparison –Properties that we explicitly model –Properties that we do not explicitly model –A case study

Properties Explicitly Modeled - Example

Properties not explicitly modeled 17

Case Study Consider single router in one VHO, users connected Evaluate the bandwidth requirement for a router Bandwidth –Simultaneous multicast streams –Simultaneous unicast streams 18

Case Study - Unicast correlated channel switches at hour boundaries 19

Case Study - Multicast

Other results Multi-class modeling –Different users have different preferences –Stable stub groups –Enhance our workload generator

Conclusion In-depth analysis on –Time varying event rate, session duration, channel popularity, etc. Developed a series of models –Mixture exponential model, Fourier transform, etc. Construct a workload generator –Limited number of parameters to generate realistic trace. Future work –DVR related behavior –More interactive features 22

Thank you! Questions? 23