Presentation is loading. Please wait.

Presentation is loading. Please wait.

Doc.: IEEE 802.11-13/1407r0 SubmissionSlide 1 Simulation Based Study of QoE Date: 2013-11-12 Authors: Chao-Chun Wang, MediaTek Nov. 2013 NameAffiliationsAddressPhoneEmail.

Published byEleanor Payne Modified over 8 years ago

Similar presentations

Presentation on theme: "Doc.: IEEE 802.11-13/1407r0 SubmissionSlide 1 Simulation Based Study of QoE Date: 2013-11-12 Authors: Chao-Chun Wang, MediaTek Nov. 2013 NameAffiliationsAddressPhoneEmail."— Presentation transcript:

1 doc.: IEEE 802.11-13/1407r0 SubmissionSlide 1 Simulation Based Study of QoE Date: 2013-11-12 Authors: Chao-Chun Wang, MediaTek Nov. 2013 NameAffiliationsAddressPhoneEmail ChaoChun WangMediaTekSan Jose, CA, USA+1-408-526-1899chaochun.wang@mediatek.com Jianhan LiuMediaTekSan Jose, CA, USAjianhan.liu@mediatek.com James YeeMediaTekHsinchu, Taiwanjames.yee@mediatek.com Thomas PareMediaTekSan Jose, CA, USAthomas.pare@mediatek.com James WangMediaTekSan Jose, CA, USAjames.wang@mediatek.com

2 doc.: IEEE 802.11-13/1407r0 Submission Overview In HEW we have highlighted Quality of Experience (QoE) in the context of dense deployments[1]. What definition of QoE is meaningful to the end user? –QoE is application specific and involves more than just MAC/PHY –QoE is Per-user but can be viewed in Aggregate too –QoE depends on more than STA density but also degree of concurrent application network access With a useful definition, how do we proceed with the development of HEW? –Using web browsing as an application, we present preliminary simulation results to illustrate QoE and QoE metrics. Propose that we establish baseline application simulation scenarios for the purpose of evaluating HEW proposals. Chao-Chun Wang, MediaTekc Nov. 2013

3 doc.: IEEE 802.11-13/1407r0 Submission Simulation Approach There are various approaches to simulate network load under different user applications. We propose to use captured real application traffic load and use them to drive MAC/PHY simulations. –We chose Web Browsing as an example application and captured real traffic statistics. For MAC/PHY simulation we used a commercial discrete event simulator (estinet[2]) which allows us to use captured traffic load, Linux TCP/IP stack, Apache Server and focus on the effects of MAC/PHY behavior. –Your choice of simulation tools may vary. Slide 3 Nov. 2013 Chao-Chun Wang, MediaTekc

4 doc.: IEEE 802.11-13/1407r0 Submission QoE Metrics Selection Slide 4 For Web Page Access, it is well recognized that the QoE depends on Web Page Delays. –From [4]: “Relatively small increases in delay can have a profound impact on how users react to Web sites.” and –“…problems associated with delay will still be present even with the increased use of high-speed connections.” and –“Fundamentally, if the designer’s goal is to promote a positive attitude [QoE], the site delay should be kept below 8 seconds.” Using Web Page Access Delay as the metric for QoE, we simulate the impact of various network configurations on the QoE. Chao-Chun Wang, MediaTek Nov. 2013

5 doc.: IEEE 802.11-13/1407r0 Submission Web Page Traffic Simulation Capture data from eight randomly selected actual web sites 1.www.estinet.com - (33 files, 2.4 MB)www.estinet.com 2.tw.msn.com - (71 files, 773 KB) 3.www.pchome.com.tw - (129 files, 1.2 MB)www.pchome.com.tw 4.www.amazon.com - (52 files, 985 KB)www.amazon.com 5.www.businessweekly.com.tw - (115 files, 5.4 MB)www.businessweekly.com.tw 6.www.feib.com.tw - (58 files, 1 MB)www.feib.com.tw 7.www.thsrc.com.tw - (74 files, 1.9 MB)www.thsrc.com.tw 8.www.trtc.com.tw - (68 files, 2.1 MB)www.trtc.com.tw Simulate the concurrent access of these captured web site files from a Server –For each page access, use WGET[3] over HTTP/TCP/IP to access files sequentially from an Apache Server local to a simulated AP. –All STAs start contend for channel access at the same time and continue to do so till the completion of the download. This is the worst case scenario. –Per Page Access delay is the duration from initiating the access of the 1 st file until the last file of the site is received. Slide 5Chao-Chun Wang, MediaTek Nov. 2013

6 doc.: IEEE 802.11-13/1407r0 Submission Simulation Scenarios and Tool Scenario –MAC/PHY Configuration: 802.11n infrastructure BSS with varying # of STAs contending –Topology: STAs distributed in grid fashion Tools: Estinet, TCPDump for analysis of simulation results. Parameters –AP TxPower = 24 dBm –STA TxPower = 21 dBm –Channel Model = SISO_Model_D_80211n –Data Rate = 150 Mbps (40MHz_64QAM_CC5/6_GI400ns) – No rate adaptation –Primary Channel = 36 (5180MHz) –Secondary Channel = 40 (5200MHz) –No bit error considered – Still an ideal case –LongRetryLimit = 4 –ShortRetryLimit = 7 –AP back haul link is 100 M Slide 6Chao-Chun Wang, MediaTek Nov. 2013

7 doc.: IEEE 802.11-13/1407r0 Submission Simulation Set Up - Topology Exemplary Topology Slide 7Chao-Chun Wang, MediaTek Nov. 2013

8 doc.: IEEE 802.11-13/1407r0 Submission Simulation Results – Validate using 1 STA Simulate 1 STA accessing the sites individually –Why are the web session throughput so low? –Examine the timing distribution in accessing the first site using tcpdump The TCP protocol overhead for setting up 33 connections sequentially takes more than 60% of the total time Excluding TCP handshakes, the data portion only took 0.303 sec and approximately equal to a throughput of ~78Mb Slide 8Chao-Chun Wang, MediaTek Nov. 2013

9 doc.: IEEE 802.11-13/1407r0 Submission Simulation Data – 5 Runs with 16 STAs Slide 9Chao-Chun Wang, MediaTek Nov. 2013 Average Per Page Delay (sec) vs. STA #

10 doc.: IEEE 802.11-13/1407r0 Submission Simulation Data – 48 STAs Slide 10Chao-Chun Wang, MediaTek Simulation Data – 5 Runs with 48 STAs Nov. 2013 Average Per Page Delay (sec) vs. STA #

11 doc.: IEEE 802.11-13/1407r0 Submission Simulation Data – Aggregate Results Slide 11Chao-Chun Wang, MediaTek Nov. 2013 Avg Per Page Delay (sec) vs. Total # of STA 16 STAs 32 STAs 48 STAs64 STAs

12 doc.: IEEE 802.11-13/1407r0 Submission Observations & Conclusions Slide 12 QoE is determined by more than just MAC/PHY and is application dependent. An end-to-end system view is needed. –Every layer in the communication stack introduces overhead Are HEW MAC/PHY enhancements enough to address QoE? If HEW is to include QoE in its PAR, we should agree on the Application scenarios and System level assumptions. Simulation is an useful tool for evaluating proposals to meet QoE targets. QoE depends on Network Load, which is a function of STA Density and the Application. In general, for a given Application Scenario, how do we defines QoE and QoE metrics? –What metrics should be included from users’ perspective? –What metrics should be included from network designers’ perspective? Chao-Chun Wang, MediaTek Nov. 2013

13 doc.: IEEE 802.11-13/1407r0 Submission Strawpolls 1.Should HEW define application level scenarios for inclusion into the PAR? YES: NO: ABSTAIN: 2.For each application scenario, should defining QoE metrics to be evaluated using simulation be a goal? YES: NO: ABSTAIN: Shoukang Zheng, I2R Slide 13 May 2013

14 doc.: IEEE 802.11-13/1407r0 Submission References [1] 11-13-1366-02-0hew-some-propositions-to-progress- towards-the-par-definition.ppt [2] Estinet (http://www.estinet.com/)http://www.estinet.com/ [3] Gnu WGET (http://www.gnu.org/software/wget/)http://www.gnu.org/software/wget/ [4] Galletta, Dennis F.; Henry, Raymond; McCoy, Scott; and Polak, Peter (2004) "Web Site Delays: How Tolerant are Users?," Journal of the Association for Information Systems: Vol. 5: Iss. 1, Article 1. (http://aisel.aisnet.org/jais/vol5/iss1/1)http://aisel.aisnet.org/jais/vol5/iss1/1 Slide 14 Nov. 2013 Chao-Chun Wang, MediaTekc

15 doc.: IEEE 802.11-13/1407r0 Submission Backup Slide 15Chao-Chun Wang, MediaTekc

16 doc.: IEEE 802.11-13/1407r0 Submission Simulation Data – 32 STAs Slide 16Chao-Chun Wang, MediaTek

17 doc.: IEEE 802.11-13/1407r0 Submission Simulation Data – 64 STAs Slide 17Chao-Chun Wang, MediaTek Simulation Data – 64 STAs

Download ppt "Doc.: IEEE 802.11-13/1407r0 SubmissionSlide 1 Simulation Based Study of QoE Date: 2013-11-12 Authors: Chao-Chun Wang, MediaTek Nov. 2013 NameAffiliationsAddressPhoneEmail."

Similar presentations

Doc.: IEEE 802.11-14/0328r2 Submission Dense Apartment Complex Throughput Calculations Channel Selection and DSC Date: 2014-03 Authors: Graham Smith, DSP.

Doc.: IEEE /0328r2 Submission Dense Apartment Complex Throughput Calculations Channel Selection and DSC Date: Authors: Graham Smith, DSP.
Doc.: IEEE 802.11-11/1515r0 Submission November 2011 Timo Koskela, Renesas Mobile CorporationSlide 1 802.11ah Wi-Fi Offloading Considerations Date: 2011-11-6.

Doc.: IEEE /1515r0 Submission November 2011 Timo Koskela, Renesas Mobile CorporationSlide ah Wi-Fi Offloading Considerations Date:
Submission doc.: IEEE 11-14/0868r0 July 2014 Johan Söder, Ericsson ABSlide 1 UL & DL DSC and TPC MAC simulations Date: 2014-07-14 Authors:

Submission doc.: IEEE 11-14/0868r0 July 2014 Johan Söder, Ericsson ABSlide 1 UL & DL DSC and TPC MAC simulations Date: Authors:
Doc.: IEEE 802.11-15/0044r0 Submission Proposed Changes to Simulation Scenario Date: 2015/01/12 Takeshi Itagaki, Sony CorporationSlide 1 Authors: January.

Doc.: IEEE /0044r0 Submission Proposed Changes to Simulation Scenario Date: 2015/01/12 Takeshi Itagaki, Sony CorporationSlide 1 Authors: January.
Doc.: IEEE 802.11-13/1176r0 Submission Sep 2013 Reza Hedayat (Cisco Systems) Slide 1 Some Simulation Scenarios for HEW NameAffiliationPhoneEmail Reza HedayatCisco.

Doc.: IEEE /1176r0 Submission Sep 2013 Reza Hedayat (Cisco Systems) Slide 1 Some Simulation Scenarios for HEW NameAffiliationPhone Reza HedayatCisco.
Doc.: IEEE 802.11-14/0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for 802.11ax Date: 2014-05-12 Authors:

Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
Doc.: IEEE 802.11-11/1019r1 Submission July 2011 MediaTek, Inc Slide 1 Supporting Large Number of STAs in 802.11ah Date: 2011-07-20 Authors:

Doc.: IEEE /1019r1 Submission July 2011 MediaTek, Inc Slide 1 Supporting Large Number of STAs in ah Date: Authors:
Doc.: IEEE 802.11-15/568r0 Submission Frequency Selective Scheduling (FSS) for TGax OFDMA May 2015 Slide 1 Date: 2015-05-11 Authors: Kome Oteri (InterDigital)

Doc.: IEEE /568r0 Submission Frequency Selective Scheduling (FSS) for TGax OFDMA May 2015 Slide 1 Date: Authors: Kome Oteri (InterDigital)
Doc.: IEEE 802.11-14/0861r0 SubmissionSayantan Choudhury Impact of CCA adaptation on spatial reuse in dense residential scenario Date: 2014-07-14 Authors:

Doc.: IEEE /0861r0 SubmissionSayantan Choudhury Impact of CCA adaptation on spatial reuse in dense residential scenario Date: Authors:
Doc.: IEEE 802.11-14/1443r0 SubmissionEsa Tuomaala Adapting CCA and Receiver Sensitivity Date: 2014-11-03 Authors: Slide 1 November 2014.

Doc.: IEEE /1443r0 SubmissionEsa Tuomaala Adapting CCA and Receiver Sensitivity Date: Authors: Slide 1 November 2014.
Doc.: IEEE 802.11-14/1420r1Nov 2014 Submission Po-Kai Huang (Intel) Slide 1 The Impact of Preamble Error on MAC System Performance Date: 2014-11-03 NameAffiliationsAddressPhoneEmail.

Doc.: IEEE /1420r1Nov 2014 Submission Po-Kai Huang (Intel) Slide 1 The Impact of Preamble Error on MAC System Performance Date: NameAffiliationsAddressPhone .
Doc.: IEEE 802.11-14/1221-01 Submission September 2014 Slide 1 Traffic Generator for OBSS Calibration Case Date: 2014-09-14 Authors: Chao-Chun Wang (MediaTek)

Doc.: IEEE / Submission September 2014 Slide 1 Traffic Generator for OBSS Calibration Case Date: Authors: Chao-Chun Wang (MediaTek)
Doc.: IEEE 802.11-14/1227r3 SubmissionSlide 1 OFDMA Performance Analysis Date: 2014-09-15 Authors: Tianyu Wu etc. MediaTek Sept 2014 NameAffiliationsAddressPhoneEmail.

Doc.: IEEE /1227r3 SubmissionSlide 1 OFDMA Performance Analysis Date: Authors: Tianyu Wu etc. MediaTek Sept 2014 NameAffiliationsAddressPhone .
Doc.: IEEE 802.11-14/0107 Jan 2014 SubmissionYonggang Fang et. al. (ZTE) HEW Evaluation Metrics Date: 2014-01-20 Slide 1 Authors: NameAffiliationAddressEmail.

Doc.: IEEE /0107 Jan 2014 SubmissionYonggang Fang et. al. (ZTE) HEW Evaluation Metrics Date: Slide 1 Authors: NameAffiliationAddress .
Doc.: IEEE 802.11-14/0116r0 SubmissionYakun Sun, et. Al.Slide 1 Long-Term SINR Calibration for System Simulation Date: 2014-01-20 Authors: NameAffiliationsAddressPhoneemail.

Doc.: IEEE /0116r0 SubmissionYakun Sun, et. Al.Slide 1 Long-Term SINR Calibration for System Simulation Date: Authors: NameAffiliationsAddressPhone .
Doc.: IEEE 802.11-12/0112r4 Submission Supporting Authentication/Association for Large Number of Stations September 2012 Slide 1 I2R Date: 2012-09-12.

Doc.: IEEE /0112r4 Submission Supporting Authentication/Association for Large Number of Stations September 2012 Slide 1 I2R Date:
Submission doc.: IEEE 11-14/0070r0 Jan 2014 Josiam et.al., SamsungSlide 1 Joint MAC/PHY Evaluation Methodology Date: 2014-01-23 Authors:

Submission doc.: IEEE 11-14/0070r0 Jan 2014 Josiam et.al., SamsungSlide 1 Joint MAC/PHY Evaluation Methodology Date: Authors:
Submission doc.: IEEE 11-14/0026r1 January 2014 Yong Liu, et al.Slide 1 Thoughts on HEW PAR Date: 2014-01-20 Authors:

Submission doc.: IEEE 11-14/0026r1 January 2014 Yong Liu, et al.Slide 1 Thoughts on HEW PAR Date: Authors:
Doc.: IEEE 802.11-13/0787r0 Submission July 2013 Wu TianyuSlide 1 Follow-up Discussions on HEW Functional Requirements Date: 2013-7-15 Authors:

Doc.: IEEE /0787r0 Submission July 2013 Wu TianyuSlide 1 Follow-up Discussions on HEW Functional Requirements Date: Authors:
Doc. No. IEEE 11-13-0847-00-0hew-r1 Submission July 2013 Klaus Doppler, NokiaSlide 1 Evaluation Criteria and Simulation Scenarios Date: July 16, 2013 Authors:

Doc. No. IEEE hew-r1 Submission July 2013 Klaus Doppler, NokiaSlide 1 Evaluation Criteria and Simulation Scenarios Date: July 16, 2013 Authors:

Similar presentations

Ads by Google