1. Application, Network and Link Layer Measurements of Streaming Video over a Wireless Campus Network Passive & Active Measurement Workshop 05 Boston, MA, April 1 st, 2005 Feng Li, Jae Chung, Mingzhe Li, Huahui Wu, Mark Claypool, Bob Kinicki {lif,goos,lmz,flashine,claypool,rek}@cs.wpi.edu Computer Science Department Worcester Polytechnic Institute Worcester, MA, 01609 USA

2. PAM – April 1 st, 2005 2 Outline Introduction Experimental Methods –Tools and Setup –Experimental Design Results and Analysis Conclusions and Future work

3. PAM – April 1 st, 2005 3 Motivation Increasingly, deployment of streaming multimedia over wireless LANs –Hardware price decreasing. –Wireless link capacity increasing: 11Mbps(802.11b), 54Mbps(802.11g). –Streaming techniques becoming mature.

4. PAM – April 1 st, 2005 4 Objectives Correlate performance for –Wireless Link Layer –Network Layer –Application Layer Characterize –Streaming Video Parameters

5. PAM – April 1 st, 2005 5 Outline Introduction Experimental Methods –Tools and Setup –Experimental Design Results and Analysis Conclusions and Future work

6. PAM – April 1 st, 2005 6 WPI Campus Network LayerToolsPerformance Measures ApplicationMedia TrackerFrame rate, Frame Lost, Encoding bit rate NetworkUDP Ping, WgetRound-Trip time, Packet loss rate, Throughput WirelessTypeperf, WRAPISignal Strength, Frame Retries, Capacity.

7. PAM – April 1 st, 2005 7 Experimental Parameters Three access points (AP) –Three AP’s on three different floors in the WPI CS Department. Three different reception locations for each AP. –Good, Fair, Bad based on Windows Wireless signal strength indicator. Experiment period –Winter Break, Dec 23 – 25, Dec 28, 29, 2004

8. PAM – April 1 st, 2005 8 Experimental Methods Each Experiment instance consists of –1 Initial TCP bulk download –8 Videos 2 Clips: High Motion and Low Motion 2 Encoding method –Single Level at 2.5M bps –Multiple Level, 11 levels, max 2.5 M bps. 2 Protocols: TCP and UDP –1 Final TCP bulk download Total: 360 video streaming 360 = 3 APs * 3 Locations * 8 videos * 5 repetitions

9. PAM – April 1 st, 2005 9 Outline Introduction Experimental Methods –Tools and Setup –Experimental Design Results and Analysis Conclusions and Future work

10. PAM – April 1 st, 2005 10 High Level Analysis TCP Streaming UDP StreamingTotal Multiple Level Video8685171 Single Level Video8990179 Subtotal175 350 Data Collected 10 data sets were removed from the 360 video runs due to wireless connection failure. TCP Streaming UDP StreamingTotal Multiple Level Video86 + 485 + 5171 Single Level Video89 + 190179 Subtotal175 350

11. PAM – April 1 st, 2005 11 Signal Strength Analysis Fig.2. Fig.3.

12. PAM – April 1 st, 2005 12 Wireless Retry Fraction Figure 8 (modified) : Wireless Retry Fraction for Upstream Traffic

13. PAM – April 1 st, 2005 13 TCP vs UDP Analysis: Frame Rate Figure 6: Frame Rate for TCP and UDP Streaming

14. PAM – April 1 st, 2005 14 TCP vs UDP Analysis : Round Trip Time Figure 10: Network Round Trip Time for TCP and UDP Streaming

15. PAM – April 1 st, 2005 15 TCP vs UDP Analysis: Duration Figure 11: Normalized Playout Duration for TCP and UDP Streaming

16. PAM – April 1 st, 2005 16 Multiple vs Single Analysis: Frame Rate Figure 4: Frame Rate for Multiple and Single Level Encoding

17. PAM – April 1 st, 2005 17 Multiple vs Single Analysis: Encoding Rate Fig.14 Encoding Bit Rate vs Wireless Link Capacity

18. PAM – April 1 st, 2005 18 Conclusions At Good wireless reception locations: –Nearly all the video clips played out at a high Frame Rate. –The treatment choices for streaming a video of multiple or single encoding levels and TCP or UDP protocols do not significantly impact performance.

19. PAM – April 1 st, 2005 19 Conclusions At Bad wireless reception locations: –Multiple level video streams adapt better than single level streams. –Videos streamed using TCP play out at a higher average frame rate than the same video streamed using UDP. –The play out duration for TCP videos is significantly longer than UDP videos.

20. PAM – April 1 st, 2005 20 Future work To develop new application layer techniques to identify and adapt to challenging wireless transmission situations. To study the behavior at the AP and the interaction of concurrent clients. To concurrently capture burst loss behavior at multiple protocol levels. To evaluate other commercial streaming products: Realplayer TM and Quick time TM player.

21. Application, Network and Link Layer Measurements of Streaming Video over a Wireless Campus Network Passive & Active Measurement Workshop 05 Feng Li, Jae Chung, Mingzhe Li, Huahui Wu, Mark Claypool, Bob Kinicki {lif,goos,lmz,flashine,claypool,rek}@cs.wpi.edu CS Department at Worcester Polytechnic Institute Worcester, MA, 01609 USA Thank You!

22. PAM – April 1 st, 2005 22 Appendix: Encoding Bit Rate vs Wireless Link Capacity

23. PAM – April 1 st, 2005 23 TCP vs UDP Analysis: Network Loss Rate Figure 9: Network Loss Rate for TCP and UDP Stream