1. M ULTIMEDIA I SSUES Professor Saad Haj Bakry, PhD, CEng, FIEE N ETWORK A RCHITECTURE

2. C ONTENTS Saad Haj Bakry Network Architecture D EVELOPMENT S TANDARDS G ROUPS T RAFFIC S TREAMS M ULTIMEDIA S ERVICES S ERVICES R EQUIREMENTS M ULTIMEDIA C OMPRESSION P ERFORMANCE I SSUES Multimedia Issues B ANDWIDTH / C APACITY S UGGESTED W ORK

3. D EVELOPMENT M ULTIMEDIA W ORKSTATIONS: HQ Audio Video Coding & Display Saad Haj Bakry Network Architecture H IGHER S PEED UTP LAN S UPPORT ATM O PTICAL F IBRE C ABLES N EW M OBILE R ADIO S YSTEMS F IXED C ELLULAR S YSTEMS: Radio Links C OMPRESSION Multimedia Issues

4. B ANDWIDTH / C APACITY Saad Haj Bakry Network Architecture D RAW C URVE ( C / B, S / N ) Multimedia Issues

5. ITU / ATM F ORUM S TANDARDS G ROUPS Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services JPEG / MPEG IMA / MMCF

6. ITU / ATM F ORUM I NTERNATIONAL T E LECOMMUNICATION U NION “ ITU ” : Radio: ITU-R Telecom.: ITU-T Develop.: ITU-D I NTERNATIONAL T E LECOMMUNICATION U NION “ ITU ” : Radio: ITU-R Telecom.: ITU-T Develop.: ITU-D A SYNCHRONOUCE T RANSFER M ODE F ORUM An Industrial Group (Telephone Companies / Computer Vendors) to Guide the Future of ATM Saad Haj Bakry Network Architecture Standard Groups Multimedia Issues

7. JPEG / MPEG J OINT P HOTOGRAPHIC E XPERT G ROUP: Compression Standards for Still (Photographic) Pictures J OINT P HOTOGRAPHIC E XPERT G ROUP: Compression Standards for Still (Photographic) Pictures Saad Haj Bakry Network Architecture M OTION P ICTURE E XPERT G ROUP: Compression Standards for Motion Pictures (Video / Audio) M OTION P ICTURE E XPERT G ROUP: Compression Standards for Motion Pictures (Video / Audio) Standard Groups Multimedia Issues

8. IMA / MMCF I NTERACTIVE M ULTIMEDIA A SSOCIATION Saad Haj Bakry Network Architecture M ULTI M EDIA C OMMUNICATIONS F ORUM Promoting multimedia applications and communications. Reducing barriers to the widespread use of multimedia technology Promoting multimedia applications and communications. Reducing barriers to the widespread use of multimedia technology Standard Groups Multimedia Issues

9. M ESSAGING S ERVICES R ETRIEVAL S ERVICES C ONVERSATIONAL S ERVICES D ISTRIBUTION S ERVICES M ULTIMEDIA S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services

10. M IXED D OCUMENT: Text / Graphics / Still, Moving Pictures / Voice Annotation D OCUMENT M AIL S ERVICE M ESSAGING S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services

11. B ROADBAND V IDEOTEX: Remote Education / News / Tele-Shoping V IDEO R ETRIEVAL: Entertainment R ETRIEVAL S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services M IXED D OCUMENT R ETRIEVAL: Archives.. H IGH- R ESOLUTION I MAGE R ETRIEVAL: Medical Images D ATA R ETRIEVAL: Tele-Software

12. B ROADBAND V IDEOTELEPHONY / V IDEOCONFERENCING V IDEO S URVEILLANCE C ONVERSATIONAL S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services H IGH S PEED T ELE F AX / T ELE A CTION H IGH R ESOLUTION I MAGE C OMMUNICATION

13. Q UALITY TV D ISTRIBUTION: NTSC / PAL / SECAM TV: P AY PER V IEW E LECTRONIC P UBLISHING D ISTRIBUTION S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services N EWS R ETRIEVAL V IDEO D ISTRIBUTION

14. CBR / DBR VBR / SBR AB R UBR T RAFFIC S TREAMS Saad Haj Bakry Network Architecture Multimedia Issues

15. CBR : C ONSTANT B IT R ATE: ATM F ORUM DBR : D ETERMINISTIC B IT R ATE: ITU-T D EFINITION: Requires fixed amount of bandwidth to be continuously available during connection ’ s lifetime. E XAMPLE: 64 kbps Speech Connection Circuit in Circuit Switching E XAMPLE: 64 kbps Speech Connection Circuit in Circuit Switching Saad Haj Bakry Network Architecture Traffic Streams Multimedia Issues

16. VBR : V ARIABLE B IT R ATE: ATM F ORUM SBR : S TATISTICAL B IT R ATE: ITU-T VBR R EAL T IME: with real time requirements, such as Real Time Videoconferencing D EFINITION: Requires variable / changing banwidth Saad Haj Bakry Network Architecture VBR N ON R EAL T IME : Such as Multimedia E-mail Traffic Streams Multimedia Issues

17. ABR : A VAILABLE B IT R ATE B OTH: ATM F ORUM / ITU-T C OMPROMISE B ETWEEN: Capacity to handle peak load (low utilization at times / higher cost). Minimal capacity (congestion, lower cost) D EFINITION: For “ Bursty Traffic ” whose banwidth range is roughly known Saad Haj Bakry Network Architecture E XAMPLE : Web Browsing Traffic Streams Multimedia Issues

18. UBR : U NSPECIFIED B IT R ATE: ATM F ORUM D EFINITION: Traffic with low cost objective / No performance promises Saad Haj Bakry Network Architecture E XAMPLE : Background Traffic such as E-Mail File Transfer Traffic Streams Multimedia Issues

19. E VALUATIONS Saad Haj Bakry SERVICES CHARACTERISTICS Network Architecture ABRUBRVBR- NRT VBR- RT CBR Optio nal NYYY N Y Y N Y N N Y N Y N N Y N N BW Guarantee RT Traffic Bursty Traffic Cong. Feedback Traffic Streams Multimedia Issues

20. S ERVICES S ERVICES S ERVICES R EQUIREMENTS: (1/2) Saad Haj Bakry Network Architecture V IDEOCONFERENCING B ROADBAND V IDEOTEX / R ET D OCUMENT T RANSFER / R ET D ATA T RANSMISSION P EAK: (Mbps) B URSTNESS: Peak / Average 1-100 1-50 1-10 1-50 1-20 1-5 1-20 Multimedia Issues

21. S ERVICES S ERVICES S ERVICES R EQUIREMENTS: (2/2) Saad Haj Bakry Network Architecture TV C ONTRIBUTION 3D M OVING I MAGES HDTV D ISTRIBUTION TV D ISTRIBUTION P EAK: (Mbps) B URSTNESS: Peak / Average 1-5 30 / More up to 100 100 (s) 1 1 1 1 1 1 1 1 Multimedia Issues

22. A UDIO S TANDARDS V IDEO S TANDARDS D ATA S TANDARDS V IDEO C HARACTERISTICS M ULTIMEDIA C OMPRESSION Saad Haj Bakry Network Architecture Multimedia Issues

23. A UDIO S TANDARDS Saad Haj Bakry C ASE Network Architecture C OMPRESSED kbps UN-COMP. kbps BW kHz 192153620 7 3.2 CD A UDIO FM S TEREO W IDEBAND A UDIO PCM 15128 64 1536 128 64 Compression Multimedia Issues

24. V IDEO C HARACTERISTICS Saad Haj Bakry Network Architecture A CTIVITIES IN THE C APTURED S CENE R EQUIRED Q UALITY F RAMES / S EC: 25 / 75 I NTERLACING L INES / F RAME: P IXELS / L INE: B ITS / P IXEL: 8 / 24 VGA: 640x480 SVGA: 800x600 XGA:1024x768 x (25)x(24) = 742 Mbps VGA: 640x480 SVGA: 800x600 XGA:1024x768 x (25)x(24) = 742 Mbps Compression Multimedia Issues

25. U SING MPEG-1 S TANDARDS Saad Haj Bakry Network Architecture C ASE COMPRE SSED NON- COMPRES. XxY Array 4 / 9 Mbps83 Mbps720x480 41 Mbps 20.5 Mbps TV Quality Cable TV Quality Low Rate Videoconference Quality 360x480 360x240 30 Frames / Second 8 bits / sample : pixel 2 / 4 Mbps 384 kbps / 1.5 Mbps Compression Multimedia Issues

26. D ATA S TANDARDS Saad Haj Bakry C ASE: 8.5"x11" Network Architecture Non-Compressed Mbps 0.029 ASCII Text Color Page Medium Res. High Res. Graphics Qual. Compression Ratio 2 / 4 10 / 20 90 359 1436 5744 Compression Multimedia Issues

27. B ASIC P RINCIPLES P ERFORMANCE R EQUIREMENTS P ERFORMANCE I SSUES Saad Haj Bakry Network Architecture Multimedia Issues

28. I MPORTANCE OF “ N ATURAL F EEL ” & “ U SER S ATISFACTION ” D ELAY S ENSITIVITY: End- to-End Deviation from Average (Jitter) Audio / Video “ Lip Synchronization D ELAY S ENSITIVITY: End- to-End Deviation from Average (Jitter) Audio / Video “ Lip Synchronization B ASIC P RINCIPLES Saad Haj Bakry Network Architecture Performance Issues Multimedia Issues L OSS S ENSITIVITY: Bit Error Rate: BER / ATM Cell-Loss Rate: CLR

29. R EAL T IME A UDIO / V IDEO E ND-TO- E ND D ELAY: 100 - 200 millisecond P ERFORMANCE R EQUIREMENTS Saad Haj Bakry Network Architecture Performance Issues Multimedia Issues E ND-TO- E ND J ITTER D ELAY: Less than 250 microsecond A UDIO / V IDEO D IFFERENTIAL D ELAY: (-20)-(+40) millisecond O BJECT R ETRIEVAL R ESPONSE: 1-2 seconds D OCUMENT B ROWSING: 0.5 second A CCEPTABLE L OSS: 1 cell every 40 min - 1 hour

30. C ODING / C OMPRESSION T ECHNIQUES C OMPLETE M ULTIMEDIA T RANSACTIONS S UGGESTED W ORK Saad Haj Bakry Network Architecture Multimedia Issues D ETAILED S TANDARDS P ERFORMANCE E VALUATION M ETHODS E NCRYPTION I SSUES C OMMUNICATION S YSTEMS

31. R EFERENCES: 1/2 Saad Haj Bakry Network Architecture Multimedia Issues A. S. Tanenbaum, Computer Networks, 3rd Ed., Prentice Hall, 1996 W. Stallings, High Speed Networks: TCP/IP & ATM Design Principles, Prentice Hall, 1998 R. Handel, M.N. Huber, S. Schroder ATM Networks: Concepts, Protocols, Applications, 3rd Ed., Addison-Wesley, 1998

32. R EFERENCES: 2/2 Saad Haj Bakry Network Architecture Multimedia Issues R. Lloyd-Evans, Wide Area Network Performance and Optimization, Addison Wesley, 1996 D. Ginsburg, ATM Solutions for Enterprise Internetworking, Addison Wesley, 1996 R. R. Roy, Networking Constraints in Multimedia Conferencing and The Role of ATM Networks, AT&T Technical Journal, Vol. 73, No.4, July / Augest 1994, pp. 97-108