M ULTIMEDIA I SSUES Professor Saad Haj Bakry, PhD, CEng, FIEE N ETWORK A RCHITECTURE

C ONTENTS Saad Haj Bakry Network Architecture D EVELOPMENT S TANDARDS G ROUPS T RAFFIC S TREAMS M ULTIMEDIA S ERVICES S ERVICES R EQUIREMENTS M ULTIMEDIA C OMPRESSION P ERFORMANCE I SSUES Multimedia Issues B ANDWIDTH / C APACITY S UGGESTED W ORK

D EVELOPMENT M ULTIMEDIA W ORKSTATIONS: HQ Audio Video Coding & Display Saad Haj Bakry Network Architecture H IGHER S PEED UTP LAN S UPPORT ATM O PTICAL F IBRE C ABLES N EW M OBILE R ADIO S YSTEMS F IXED C ELLULAR S YSTEMS: Radio Links C OMPRESSION Multimedia Issues

B ANDWIDTH / C APACITY Saad Haj Bakry Network Architecture D RAW C URVE ( C / B, S / N ) Multimedia Issues

ITU / ATM F ORUM S TANDARDS G ROUPS Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services JPEG / MPEG IMA / MMCF

ITU / ATM F ORUM I NTERNATIONAL T E LECOMMUNICATION U NION “ ITU ” : Radio: ITU-R Telecom.: ITU-T Develop.: ITU-D I NTERNATIONAL T E LECOMMUNICATION U NION “ ITU ” : Radio: ITU-R Telecom.: ITU-T Develop.: ITU-D A SYNCHRONOUCE T RANSFER M ODE F ORUM An Industrial Group (Telephone Companies / Computer Vendors) to Guide the Future of ATM Saad Haj Bakry Network Architecture Standard Groups Multimedia Issues

JPEG / MPEG J OINT P HOTOGRAPHIC E XPERT G ROUP: Compression Standards for Still (Photographic) Pictures J OINT P HOTOGRAPHIC E XPERT G ROUP: Compression Standards for Still (Photographic) Pictures Saad Haj Bakry Network Architecture M OTION P ICTURE E XPERT G ROUP: Compression Standards for Motion Pictures (Video / Audio) M OTION P ICTURE E XPERT G ROUP: Compression Standards for Motion Pictures (Video / Audio) Standard Groups Multimedia Issues

IMA / MMCF I NTERACTIVE M ULTIMEDIA A SSOCIATION Saad Haj Bakry Network Architecture M ULTI M EDIA C OMMUNICATIONS F ORUM Promoting multimedia applications and communications. Reducing barriers to the widespread use of multimedia technology Promoting multimedia applications and communications. Reducing barriers to the widespread use of multimedia technology Standard Groups Multimedia Issues

M ESSAGING S ERVICES R ETRIEVAL S ERVICES C ONVERSATIONAL S ERVICES D ISTRIBUTION S ERVICES M ULTIMEDIA S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services

M IXED D OCUMENT: Text / Graphics / Still, Moving Pictures / Voice Annotation D OCUMENT M AIL S ERVICE M ESSAGING S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services

B ROADBAND V IDEOTEX: Remote Education / News / Tele-Shoping V IDEO R ETRIEVAL: Entertainment R ETRIEVAL S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services M IXED D OCUMENT R ETRIEVAL: Archives.. H IGH- R ESOLUTION I MAGE R ETRIEVAL: Medical Images D ATA R ETRIEVAL: Tele-Software

B ROADBAND V IDEOTELEPHONY / V IDEOCONFERENCING V IDEO S URVEILLANCE C ONVERSATIONAL S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services H IGH S PEED T ELE F AX / T ELE A CTION H IGH R ESOLUTION I MAGE C OMMUNICATION

Q UALITY TV D ISTRIBUTION: NTSC / PAL / SECAM TV: P AY PER V IEW E LECTRONIC P UBLISHING D ISTRIBUTION S ERVICES Saad Haj Bakry Network Architecture Multimedia Issues Multimedia Services N EWS R ETRIEVAL V IDEO D ISTRIBUTION

CBR / DBR VBR / SBR AB R UBR T RAFFIC S TREAMS Saad Haj Bakry Network Architecture Multimedia Issues

CBR : C ONSTANT B IT R ATE: ATM F ORUM DBR : D ETERMINISTIC B IT R ATE: ITU-T D EFINITION: Requires fixed amount of bandwidth to be continuously available during connection ’ s lifetime. E XAMPLE: 64 kbps Speech Connection Circuit in Circuit Switching E XAMPLE: 64 kbps Speech Connection Circuit in Circuit Switching Saad Haj Bakry Network Architecture Traffic Streams Multimedia Issues

VBR : V ARIABLE B IT R ATE: ATM F ORUM SBR : S TATISTICAL B IT R ATE: ITU-T VBR R EAL T IME: with real time requirements, such as Real Time Videoconferencing D EFINITION: Requires variable / changing banwidth Saad Haj Bakry Network Architecture VBR N ON R EAL T IME : Such as Multimedia Traffic Streams Multimedia Issues

ABR : A VAILABLE B IT R ATE B OTH: ATM F ORUM / ITU-T C OMPROMISE B ETWEEN: Capacity to handle peak load (low utilization at times / higher cost). Minimal capacity (congestion, lower cost) D EFINITION: For “ Bursty Traffic ” whose banwidth range is roughly known Saad Haj Bakry Network Architecture E XAMPLE : Web Browsing Traffic Streams Multimedia Issues

UBR : U NSPECIFIED B IT R ATE: ATM F ORUM D EFINITION: Traffic with low cost objective / No performance promises Saad Haj Bakry Network Architecture E XAMPLE : Background Traffic such as File Transfer Traffic Streams Multimedia Issues

E VALUATIONS Saad Haj Bakry SERVICES CHARACTERISTICS Network Architecture ABRUBRVBR- NRT VBR- RT CBR Optio nal NYYY N Y Y N Y N N Y N Y N N Y N N BW Guarantee RT Traffic Bursty Traffic Cong. Feedback Traffic Streams Multimedia Issues

S ERVICES S ERVICES S ERVICES R EQUIREMENTS: (1/2) Saad Haj Bakry Network Architecture V IDEOCONFERENCING B ROADBAND V IDEOTEX / R ET D OCUMENT T RANSFER / R ET D ATA T RANSMISSION P EAK: (Mbps) B URSTNESS: Peak / Average Multimedia Issues

S ERVICES S ERVICES S ERVICES R EQUIREMENTS: (2/2) Saad Haj Bakry Network Architecture TV C ONTRIBUTION 3D M OVING I MAGES HDTV D ISTRIBUTION TV D ISTRIBUTION P EAK: (Mbps) B URSTNESS: Peak / Average / More up to (s) Multimedia Issues

A UDIO S TANDARDS V IDEO S TANDARDS D ATA S TANDARDS V IDEO C HARACTERISTICS M ULTIMEDIA C OMPRESSION Saad Haj Bakry Network Architecture Multimedia Issues

A UDIO S TANDARDS Saad Haj Bakry C ASE Network Architecture C OMPRESSED kbps UN-COMP. kbps BW kHz CD A UDIO FM S TEREO W IDEBAND A UDIO PCM Compression Multimedia Issues

V IDEO C HARACTERISTICS Saad Haj Bakry Network Architecture A CTIVITIES IN THE C APTURED S CENE R EQUIRED Q UALITY F RAMES / S EC: 25 / 75 I NTERLACING L INES / F RAME: P IXELS / L INE: B ITS / P IXEL: 8 / 24 VGA: 640x480 SVGA: 800x600 XGA:1024x768 x (25)x(24) = 742 Mbps VGA: 640x480 SVGA: 800x600 XGA:1024x768 x (25)x(24) = 742 Mbps Compression Multimedia Issues

U SING MPEG-1 S TANDARDS Saad Haj Bakry Network Architecture C ASE COMPRE SSED NON- COMPRES. XxY Array 4 / 9 Mbps83 Mbps720x Mbps 20.5 Mbps TV Quality Cable TV Quality Low Rate Videoconference Quality 360x x Frames / Second 8 bits / sample : pixel 2 / 4 Mbps 384 kbps / 1.5 Mbps Compression Multimedia Issues

D ATA S TANDARDS Saad Haj Bakry C ASE: 8.5"x11" Network Architecture Non-Compressed Mbps ASCII Text Color Page Medium Res. High Res. Graphics Qual. Compression Ratio 2 / 4 10 / Compression Multimedia Issues

B ASIC P RINCIPLES P ERFORMANCE R EQUIREMENTS P ERFORMANCE I SSUES Saad Haj Bakry Network Architecture Multimedia Issues

I MPORTANCE OF “ N ATURAL F EEL ” & “ U SER S ATISFACTION ” D ELAY S ENSITIVITY: End- to-End Deviation from Average (Jitter) Audio / Video “ Lip Synchronization D ELAY S ENSITIVITY: End- to-End Deviation from Average (Jitter) Audio / Video “ Lip Synchronization B ASIC P RINCIPLES Saad Haj Bakry Network Architecture Performance Issues Multimedia Issues L OSS S ENSITIVITY: Bit Error Rate: BER / ATM Cell-Loss Rate: CLR

R EAL T IME A UDIO / V IDEO E ND-TO- E ND D ELAY: millisecond P ERFORMANCE R EQUIREMENTS Saad Haj Bakry Network Architecture Performance Issues Multimedia Issues E ND-TO- E ND J ITTER D ELAY: Less than 250 microsecond A UDIO / V IDEO D IFFERENTIAL D ELAY: (-20)-(+40) millisecond O BJECT R ETRIEVAL R ESPONSE: 1-2 seconds D OCUMENT B ROWSING: 0.5 second A CCEPTABLE L OSS: 1 cell every 40 min - 1 hour

C ODING / C OMPRESSION T ECHNIQUES C OMPLETE M ULTIMEDIA T RANSACTIONS S UGGESTED W ORK Saad Haj Bakry Network Architecture Multimedia Issues D ETAILED S TANDARDS P ERFORMANCE E VALUATION M ETHODS E NCRYPTION I SSUES C OMMUNICATION S YSTEMS

R EFERENCES: 1/2 Saad Haj Bakry Network Architecture Multimedia Issues A. S. Tanenbaum, Computer Networks, 3rd Ed., Prentice Hall, 1996 W. Stallings, High Speed Networks: TCP/IP & ATM Design Principles, Prentice Hall, 1998 R. Handel, M.N. Huber, S. Schroder ATM Networks: Concepts, Protocols, Applications, 3rd Ed., Addison-Wesley, 1998

R EFERENCES: 2/2 Saad Haj Bakry Network Architecture Multimedia Issues R. Lloyd-Evans, Wide Area Network Performance and Optimization, Addison Wesley, 1996 D. Ginsburg, ATM Solutions for Enterprise Internetworking, Addison Wesley, 1996 R. R. Roy, Networking Constraints in Multimedia Conferencing and The Role of ATM Networks, AT&T Technical Journal, Vol. 73, No.4, July / Augest 1994, pp