2. Streaming technologies: Under the hood Egon Verharen Innovatie management SURFnet bv Egon.Verharen@SURFnet.NL

3. 2 TERENA Networking Conference 2000 Contents Digital Video family –Similarities en Differences What is streaming and why streaming media? Technology –what do you need formats, standards, server, clients, network –demo (forseable) Future Lessons learned Content Management

4. 3 TERENA Networking Conference 2000 Pieces of the puzzle Why digital video in education Collaborative tools Conferencing tools Multimedia archives live event streaming webbased virtual classroom

5. 4 TERENA Networking Conference 2000 Digital Video: Similarities and Differences Video Conferencing Video chat Like a telephone call Two - Way Call up or Answer typical bitrates from 56 kb/s - 1,5 mb/s Video format (H.261, H.263, MPEG) transport protocol (RTP) fast network connection QoS (min. delay, min. jitter, synchronisation Video Broadcasting Streaming/Webcasting Like watching Television One - Way Tune In or enter URL typical bitrates from 28 kb/s - 8 mb/s Video format (H.261, H.263, MPEG) transport protocol (RTP) fast network connection QoS (jitter, synchronisation) -Network video

6. 5 TERENA Networking Conference 2000 What & Why Streaming Media “Streaming” is buzz-word. –an adjective Many definitions/definotions –Push vs. Pull –Client-oriented vs. server-oriented –on-demand vs. live Streaming media: the ‘real-time’ playing of a video-, audio- and/or datastream on a machine from the moment the first bytes come in. content IT TelCo

7. 6 TERENA Networking Conference 2000 Streaming: live vs on-demand archiverealtime unicast multicast VoD Event- driven scheduled

8. 7 TERENA Networking Conference 2000 Why streaming? (download times) Bandwidthtransport time (650 MB) 2400 bit/s631 hrs (26 days and 7 hrs) 9600 bit/s158 hrs (6 days and 14 hrs) 2,5 Mbit/s34 min 10 Mbit/s8 min and 40 sec 34 Mbit/s2 min and 33 sec 155 Mbit/s 32 sec 1 Gbit/s 5 sec 1 Gbit/s = 1.000 Mbit/s = 1.000.000 kbit/s = 1.000.000.000 bit/s

9. 8 TERENA Networking Conference 2000 Streaming media advantages data does not need to be downloaded; high bitrate make high (video)quality possible; you can jump ahead (or back) in stream (‘vcr principle’); you can broadcast/netcast live; suitable for tele-educatie, –but also information delivery.

10. 9 TERENA Networking Conference 2000 Digitale Video QoS myth NO, you can start now ! QoS for end-users = bigger picture, better audio. QoS for network = delay, packet loss, jitter Requirements differ per application: – interactivity vs streaming, minimal delay/jitter ? Quality is function of many parameters –client, LAN, campus, access links to PoP, within PoP, natl & int.l. networks “DV cannot be implemented without QoS technology (which is new, complex, expensive and over the horizon)”

11. 10 TERENA Networking Conference 2000 Quotes & Provocations by Dennis Glenn, NWU “Tape is dead” “Delivery is king” “Quality is not important” –quality of video –QoS “Exposure is everything” –Content is worth nothing if you don’t show it

12. 11 TERENA Networking Conference 2000 Analog Digital CostsValue Digital Content management: driving forces LARGE archives Everywhere and always access Create once, distribute/use many Save and secure for (re)use

13. 12 TERENA Networking Conference 2000 Developments in the content chain Program maker Internet provider Website owner Internet host Channel Cable- operator Distributer Telecom operator Author Broadcast organisation Publisher Users/Viewer

14. 13 TERENA Networking Conference 2000 Merging of the chains Contentmanager Distribution media A/V/D-material End-users Format conversion classification logical ordering

15. 14 TERENA Networking Conference 2000 Video-over-IP value chain $$ Content use $ $ Content deployment (content distribution/ content delivery) Media production 1011011 Content management Encoding

16. 15 TERENA Networking Conference 2000 Workflow TV “broadcast” via internet “Dynamic” services example: DelayTV NED1Online Encoding Batching NOS A DatabaseA 5 min to 3 hrs Staging SpottingEnhancing Installatie Videoserver Onlin e disk2tape Validatie Mass Archive E x p o rt Installatie DB/Webserver 30 hrs encoded video plus metadata each day! By Ton van Mil, director NOB-interactive Content management cycle

17. 16 TERENA Networking Conference 2000 disk2tape Workflow TV “broadcast” via internet “Dynamic” services example: News NED1Online Encoding Installatie Videoserver Installatie DB/Webserver Onlin e disk2CD Batching Validatie NOS Programma Database 3 hrs Staging SpottingEnhancing E x p o rt NOS Newsroom NOB graphics Mass Archive Archief By Ton van Mil, director NOB-interactive Content management cycle

18. 17 TERENA Networking Conference 2000 VIP platform components End user Basic deployment Advanced deployment Content management Basic Content production Advanced Content production Metadata MPEG7 User metadata provision Accounting server Reversed content provision

19. 18 TERENA Networking Conference 2000 Streaming media service content creation –producers, editors, encoders content mgt –db mgt, META-DATA, indexing&searching content delivery –dynamic streaming (more than one bandwidth), license control, synchr. Multimedia, –scalability (caching & replication) content viewing –softw based players, MPEG2 hw based players, browser plugin and external helper apps.

20. 19 TERENA Networking Conference 2000 Technology standards, formats –still new codecs (e.g. MPEG4, IBMs LBR) streaming servers and clients network

21. 20 TERENA Networking Conference 2000 Formats Aspects: –Bitrates (constant, variable) –Framesize –QoS Bandwidth (at end-user) dynamic use: Real SureStream, simulcast Standards –ISO/IEC (int.l. org for standardization/int.l. electrotechnical commission) Moving Pictures Experts Group (ISO/IEC JTC1/SC29/WG11) MPEG1,2,4,7 –ITU (int.l. telecommunication union) Series H (video), Series G (audio) (ITU-T SG16)

22. 21 TERENA Networking Conference 2000 Formats (cont.: MPEG) MPEG1 1,5 mb/s; VHS; part3=audio=MP3 MPEG2 6-8 mb/s; digitale TV MPEG4 lower bitrate (better compr.); multimedia appl. layers (transparent info), content protection, QoS MPEG7 metadata model ‘on top of’ MPEG1/2/4; searching, filtering, processes

23. 22 TERENA Networking Conference 2000 Formats (cont.: Video en Audio) Video –ITU-T Series H - Audiovisual and multimedia systems –H.261 H.263 –DV (Digital Video) Audio –MP3 = MPEG-1 audio layer 3 –Series G - Transmission systems and media, digital systems and networks –G711, 722, 723.1, 726, 728, 729

24. 23 TERENA Networking Conference 2000 Protocols Streaming Media Protocols are protocols that are being used to support the real-time delivery of multimedia data TCP vs. UDP HTTP –progressive download RTP –real time protocol –UDP –payload

25. 24 TERENA Networking Conference 2000 Protocols (cont.: RTSP) RTSP –Real Time Streaming Protocol designed to be an open standard aims to provide an extensible framework to enable controlled delivery of real-time data, such as audio and video. Denk: videocontrole (play, pauze, stop, back, forward) –http://www.ietf.org/rfc/rfc2326.txt

26. 25 TERENA Networking Conference 2000 Distribution Scenario’s –Broadcast vs. Groupcast vs. Personcast (Video-on- demand) Technology –Unicast –Multicast cookbook

27. 26 TERENA Networking Conference 2000 What do you need Streaming server –on-demand/live; program manager; asset mgt –data pump –encoders (can be separate) Streaming client –Fast PC –decoder (up to MPEG1: software, MPEG2 prefer. hardware) –monitor Network connection –MPEG-1 (VHS-qual/CD):  2 Mbit/s guaranteed end-to-end ! –UDP/IP –multicast Connectivity end-user determintes format (bitrate)

28. 27 TERENA Networking Conference 2000 Streaming servers & Clients Architectures –Real –Windows Media –Quicktime “High-end” –Kasenna Mediabase, Oracle Videoserver –(not yet) Broadcast servers ! Others –FVC I-studio, IBM Videocharger, Cisco IP/TV, … Clients –almost all dedicated ! –Not (yet) interoperable

29. 28 TERENA Networking Conference 2000 Architectures RealMedia –codecs: RealVideo, RealAudio –streaming formaat: RealVideo, RealAudio, met plugins (bijv. BitCasting) MPEG1, MP3 –SureStream: multiple bitrate encodings, bandwidth negotiation –RealText, RealPix –SMIL (Synchronized Multimedia Integration Language) –Standards: RTSP, RTP (RDP)

30. 29 TERENA Networking Conference 2000 Architectures (cont.) Apple Quicktime –supports many codecs streaming RTP payloads; Sorensen: VBR, CBR –streaming format: Quicktime (hinted movies) –plug-in architecture –tracks & effects & interactivity –standards: RTSP, RTP

31. 30 TERENA Networking Conference 2000 Architectures (cont.) Microsoft Windows Media Technologies –NetShow, DirectShow/ActiveMovie, Video for Windows –codecs: Windows Media Audio (WMA), MPEG-4 v3, ACELP (voice) –streaming format: ASF (advanced streaming format) –Multi-Datarate Encoding, Intelligent Transmission, Media rights –standards: ??; WMM –office integration !! (e.g. streaming powerpoint) –Most ‘compatible’ client (player)

32. 31 TERENA Networking Conference 2000 Codecs –MPEG1, MPEG2, MPEG4 –MP3 = MPEG-1 audio layer 3 –Qualcomm PureVoice –Qdesign Music (stereo audio for dialup data rates en fast processor) –a2b (AAC, high fidelity, faster data rates, encryption) –liquid audio (arch., AAC, hifi, encryption, licensing, watermarking) –java based: emblaze, GTS –Sorensen (video, both dialup and cable modem data rates) –Vivo (VIV), Vxtreme (VXF), VDOnet –http://www.terran.com/CodecCentral/

33. 32 TERENA Networking Conference 2000 Servers Aspects –storage –media pump –network (bandwidth) –on-demand vs. live –asset management ! Examples (not complete !!) –Architectures Apple Quicktime, Real G2, Microsoft Windows Media –“high end” IP streamers (live/on-demand) Cisco IP/TV, IBM Videocharger, Kasenne Mediabase, Oracle Videoserver –broadcast servers Sony,Philips, SUN,..., AXCENT INSERT –frameworks SUN & IBM Java Media Framework

34. 33 TERENA Networking Conference 2000 Servers (cont.: Examples) –“high end” FVC.COM I-Studio Cisco IP/TV –standards support IBM Videocharger –Digital Library; architectuer; interactivity –standards support Kasenna (formerly SGI) Mediabase Ncube/Oracle MediaCUBE/Videoserver... Frameworks –SUN & IBM Java media framework –unified architecture for the playback, synchronization, capture, transmission and transcode of media -- including streaming audio and video -- across most major operating systems

35. 34 TERENA Networking Conference 2000 Clients Aspects –Buffer –Synchronisation –Multicast Examples –FVC.COM I-viewer –Cisco IP/TV viewer –IBM Videocharger client –Apple Quicktime client –Microsoft Windows Media Player –Mbone tools SDR, Vic, Rat, …

36. 35 TERENA Networking Conference 2000 What does streaming mean for your network ?

37. 36 TERENA Networking Conference 2000 All problems solved ? NO ! Open issues –standaards protocol implementations –RTP, RTSP –formats MPEG program/system/transport streams Metadata –filesystems –network multicast Quality of Service (QoS) –content delivery

38. 37 TERENA Networking Conference 2000 Rights issues Rights organisations see “On demand” as the highest service level possible and therefore demand high compensation Rights organisations (in NL) are nog (yet) qualified for –TV rights –Film –News, Sport Models for slice payments are missing [YMMV]

39. 38 TERENA Networking Conference 2000 Lessons learned Audio and data often more important than Video –scenario dependent Image quality and refresh-rate still no problem with Internet users –compare tv viewers –Connectivity end-user determines format (bitrate) Multicast –Commercialisation needed Content ! –Refresh services

40. 39 TERENA Networking Conference 2000 Streaming services at your screen Do not underestimate technology involved –recording, encoding, network, storage, distribution Navigation for the end-user is important Automate the workflow Know in advance what to do with the material afterwards –does it stay online, storage, re-distribute Don’t forget the rights ! Warning: it is expensive (still) Always subcontract large applications/services

41. 40 TERENA Networking Conference 2000 Future Quality –MPEG2 (both streaming & conferencing); DV format -> HDTV –QoS/Classes of Service Contents –3D (e.g.. VRML, QuicktimeVR) –Metadata (MPEG7) Codecs –fractal; VBR Standards –RTP/RTSP, incl. Authenticatie; MPEG4 & MPEG7 Efficiency –multicast: data too; content delivery (caching & replication) New applications –gnutella More streaming servers/clients –better access networks –media & asset management

42. 41 TERENA Networking Conference 2000 Come forward: TF-STREAM Who has experience ? –which tools, what have you done –plans for content creation, mgt, deployment Ideas: how can this (new) technology be put to work in projects –at your institute –between institutes, organisations, NRNs,... TF-STREAM –http://www.terena.nl/task-forces/tf-stream/ –streaming@terena.nl (majordomo@terena.nl subscribe)

43. 42 TERENA Networking Conference 2000 Demo streaming SURFnet-TV –1. FVC I-studio –2. IBM Videocharger –3. Cisco IP/TV –Real –Quicktime –WindowsMedia SNOB/Snelnet –SGI Mediabase –Compcore player FUNET-TV US: –ICAIR –ResearchChannel –Vanderbilt Univ.

44. 43 TERENA Networking Conference 2000 URLs (background info) http://stream.surfnet.nl/ http://contact.surfnet.nl/ http://www.surfnet.nl/diensten/seminars/surfnet-sec/streaming/ http://skin.surfnet.nl/video-audio/index.html http://www.surfnet.nl/innovatie/surfworks/showcase/ http://www.surfnet.nl/innovatie/surfworks/streaming/surfnettven.html http://www.surfnet-tv.nl/ http://dv.internet2.edu/ http://dv.internet2.edu/videospace/index.html http://www.researchchannel.com/ http://www.vide.net/