1. CS 414 - Spring 2011 CS 414 – Multimedia Systems Design Lecture 18 – Multimedia Session Protocols Klara Nahrstedt Spring 2011

2. Administrative HW1 deadline March 2, midnight 11:59pm  Individual effort!!! (take it as a midterm preparation) Midterm, March 7 11-11:50am in class  All topics/lectures until February 28, i.e., the material covered this week March 2 and 4 will not be on the midterm  You can bring calculator and 1 page of cheat-sheet (otherwise, exam is closed book, closed notes) Class on Friday, March 4 - discussion of midterm topics CS 414 - Spring 2011

3. Outline Multimedia Protocols – Standards  RTP/UDP/IP – Transmission Protocol  RTCP Control/Negotiation Protocol to RTP  RTSP – Control VOD Negotiation Protocol CS 414 - Spring 2011

4. Internet Multimedia Protocol Stack CS 414 - Spring 2011 AAL3/4 IP Version 4, IP Version 6 UDP Media encaps (H.264, MPEG-4) RTP ATM/Fiber Optics Ethernet/WiFi TCP SIP RTSPRSVPRTCP AAL5 KERNEL APPLICATION Layer 4 (Transport) Layer 3 (Network) Layer 2 (Link/MAC) Layer 5 (Session) MPLS DCCP

5. Service Requirements for Real- time Flows (Voice/Video) Sequencing Intra-media synchronization Inter-media synchronization Payload identification Frame indication CS 414 - Spring 2011

6. Real-time Transmission Protocol (RTP) RTP provides end-to-end transport functions suitable for real-time audio/video applications over multicast and unicast network services RTP companion protocol – Real-time Transport Control Protocol (RTCP) CS 414 - Spring 2011 RTPRTCP User Datagram Protocol Internet Protocol Ethernet 802.13 or Wi-Fi 802.11 PHY (Wired or Wireless) Layer 4

7. Relation between RTP and RTCP CS 414 - Spring 2011 DecodingCoding RTPRTCP UDP/IP Application CodingDecoding RTCPRTP UDP/IP Application

8. RTCP: Control and Management Out-of-band control information for RTP flow.  Monitors QoS for RTP in the delivery and packaging of multimedia data  Used periodically to transmit control packets to participants in a streaming multimedia session.  Provides feedback on the quality of service being provided by RTP.quality of service  Gathers statistics on media connection Bytes sent, packets sent, lost packets, jitter, feedback and round trip delay.jitter round trip delay Application may use this information to increase the quality of service, perhaps by limiting flow or using a different codec. CS 414 - Spring 2011

9. RTCP Functions There are several type of RTCP packets:  Sender report packet,  Receiver report packet,  Source Description RTCP Packet,  Goodbye RTCP Packet and  Application Specific RTCP packets. RTCP itself does not provide any flow encryption or authentication means. SRTCP protocol can be used for that purpose.SRTCP CS 414 - Spring 2011

10. RTP Services Payload Type Identification  Determination of media coding  Source identification  RTP works with Profiles Profile defines a set of payload type codes and their mappings to payload formats Sequence numbering  Error detection Time-stamping  Time monitoring, synchronization, jitter calculation Delivery monitoring CS 414 - Spring 2011

11. RTP Message MAC header IP header UDP header RTP messageIPUDP CS 414 - Spring 2011 0 0101 0202 0303 0404 0505 0606 0707 0808 0909 10101 1212 1313 1414 1515 1616 1717 1818 1919 2020 21212 2323 2424 2525 2626 2727 2828 2929 3030 3131 VerPXCCMPTSequence Number Timestamp SSRC CSRCCSRC [0..15] ::: Ver – Version 2 P – Padding X – Extension, if set, the fixed head is followed by exactly one header extension CC – CSRC count M – Marker – intended to allow significant events such as frame boundaries to be marked (defined by profile) PT – Payload type SSRS – synchronization source, CSRC – contribution source

12. RTP Services – Support of Heterogeneity Mixer service  Allows for resynchronization of incoming audio packets  Reconstructs constant 20 ms spacing generated by sender  Mixes reconstructed audio streams into single stream  Translates audio encoding to lower bandwidth  Forwards lower bandwidth packet streams Translator service  Allows for translation between IP and other high speed protocols  May change encoding data CS 414 - Spring 2011

13. Difference between Mixers and Translators CS 414 - Spring 2011 S1 S2S4 S3 R1 M1 T M2

14. Payload Formats Static Payload formats  Established in RTP Profile  Payload type 0 := µ-law audio codec Dynamic Payload formats  Applications agree per session on payload format  H.263, JPEG, MPEG CS 414 - Spring 2011

15. Session Management (Layer 5) Important part of multimedia communication Separates control aspects from transport aspects CS 414 - Spring 2011 Participant Management Media control Session Control Conference control Configuration control Session Control Protocol (e.g., RTSP) video audio whiteboard Presentation data communication Continuous data communication SESSION MANAGER

16. Session Manager Tasks:  Membership control  Monitoring of shared workspace  Coordination of Media control management  Exchange of QoS parameters  Conference control management – establishment, modification, termination CS 414 - Spring 2011

17. Session Control Session Described by  Session state Name of session, start, valid policies Session management – two steps for state processing  Establishment of session  Modification of session CS 414 - Spring 2011

18. Session Control Conference Control  Centralized or distributed approach Media Control  Synchronization Configuration Control  Negotiation of QoS parameters, admission control and reservation/allocation of resources Membership Control  Invitation of users; registration of users, change of membership CS 414 - Spring 2011

19. Real-Time Streaming Protocol (RTSP) Application Protocol for Control of multimedia streams This is not an application data transmission protocol, just remote control protocol between client and server CS 414 - Spring 2011 SERVER CLIENT RTP RTSP Session Control Audio video Coder Audio Video Decoder

20. RTSP Approved as Internet Draft, February 2, 1998, authors H. Schulzrinne, A. Rao, R. Lanphier Enables controlled, on-demand delivery of real- time data such as audio and video Intends to control multiple data delivery sessions Provides means for choosing delivery channels  UDP  Multicast UDP,  TCP CS 414 - Spring 2011

21. RTSP Methods RequestDirectionDescription OPTIONSS CDetermine capabilities of server (S) or client (C) DESCRIBEC -> SGet description of media stream ANNOUNCES CAnnounce new session description SETUPC -> SCreate media session RECORDC -> SStart media recording PLAYC -> SStart media delivery PAUSEC -> SPause media delivery REDIRECTS -> CUse other server TEARDOWNC -> SDestroy media session SET_PARAMETERS CSet server or client parameter GET_PARAMETERS CRead server or client parameter CS 414 - Spring 2011

22. RTSP Extensions Timing  RTSP needs to hide latency variations  PLAY request may contain information about when request is to be executed Three types of timestamps  SMPTE (the same as in TV production) Format: hours:minutes:seconds:frames  Normal play time Measured relative to beginning of stream and expressed in ours, minutes, seconds and fractions of second  Absolute time Wall clock CS 414 - Spring 2011

23. Conclusion RTP usage – in several application audio and video tools (vat, vic) RTP follows the principle of application level framing and integrated layer processing RTP/UDP/IP is being used by the current streaming session protocols such as RTSP Session protocols are actually negotiation/session establishment protocols that assist multimedia applications Multimedia applications such as QuickTime, Real Player and others use them CS 414 - Spring 2011