Visible Light Video Sequences Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM Applications

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 2 DICOM from X-Ray to VL Radiology / Diagnosis Visible image / Therapy

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 3 Main Visible Light Modalities Microsurgery Rigid Endoscopy Flexible Endoscopy

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 4 The Current Demand Presentation Publication Reporting Education

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 5 Surgery and Intra Body Diagnosis PRE POST

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 6 In Association with Other Images

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 7 From Still Images to Video Clips Digital video sequences: –Replacing analogue tapes –For post operation reporting –Carefully selected clips Archiving on DVD or Server Without workflow disturbance Associated to report for referring physicians Minimizing the retrieval time –Including sound (environment, comments)

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 8 Today’s VHS Situation Safe Area Medical VHS

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 9 Digital Video Evolution Safe Area MPEG, DVD, VCD, DiVX DV

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 10 Emerging Proprietary Solutions Safe Area MPEG, DVD, VCD, DiVX MPEG

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 11 DICOM Proposition DICOM Network Ethernet DICOM CD Safe Area PACS DICOM Workstations Hospital Information System <- Worklist Patient data

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 12 WEB RADIOLOGY PACS ARCHIVE Workload PACS

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 13 The Video Signal PAL is the analogue TV transmission standard used in Europe, and throughout many parts of the world. A uncompressed PAL TV (25 f/s) picture produces a massive 216 Mbit/sec bit stream The U.S. uses an analogue TV system called NTSC. This system provides less precise color information, and a different frame rate (30 f/s). An uncompressed NTSC signal requires slightly less transmission capacity at 168 Mbit/sec. Data rates becomes even higher when one realizes a High Definition TV (HDTV) picture requires a raw bandwidth exceeding 1 Gbit/sec (1000 Mbit/sec).

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 14 MPEG Discussion about compression of video 1988 ISO/IEC Moving Picture Experts Group 1992 MPEG-2 (TV) and MPEG-3 (HDTV) combined 1993 MPEG-2 Main profile defined, compatible with MPEG ISO MPEG-2 Systems Definition 1997 First interactive Digital Video Broadcast service using MPEG Digital Versatile Disk (DVD) using MPEG Definition of the DVB Multimedia Home Platform (MHP) 2002 Availability of real time MPEG-2 DVD R writers

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 15 Other MPEG standards MPEG-1, a standard for storage and retrieval of moving pictures and audio on storage media MPEG-2, for digital video MPEG-4, for multimedia applications (~DivX) MPEG-7, content representation standard for information search MPEG-21 to define a multimedia framework

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 16 Why MPEG-2 Open, established standard Compatibility to DVD and Networks Low cost technology base Family inter-operability & flexibility Scalable bit rates Industry Support… and STABLE ?

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 17 MPEG-2 Dissemination Systems which now use MPEG-2 is extensive and continuously growing: –Digital TV (cable, satellite and terrestrial broadcast) –Video on Demand –Digital Versatile Disc (DVD) –Personal Computing –Card Payment, test and measurement, etc.

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 18 MPEG-2 Compression Video compression which is backwards compatible with MPEG-1 Full-screen interlaced and/or progressive video (for TV and Computer displays) Enhanced audio coding (high quality, mono, stereo, and other audio features) Transport multiplexing (combining different MPEG streams in a single transmission stream) Other services (GUI, interaction, encryption, data transmission, etc)

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 19 MPEG-2 Group of Pictures (GOP)

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 20 MPEG-2 provides a way to compress the digital video signal to a manageable bit rate. MPEG-2 Compression

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 21 MPEG-2 Levels & Profiles Profile = quality of the video Level = resolution of the video The basic system is known as Main Profile Main Level which covers video compression to 1-15 Mbps.

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 22 Profile Table Level Table Compatibility  720 x 576 x 25 fps (PAL CCIR 601)  352 x 576 x 25 fps (PAL Half-D1)  720 x 480 x 30 fps (NTSC CCIR 601)  352 x 480 x 30 fps (NTSC Half-D1)

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 23 MPEG-2 MP 4:2:0 Image format

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 24 DICOM WG13 MPEG2 Work Item Several face to face meetings, mainly in Europe, and t-cons Supplement 42: MPEG2 Video Sequence Transfer Syntax Supplement 47: Visible Light Video Sequences Plan to finalize the supplements end 2003, for balloting early in 2004

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 25 DVD based media exchange profile The DVD writers (~350€) and DVD-R media (~2€) are really accessible CD is more and more accepted and used for image distribution and « portable archive » DICOM sup 80 will be balloted soon WG13 proposes to: –Use the sup 80 format with VL SOP + potential Key Object Selection for « key » sequences –Add an informative annex suggesting how to create a « dual format » DVD containing the DICOM data and a Video DVD of the acquired / selected sequences for the distribution to the patient / referring physician

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 26 video DVD video DVD « Dual Format » DICOM / video DVD video DVD video DVD VIDEO-TS Key Object Selection directory titles, overlays Key Object Selection MPEG2 sequence DICO M data DICOMDIR Key Object Selection DICOM MPEG2 sequence

Thiem, Rorive & Cordonnier DICOM 20 th Anniversary Conference / Video page 27 Conclusion The demand for digital video recording in Visible Light Imaging is emerging DICOM will contribute to harmonize the different products MPEG2 is the best compromise Network transfer and DVD media exchange To be adopted in VL in a couple of months Could be applicable elsewhere (US…)