1. 1 Part A Multimedia Production Chapter 2 Multimedia Basics - 2.4 Digitization, Coding-decoding and Compression Information and Communication Technology “Multimedia Production and Web Site Development”

2. Ch 2.4 Digitization, Coding-decoding and Compression 2 Digitization, coding-decoding and compression

3. Ch 2.4 Digitization, Coding-decoding and Compression 3 Understand the meaning of digitization, coding-decoding and compression

4. Ch 2.4 Digitization, Coding-decoding and Compression 4

5. 5 Table of Contents 1.Overview of Digitization 2.Coding-decoding 3.Types of Compression 4.Current Standards of Multimedia Compression

6. Ch 2.4 Digitization, Coding-decoding and Compression 6

7. 7 1. Overview of digitization What is digitization? A process of converting analog information into a digital format Information is organized into discrete binary units of data (0 or 1) Information is stored into computer Text and Graphic digitization Use scanner, digital camera or other capturing device to capture an image into computer Graphic becomes bitmap image file An optical character recognition (OCR) program can analyze text image and identify each alphabetic letter and numeric digit. Lastly, it converts each character into an ASCII code

8. Ch 2.4 Digitization, Coding-decoding and Compression 8 1. Overview of digitization Sound and video digitization Use some analog-to-digital conversion processes that change the continuously variable (analog) signal into multi-level (digital) signal For example: sound digitization Sampling the amplitude (signal strength) of an analog waveform at evenly spaced time markers and representing the samples as numerical values for input as digital data

9. Ch 2.4 Digitization, Coding-decoding and Compression 9

10. 10 2. Coding and decoding Human can only sense analog signals rather than digital signals Computer stores digital data Coding is one of digitization process to convert analog signals to digital signals. (A->D) Decoding is a process to convert digital signals to analog signals. (D->A)

11. Ch 2.4 Digitization, Coding-decoding and Compression 11 2. Coding and decoding process Coding Convert analog audio signal to digital signal. Decoding Convert digital audio signal to analog signal Computer Guitar Sound Music

12. Ch 2.4 Digitization, Coding-decoding and Compression 12 2. Transform Coding What is transform coding? A type of data compression for “natural” data Lossy compression A lower quality copy of the original input Introduction of transform coding Transforms coordinate axes rotations Transforms basis functions decomposition Image Transform KLT DFT DCT

13. Ch 2.4 Digitization, Coding-decoding and Compression 13

14. Ch 2.4 Digitization, Coding-decoding and Compression 14 3. Types of compression Lossy compression For diffused data This compression throws away bits which are not needed for reproducing sound, audio, image and video Fast transmission and good for streaming media and internet telephonystreaming media internet telephony Lossless compression For symbolic data An exact, bit-identical reproduction of the original data

15. Ch 2.4 Digitization, Coding-decoding and Compression 15 3. Types of compression Lossless Vs. Lossy Compression Original data Compressed Restored data Lossless Compression Lossy Compression

16. Ch 2.4 Digitization, Coding-decoding and Compression 16 3. Example of Lossy Compression Original Image (lossless PNG, 101 KB size) Low Compression (10% less information, 84 KB) Medium Compression (20% less information, 71 KB) High Compression (80% less information, 6.5KB) The above images show the use of lossy compression to reduce the file size of the image.file size

17. Ch 2.4 Digitization, Coding-decoding and Compression 17

18. Ch 2.4 Digitization, Coding-decoding and Compression 18 4. Categories of Compression Techniques Lossless CompressionLossy CompressionMixed Compression Run-length Coding Huffman Coding Arithmetic Coding DPCM (Differential Pulse Code Modulation) FFT (Fast Fourier Transform) DCT (Discrete Cosine Transform) JPEG MPEG H.261

19. Ch 2.4 Digitization, Coding-decoding and Compression 19 4. Current standards of multimedia compression Image JPEG Using four coding modes  Lossless Mode (mode 1)  Lossy sequential DCT-based mode (baseline mode)  Lossy progressive DCT-based mode (mode 3)  Hierarchical Mode

20. Ch 2.4 Digitization, Coding-decoding and Compression 20 Video MPEG-1 Video Used by Video CD Quality and performance similar VHS tape MPEG-2 Video The core of most digital television and DVD format Compression rate is higher than MPEG-1 MPEG-4 Video Develop for the following fields:  Digital television  Interactive graphics applications (synthetic content)  Interactive multimedia (World Wide Web, distribution of and access to content) Compression rate is higher than MPEG-1 and MPEG-2 4. Current standards of multimedia compression

21. Ch 2.4 Digitization, Coding-decoding and Compression 21 4. Compression of video Two reasons: Reduce file size Enable live broadcast on the web Standard Compression technique is called MPEG MPEG stands for Moving Picture Expert Groups A compressed video must be decompressed before playing Compression and decompression are called CODEC

22. Ch 2.4 Digitization, Coding-decoding and Compression 22 4. Different formats of MPEG FormatYearVideo Characteristics PurposeApplication Examples MPEG - 11992320 x 240 pixels 24-bit color depth CD-quality High compression ratio but in sacrifice of quality VCD (Video CD) 40 minutes of video MPEG - 21994640 x 480 pixels 24-bit color depth Multi-audio channels Improvement in image quality DVD 90 minutes of video MPEG - 41998640 x 480 pixels 24-bit color depth MP3 audio Designed for viewing online video through the Internet with broadband access Used in Internet video broadcasting. Video file with extension ASF, WMV, RM

23. Ch 2.4 Digitization, Coding-decoding and Compression 23 4. Current standards of multimedia compression Audio MP3 Stands for MPEG-1 Audio Layer 3 Popular digital audio coding Lossy compression

24. Ch 2.4 Digitization, Coding-decoding and Compression 24

25. Ch 2.4 Digitization, Coding-decoding and Compression 25 References Digitization What is digitization? http://whatis.techtarget.com/definition/0,289893,sid9_g ci896692,00.html http://whatis.techtarget.com/definition/0,289893,sid9_g ci896692,00.html Transform coding What is transform coding? http://en.wikipedia.org/wiki/Transform_coder Introduction http://www.cis.scu.edu.tw/~tseng/DataCompression/un it09-Transform%20Coding.PPT http://www.cis.scu.edu.tw/~tseng/DataCompression/un it09-Transform%20Coding.PPT

26. Ch 2.4 Digitization, Coding-decoding and Compression 26 References Types of compression Lossy Compression http://en.wikipedia.org/wiki/Lossy_data_compression#Lossy_vs._lossl ess_Compression http://en.wikipedia.org/wiki/Lossy_data_compression#Lossy_vs._lossl ess_Compression Loseless Compression http://en.wikipedia.org/wiki/Lossless_compression Categories of Compression Techniques Lossless Compression Run-length Coding  http://en.wikipedia.org/wiki/Run-length_encoding http://en.wikipedia.org/wiki/Run-length_encoding Huffman Coding  http://en.wikipedia.org/wiki/Huffman_coding http://en.wikipedia.org/wiki/Huffman_coding Arithmetic Coding  http://en.wikipedia.org/wiki/Arithmetic_coding http://en.wikipedia.org/wiki/Arithmetic_coding

27. Ch 2.4 Digitization, Coding-decoding and Compression 27 References Categories of Compression Techniques Lossy Compression DPCM  http://einstein.informatik.uni-oldenburg.de/rechnernetze/dpcm.htm http://einstein.informatik.uni-oldenburg.de/rechnernetze/dpcm.htm FFT  http://en.wikipedia.org/wiki/Fast_Fourier_transform http://en.wikipedia.org/wiki/Fast_Fourier_transform DCT  http://www.cs.cf.ac.uk/Dave/Multimedia/node231.html http://www.cs.cf.ac.uk/Dave/Multimedia/node231.html  http://cobweb.ecn.purdue.edu/~ace/jpeg-tut/jpgdct1.html http://cobweb.ecn.purdue.edu/~ace/jpeg-tut/jpgdct1.html Mixed Compression H.261  http://www-mobile.ecs.soton.ac.uk/peter/h261/h261.html http://www-mobile.ecs.soton.ac.uk/peter/h261/h261.html

28. Ch 2.4 Digitization, Coding-decoding and Compression 28 References JPEG Compression http://www.cs.cf.ac.uk/Dave/Multimedia/node234.html MPEG-1 Compression http://www.chiariglione.org/mpeg/standards/mpeg-1/mpeg-1.htm MPEG-2 Compression http://www.chiariglione.org/mpeg/standards/mpeg-2/mpeg-2.htm MPEG-4 Compression http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm MP3 Compression http://en.wikipedia.org/wiki/MP3 http://upload.wikimedia.org/wikipedia/en/e/ee/Mp3filestructure.jpg