1. 1 Error-Protection Techniques of SPIHT- Coded Images in Packet Loss Network 指導教授：楊士萱報告者：鄭博峰 11 月 12 日

2. 2 ► ► Error resilience: Robustness. Needing to modify encoder. Needing add additional information. ► ► Channel coding: Correcting the errors. Adding correct codes. ► ► Error Concealment: Estimating the data (loss or damage). Using correct data. Error Protection techniques

3. 3 Outline ► ► Wavelet Transform and SPIHT Coding ► ► Error resilience: 1. Trees’ Partition and Packetization. 1. Trees’ Partition and Packetization. 2. Multi-description in SPIHT 2. Multi-description in SPIHT ► ► Error Concealment ► ► Simulation ► ► Conclusion

4. 4 Wavelet coder SPIHT Image Error resilience Channel SPIHT Decoder Wavelet Decoder Image Source coderFlowchart Error concealment

5. 5 Outline ► Wavelet Transform and SPIHT Coding ► ► Error resilience: 1. Trees’ Partition and Packetization. 1. Trees’ Partition and Packetization. 2. Multi-description in SPIHT 2. Multi-description in SPIHT ► Error Concealment ► Simulation ► Future work

6. 6 Wavelet Transform ► ► Gathering Energy in lowest subband. ► ► Reconstructing original image. DWT

7. 7 Subband Coefficient Correlation C Brother,Parent > C Brother (up,left)> C parent (H,D)> C cousin (H,D)> C aunt (H,D)

8. 8 SPIHT 1. * and highest subband have no son. 2. Others have 4 sons.

9. 9 SPIHT quantization

10. 10 SPIHT Coding (Sorting Pass)

11. 11 Outline ► Wavelet Transform and SPIHT Coding ► Error resilience: 1. Trees’ Partition and Packetization. 1. Trees’ Partition and Packetization. 2. Multi-description in SPIHT 2. Multi-description in SPIHT ► Error Concealment ► Simulation ► Future work

12. 12 Trees ’ Partition and Packetization 1.Partition into trees by direction. 2. Packing with clan.

13. 13 Multi-description in SPIHT ► After Wavelet transforming, almost energy will gather in low frequency. ► Using MDC to overcome this problem. ► Copying lowest coefficients. ► Encoding sub-lowest subband’s sign. ► Must modify SPIHT’s encoder.

14. 14

15. 15 Outline ► Wavelet Transform ► SPIHT Coding ► Error resilience: 1. Trees’ Partition and Packetization. 1. Trees’ Partition and Packetization. 2. Multi-description in SPIHT 2. Multi-description in SPIHT ► Channel ► Error Concealment ► Simulation ► Future work

16. 16 Error Concealment ► Recovery of lost information (estimation). ► Using correct information’s correlation. ► There are three kinds of error concealment: 1.Spatial domain (video/image) 1.Spatial domain (video/image) 2.Temporal domain (video) 2.Temporal domain (video) 3.Frequency domain (video/image) 3.Frequency domain (video/image)

17. 17 Our Error Concealment method ► Using linear prediction to do error concealment. (, ) (, ) ► Minimum the mean square error ► We can get ► Using pixel’s correlation (the same position): 1.intra-subband (siblings) 1.intra-subband (siblings) 2.inter-subband (parents’ correlation) 2.inter-subband (parents’ correlation)

18. 18 Intra-subband (siblings) ► 1. Siblings’ direction ( ) ► 2. Correlative siblings ( )

19. 19 Intra-subband

20. 20 Inter-subband (parents’ correlation) （ 4,20 ）（ 4,5 ）

21. 21 Inter-subband (parents’ correlation)

22. 22 Reference compare (1).Our MDC and MD-SPIHT(A. C. Miguel) ► MD-SPIHT: Copying every tree (20%,40% and 70%) ► Our MDC :Copying lowest subband ’ s coefficients. (2).Our concealment and sequential error concealment (X. Li and M. T. Orchard) 1. Frequency domain and Time domain 1. Frequency domain and Time domain 2. Correlative position. 2. Correlative position. Redundancy Lossless PSNR(db) MD-SPIHT(1.25)35%39.5 Our MDC(1.25)1.72%40.96 MD-SPIHT(0.5)20%36 Our MDC(0.5)3.90%36.6

23. 23 Outline ► Wavelet Transform and SPIHT Coding ► Error resilience: 1. Trees’ Partition and Packetization. 1. Trees’ Partition and Packetization. 2. Multi-description in SPIHT 2. Multi-description in SPIHT ► Error Concealment ► Simulation ► Future work

24. 24 Simulation Methods ► （一） Lossless ： No packet loss 。 ► （二） Unprotected ： Packets loss without protecting 。 ► （三） All Average ： Using siblings ’ average 。 ► （四） MDC+average( 二 ) ： Lowest subband->MDC, sub-lowest subband->siblings ’ average 。 sub-lowest subband->siblings ’ average 。 ► （五） MDC+(intra) ： Lowest subband->MDC, sub-lowest subband->our concealment(intra-subband) 。 subband->our concealment(intra-subband) 。 ► （六） MDC+(inter) ： Lowest subband->MDC, sub-lowest subband->our concealment(inter-subband) 。 subband->our concealment(inter-subband) 。

25. 25 9/7 filter Bitrate 0.25 (Lena) 9/7 filter Bitrate 0.25 (Lena) 102040 Lossless33.58 Unprotected17.6214.8312.02 全部 Average 2724.9121.139 MDC+average( 二 ) 30.0527.5524.69 MDC+(intra)30.6128.2925.39 MDC+(inter)30.728.2825.49

26. 26 9/7 10 Packets loss 0.25bpp Lossless 32.59 dbUnprotected 19.22dbAll Average 28.48 db MDC+inter 31.03 db MDC+intra 30.55 db MDC+average( 二 ) 30.27 db

27. 27 9/7 filter Bitrate 0.25 (Baboon) 102040 （一） Lossless 22.88 （二） Unprotected 16.2413.9611.35 （三） All Average 22.1821.3719.49 （四） MDC+average( 二 ) 22.4622.0121.26 （五） MDC+(intra) 22.4622.0821.23 （六） MDC+(inter) 22.522.0921.41

28. 28 9/7 filter Loss 20 packets (Lena) 0.1250.250.51 Lossless30.5233.5836.7339.92 Unprotected14.7714.8314.8514.86 All Average24.4224.9125.1725.31 MDC+average( 二 ) 26.5527.5528.1428.45 MDC+(intra)27.0728.2929.0129.3 MDC+(inter)27.0728.282929.38

29. 29 9/7 20Packets loss 0.25bpp Unprotected 15.35dbAll Average 25.42db MDC+average 28.55dbMDC+(inter) 29.28dbMDC+(intra) 29.07db Lossless 32.59 db

30. 30 9/7 filter Loss 20 packets (Baboon) 0.1250.250.51 （一） lossless 21.4922.8725.1128.62 （二） Unprotected 13.7713.9614.1614.32 （三） All Average 20.4721.3722.7124.06 （四） MDC+average( 二 ) 20.8522.0123.5525.39 （五） MDC+(intra) 20.8922.0823.6925.62 （六） MDC+(inter) 20.9222.0923.7225.63 db

31. 31 9/7 20Packets loss 0.25bpp Lossless 22.87dbAll Average 21.78db MDC+average 22.17dbMDC+(inter) 22.18dbMDC+(intra) 22.18db Unprotected 14.83db

32. 32 Bitrate 0.25 Loss 40 packets 9/7filter(Lena)5/3filter(Lena)9/7filter(Baboon)5/3filter(Baboon) （一） lossless 33.5832.622.8822.24 （二） Unprotected 12.0214.1911.3513.36 （三） All Average 21.1420.8919.4919.1 （四） MDC+average( 二 ) 24.6924.4121.2620.91 （五） MDC+(intra) 25.3925.2821.2320.95 （六） MDC+(inter) 25.4925.2821.4121.05

33. 33 Outline ► Wavelet Transform ► SPIHT Coding ► Multi-description in SPIHT ► Channel ► Error Concealment ► Simulation ► Conclusion

34. 34 Conclusion ► In the lowest subband : MDC>Average (3db),(1db) MDC>Average (3db),(1db) ► In the sub-lowest subband : Our concealment (intra)>Average (0.5db),(0.1db) Our concealment (intra)>Average (0.5db),(0.1db) Our concealment (inter)>Average (0.6~0.7db ) Our concealment (inter)>Average (0.6~0.7db ) ( 0.1~0.2db) ( 0.1~0.2db) ► Increasing by bitrate and packet loss rate. ► In Lowest subband(MDC).(9/7 filter > 5/3 filter) ► Sub-lowest subband( ourconcealment).(5/3 filter > 9/7 filter)

35. 35 ThanksEverybody

36. 36 Inter-subband (parent)

37. 37 9/7 10 Packets loss 0.25bpp Lossless 22.88 dbUnprotected 17.76dbAll Average 22.41 db MDC+inter 22.52 dbMDC+intra 22.52 db MDC+average( 二 ) 22.50 db

38. 38 9/7 20Packets loss 0.25bpp Unprotected 15.35dbAll Average 25.42dbMDC+average 28.55db MDC+(father) 29.72dbMDC+(inter) 29.28dbMDC+(intra) 29.07db