1. Issues for Multimedia Privacy & Security ---- Video Content Privacy Protection, Copyright Protection & Database Access Control Jianping Fan Dept of Computer Science UNC-Charlotte

2. Visual Database: Efficiency & Accuracy a.Multimedia Content Analysis --  Feature Extraction b.Multimedia Clustering & Classification --  Indexing c.Database Indexing ---  Fast Search & Access d.Query Processing ---  Query Represent. & Feedback e.Multimedia Coding & Transmission--  Data Streaming

3. 1. Why we need security & privacy for multimedia? a.Multimedia data has copy right issue! It is easy for us to copy a digital image without losing! ------- data level b. Different user class should have permission to access different data in database! Even the same data with different quality! -------- Access Control at database and data levels c. Multimedia data has privacy issue! ------ why you show my appearance in your pictures?! Traditional techniques, such as encryption, are not good enough!

4. Encryption is not for multimedia content protection AliceEncryptDecryptBob plaintext cyber text sourcedestination key encrypt What you want to show us? We cannot pay for nothing! When I see it, then I can decide whether I can buy it! John Smith, Attacker Show me what you have, not just claim what you have!

5. I want to make a schedule to visit Arizona this summer!! It is so beautiful!! I have no interesting on this!! Arizona state government will have different opinion for these two photos!! If you are good photographer, you want to show your pictures to attract people, but you do not want other people to make an illegal copies of your pictures! Your children may get benefit from this photo!!!!!!!! Original Picture Encrypted Picture

6. Jianping Fan 11/12/2002 Signature Original Picture Picture with Hidden Signature! Watermarking Why watermarking is more attractive than encryption You can still see the picture with big quality lost!

7. Advantages of Watermarking: a. It is able to display the pictures to attract customers! This property is very important for multimedia content protection! b. The watermarked pictures are able to keep ``same” vision quality of the original pictures! Customers will be happy for this! c. It is easy for detecting the watermarking signal! d. It is hard to remove the watermarking signal from pictures!

8. 2. What’s Watermarking? Most Images are compressed in JPEG Coding will make watermarked image more secure!

9. 2. What’s Watermarking? Why watermarking is more attractive than encryption John Smith 6/30/2004 Original ImageWatermarking Signal JPEG Encoded Image With Watermarking Signatures!

10. 2. What’s Watermarking? Original Image Watermarked Image Can you find any difference?

11. 2. What’s Watermarking? Original ImageWatermarked Image Can you find any difference?

12. 2. What’s Watermarking? Original ImageWatermarked Image Can you find any difference?

13. 2. What’s Watermarking? From these examples, what we can learn? a. The watermarked image should have ``same” vision quality as the original image has, or at least the human perception system cannot find their differences! b. We should know where to add watermarking signal, how strong it should be! c. We should be able to detect the watermarking signal effectively when we need.

14. 2. What’s Watermarking? Why we cannot damage the image quality? How we can do this? How to measure image perceptional quality? How to quantify the threshold for human perceptional system? How to use this to watermark images? Questions to be answered:

15. 2. What’s Watermarking? Applications for watermarking are very popular & market is also big! Original Image Watermarking Signal Jianping Fan 6/30/2005

16. 2. What’s Watermarking? Applications for watermarking are very popular & market is also big! Original Image Secure Signal terrorist attack plan Picture shown in public web page! Secure Information Transmission!

17. 2. What’s Watermarking? When the watermarking signal damages images? a.How can we obtain the threshold for human perception system? b. How can we use this threshold to control the value of watermarking?

18. 2. What’s Watermarking? a. How can we generate the suitable watermarking signal? b. Where should we add the watermarking signal in? Where to add watermarking signal?

19. 2. What’s Watermarking? Why we should add maximum watermarking? I can also add my watermarking signal in your picture!

20. 2. What’s Watermarking? Why we should add maximum watermarking? a. Original Image Signal: I(x, y) b. Your Watermarking Signal: w(x, y) c. Human Perception Threshold: T(x, y) If I(x, y) + w(x, y) << T(x, y), there exists another signal q(x, y): I(x, y) + w(x, y) + q(x, y) T(x, y) q(x, y) can be used by attackers!

21. Jianping Fan 11/12/2002 Why we should add maximum watermarking? Weakly Watermarked Image

22. John Smith 5/12/2005 Why we should add maximum watermarking? Weakly Watermarked Image Another Watermarking Signal From Attackers! Strongly Watermarked Image

23. John Smith 5/12/2005 Strongly Watermarked imageWeakly Watermarked image How can you claim this is your picture?

24. Jianping Fan 11/12/2002 Watermarked ImageOriginal Image How can you claim this is your picture? Manually adjust is the major solution now!

25. 2. What’s Watermarking? Different Watermarking Signals

26. 2. What’s Watermarking? Different Watermarking Signals

27. 2. What’s Watermarking? Different Watermarking Signals

28. 2. What’s Watermarking? Most Images are compressed in JPEG

29. 2. What’s Watermarking? DCT 121 Each DCT coefficient consists of information from all the pixels!!!!!! Watermarking Image at Compressed Domain

30. 2. What’s Watermarking? Watermarking Image at Compressed Domain 8 8 low high a. Low frequency coefficients represent average information or homogeneity of image blocks b. High frequency coefficients represent difference information or texture of image blocks Watermarking signal should be added in Texture areas!

31. 2. What’s Watermarking? Watermarking Image at Compressed Domain Wavelet Transformation JPEG 2000

32. 2. What’s Watermarking? How to watermark MPEG videos? DCT QVLCBuffer 01001…. ME IQ IDCT 01001…. IDCTIQVLCBuffer ME Q: quantization IQ: reverse quantization ME: motion estimation

33. 2. What’s Watermarking? How to watermark MPEG videos?

34. 2. What’s Watermarking? Is it too expensive for a 2 hours video? How to water MPEG videos?

35. 2. What’s Watermarking? a. Can we only watermark I frames? b. Can we only watermark I and P frames? How to watermark MPEG videos? IBP

36. 2. What’s Watermarking? IPP IPB

37. 3. What’s Database Access Control? Data in Disk read write Access Control client a.Pay more then get more! b. User classes

38. 3. What’s Database Access Control? Objects in database U s e rs of d at a b a s e Rule 1

39. Video in Database Cluster 1Cluster iCluster n Subcluster 11Subcluster 1j Subcluster n1 Subcluster nl Subregion 11k Subregion nl1Subregion nlm object1111 object nlm1 Disk for Cluster 1 Disk for Cluster i Disk for Cluster n 3. What’s Database Access Control? Integrating access control with database indexing structure!!!

40. query object feature extraction Cluster 1 Cluster i Cluster n Subcluster i1Subcluster ij Subcluster im Subregion ij1Subregion ijl Subregion ijr Object ijrm Disk for cluster 1Disk for cluster i 3. What’s Database Access Control? Integrating access control with video transmission and packaging!!!

42. Video in Database Cluster 1Cluster iCluster n Subcluster 11Subcluster 1j Subcluster n1 Subcluster nl Subregion 111 Subregion 11k Subregion nl1Subregion nlm object1111 object nlm1 Disk for Cluster 1 Disk for Cluster i Disk for Cluster n 3. What’s Database Access Control?

43. Video in Database Cluster 1Cluster iCluster n Subcluster 11Subcluster 1j Subcluster n1 Subcluster nl Subregion 111 Subregion 11k Subregion nl1Subregion nlm object1111 object nlm1 Disk for Cluster 1 Disk for Cluster i Disk for Cluster n 3. What’s Database Access Control?

44. Video in Database Cluster 1Cluster iCluster n Subcluster 11Subcluster 1j Subcluster n1 Subcluster nl Subregion 111 Subregion 11k Subregion nl1Subregion nlm object1111 object nlm1 Disk for Cluster 1 Disk for Cluster i Disk for Cluster n 3. What’s Database Access Control?

45. a. Frame level 4. Video Content Protection?

46. b. Region level 4. Video Content Protection?

47. c. Video Content Privacy Protection 4. Video Content Protection?

48. c. Video Content Privacy Protection 4. Video Content Protection?

49. c. Video Content Privacy Protection 4. Video Content Protection? Why image privacy is so important?!

50. Access control & rights management Query & Delivery Delivery Query Presentation Query Processing Visual Summarization Indexing Video CollectionsMPEG Encoder 5. Video Database with Privacy Protection and Access Control Integrating with encryption and networks!!!

51. Video Shot n Unsuitable for people under 18!!! Repackaged MPEG Video Bit Stream!!! 5. Video Database with Privacy Protection and Access Control

52. Who work on this area?