Presentation is loading. Please wait.

Presentation is loading. Please wait.

LDP Local Directional Pattern & LDN Local Directional Number Pattern 报告人:黄倩颖.

Similar presentations


Presentation on theme: "LDP Local Directional Pattern & LDN Local Directional Number Pattern 报告人:黄倩颖."— Presentation transcript:

1 LDP Local Directional Pattern & LDN Local Directional Number Pattern 报告人:黄倩颖

2 内容 两种局部编码模式构造描述子 LDP Local Directional Pattern LDN Local Directional Number Pattern 对 Local Binary Pattern (LBP) 的改良

3 Descriptor geometric-feature-based appearance-based

4 Part One 作者简介 文章结构 方法概述 讲解提纲 LBP 方法回顾 LDP 的创新点 LDP 的鲁棒性 LDP 的旋转不变性 实验 结论

5 作者简介 Local Directional Pattern (LDP) – A Robust Image Descriptor for Object Recognition Taskeed Jabid, Md. Hasanul Kabir, Oksam Chae Department of Computer Engineering Kyung Hee University, Republic of Korea 2010 Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance Taskeed Jabid Human Computer Interaction, Computer Vision, Object Recognition Local Directional Pattern (LDP) for face recognition International Conference Consumer Electronics (ICCE), 2010 Cited by 44

6 文章结构 Introduction LDP image descriptor a.Local Binary Pattern (LBP) b.Local Directional Pattern (LDP) c.Robustness of LDP d.Rotation invariant LDP e.LDP Descriptor Texture classification using LDP descriptor Face recognition using LDP descriptor Conclusions

7 Abstract LDP( Local Directional Pattern) is a local feature descriptor for describing local image feature. Though LBP is robust to monotonic illumination change but it is sensitive to non-monotonic illumination variation and also shows poor performance in the presence of random noise A LDP feature is obtained by computing the edge response values in all eight directions at each pixel position and generating a code from the relative strength magnitude. Each bit of code sequence is determined by considering a local neighborhood hence becomes robust in noisy situation.

8 Part One 作者简介 文章结构 方法概述 讲解提纲 LBP 方法回顾 LDP 的创新点 LDP 的鲁棒性 LDP 的旋转不变性 实验 结论

9 讲解提纲 LBP 方法回顾 LDP 的创新点 LDP 的鲁棒性 LDP 的旋转不变性 实验 结论

10 Local Binary Pattern (LBP) Original LBP 50 Threshold 50 ( ) 2 = < 50 0

11 Local Directional Pattern (LDP) Kirsch masks North- East North North- West M2M2 M1M1 M4M4 M0M0 M5M5 M6M6 M7M7 M3M3 East South West South-West South-East M3M2M1M4M0 M5M6M

12 Computing… Kirsch masks LDP Binary Code = LDP Decimal Code= 19 19

13 Robustness of LDP noise & non-monotonic illumination changes LBP = LDP = LBP = LDP =

14 Rotation invariant LDP Rotation Invariant LDP Code =

15 LDP Descriptor Accumulating the occurrence of LDP feature

16 Experiments Texture Classification using LDP histogram Primary pictures from Brodatz texture album: (a) Bark, (b) Brick, (c) Bubbles, (d) Grass, (e) Leather, (f) Pigskin, (g) Raffia, (h) Sand, (i) Straw, (j) Water, (k) Weave, (l) Wood and (m) Wool

17 Experiments Texture Classification using LDP histogram

18 Experiments Extracted rotation invariant LDP features of each pixel of the image then combined to generate rotation invariant image descriptor using LDP histogram following equation.

19 Experiment Results The accuracy of the method Results

20 Face recognition using LDP descriptor (a) fa set, used as a gallery set, contains frontal images of 1,196 people. (b) fb set (1,195 images) with an alternative facial expression than in the fa photograph. (c) fc set (194 images) taken under different lighting conditions. (d) dup I set (722 images) taken later in time. (e) dup II set (234 images) subset of the dup I set containing images that were taken at least a year after the corresponding gallery image. Database FERET

21 Face recognition using LDP descriptor Classification using LDP histogram Template matching

22 Experiment Results

23 Part Two 作者简介 文章结构 方法概述 讲解提纲 LBP LDP 缺点 LDN 三个关键点 人脸描述 实验 结论及未来工作

24 作者简介 Local Directional Number Pattern for Face Analysis: Face and Expression Recognition Adin Ramirez Rivera,Student Member, IEEE, Jorge Rojas Castillo,Student Member, IEEE, and Oksam Chae,Member, IEEE IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 22, NO. 5, MAY 2013 Cited by 2 | Year 2012 | Adin Ramirez Rivera Image Processing, Computer Vision Content-Aware Dark Image Enhancement through Channel Division IEEE Transactions on Image Processing 21 (9), Cited by 9 | Year 2012

25 文章结构 Introduction Local Directional Number Pattern Difference With Previous Work Coding Scheme Compass Masks Face description Face recognition Conclusions

26 Abstract A novel local feature descriptor LDN encodes the directional information of the face’s textures in a compact way, producing a more discriminative code than current methods

27 Part Two 作者简介 文章结构 方法概述 讲解提纲 LBP LDP 缺点 LDN 三个关键点 人脸描述 实验 结论及未来工作

28 讲解提纲 LBP LDP 缺点 LDN 三个关键点 人脸描述 实验 结论及未来工作

29 LBP The method discards most of the information in the neighborhood.  It limits the accuracy of the method  It makes the method very sensitive to noise  Moreover, these drawbacks are more evident for bigger neighborhoods

30 Directional (LDiP) & Derivative (LDeP) Miss some directional information (the responses’ sign) by treating all directions equally  Sensitive to illumination changes and noise, as the bits in the code will flip and the code will represent a totally different characteristic

31 Key points of LDN LBP Direction number Sign information gradient information 6-bit LDN

32 Key points of LDN Direction number Sign information gradient information 6-bit LDN

33 Coding Scheme Direction number Direction number Sign information Sign information

34 Coding Scheme

35 Compass Masks Two kinds of masks derivative-Gaussian mask Kirsch masks gradient information

36 Compass Masks Kirsch masks North- East North North- West M2M2 M1M1 M4M4 M0M0 M5M5 M6M6 M7M7 M3M3 East South West South- West South- East M3M2M1M4M0 M5M6M

37 Compass Masks derivative-Gaussian mask Compute code in gradient space Therefore, use Gaussian smoothing to stabilize the code in presence of noise Generate a compass mask,{M 0 σ,...,M 7 σ}, by rotating Mσ, 45°apart, in eight different directions

38 Compass Masks derivative-Gaussian mask

39 Face Descriptor Histogram LH & MLH

40 Face Descriptor Two kinds of descriptor Code in LH Code in MLH must be

41 Face Recognition Chi-Square dissimilarity measure

42 Face recognition using LDP descriptor (a) fa set, used as a gallery set, contains frontal images of 1,196 people. (b) fb set (1,195 images) with an alternative facial expression than in the fa photograph. (c) fc set (194 images) taken under different lighting conditions. (d) dup I set (722 images) taken later in time. (e) dup II set (234 images) subset of the dup I set containing images that were taken at least a year after the corresponding gallery image. Database FERET

43 Experiment Results small neighborhoods (3×3, 5×5, 7×7) medium neighborhoods (5×5, 7×7, 9×9) large neighborhoods (7×7, 9×9, 11×11) small neighborhoods (3×3, 5×5, 7×7) medium neighborhoods (5×5, 7×7, 9×9) large neighborhoods (7×7, 9×9, 11×11) Face recognition accuracy

44 Experiment Results Noise Evaluation With white Gaussian noise

45 Conclusion Combination of different sizes (small, medium and large) gives better recognition rates for certain conditions. Evaluated LDN under expression, time lapse and illumination variations, and found that it is reliable and robust throughout all these conditions.

46 总结及未来工作 如何选择一个描述子 长度 描述精度 抗噪能力 计算强度 如何设计一个描述子 舍弃冗余的信息 整合多种信息来源 信息压缩

47


Download ppt "LDP Local Directional Pattern & LDN Local Directional Number Pattern 报告人:黄倩颖."

Similar presentations


Ads by Google