Presentation is loading. Please wait.

Presentation is loading. Please wait.

Computer Vision Spring 2010 15-385,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #22.

Published byEthelbert McDonald Modified over 8 years ago

Similar presentations

Presentation on theme: "Computer Vision Spring 2010 15-385,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #22."— Presentation transcript:

1 Computer Vision Spring 2010 15-385,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #22

2 Face Detection Thanks to Guru Krishnan and Shree Nayar

3 I.1 Locate human faces in images. What is Face Detection?

4 Face Detection Topics: (1) Features for Face Detection (2) Integral Images (3) Nearest Neighbor Classifier (4) Support Vector Machine Locate human faces in images.

5 Where is Face Detection Used? Cameras (for Autofocus) I.16

6 Where is Face Detection Used? Search Engine Face Detection Function I.2

7 Where is Face Detection Used? Only Faces of Gates now! Search Engine I.3

8 Where is Face Detection Used? Photo Tagging in Social Networks I.4

9 Where is Face Detection Used? Security Surveillance in Public I.6

10 How Humans Detect Faces? We do not know yet! Memory-prediction model Match faces with the face model in memory. Parallel computing Detect faces at multiple location/scale combination. Some Conjectures:

11 Face Detection in Computers Basic Idea: Slide windows of different sizes across image. At each location match the window to a face model. I.1

12 Face Detection in Computers Basic Idea: Slide windows of different sizes across image. At each location match the window to a face model. I.1

13 Basic Framework For each window Extract Features Match Face Model Yes / No Features: Which features represent faces well? Classifier: How to construct/match the face model? F I.12

14 What are Good Features? Facial Components ? SIFT?

15 Characteristics of Good Features Discriminate Face/Non-Face ≠ Extremely Fast to Compute Need to evaluate tens of thousands windows in an image. I.7 I.8 I.9 I.10 I.11 I.12

16 Haar Features A Set of Responses to Rectangular Haar Filters *

17 Response to Haar Filter White = 1, Black = -1 *

18 Haar Feature: Discriminative Ability V A = 64V A ≈ 0 Haar features capture the Directional Pattern V A = 16V A = -127 I.13 I.14 I.12

19 Haar Features * Feature Vector

20 Face Detection at Different Scales Use filters of different sizes to find faces at corresponding scale

21 Haar Feature: Computation Cost Value = ∑ (pixels in white) – ∑ (pixels in black) = Pixel sum in White Rect – Pixel sum in Black Rect If filter size is N×M pixels: Computation cost = (N×M-1) additions Still too expensive! Integral Image to the Rescue!

22 Integral Image For example: ImageIntegral Image 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 A table that holds the sum of all pixel values to the left and top of a given pixel, inclusive.

23 Integral Image For example: ImageIntegral Image 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 A table that holds the sum of all pixel values to the left and top of a given pixel, inclusive.

24 Integral Image For example: ImageIntegral Image 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 A table that holds the sum of all pixel values to the left and top of a given pixel, inclusive.

25 Integral Image A table that holds the sum of all pixel values to the left and top of a given pixel, inclusive. For example: ImageIntegral Image 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052

26 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 Summation Within a Rectangle ImageIntegral Image (II) Fast summations of arbitrary rectangles using integral images.

27 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 Summation Within a Rectangle ImageIntegral Image (II) Fast summations of arbitrary rectangles using integral images. Sum = II P +… = 3490 + … P

28 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 Summation Within a Rectangle ImageIntegral Image (II) Fast summations of arbitrary rectangles using integral images. Sum = II P – II Q + … = 3490 – 1137 + … Q P

29 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 Summation Within a Rectangle ImageIntegral Image (II) Fast summations of arbitrary rectangles using integral images. Sum = II P – II Q – II S + … = 3490 – 1137 – 1249 + … Q PS

30 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 Summation Within a Rectangle ImageIntegral Image (II) Sum = II P – II Q – II S + II R = 3490 – 1137 – 1249 + 417 = 1521 QR PS Can be computed in constant time with only 4 references

31 Haar Response using Integral Image V A = ∑ (pixels in white area) – ∑ (pixels in black area) = (II O – II T + II R – II S ) – (II P – II Q + II T – II O ) = (2061–329+98–584) – (3490–576+329–2061) = 64 98110121125122129 99110120116 129 97109124111123134 98112132108123133 97113147108125142 95111168122130137 96104172130126130 98208329454576705 19741765889911371395 294623988134017012093 3928331330179022742799 48910431687225528643531 58412492061275134904294 68014492433325341185052 ImageIntegral Image (II) QR PS T O

32 Computing Integral Image Raster Scanning Let I A and II A be the values of the Image and Integral Image, respectively, at pixel A. A DB C II A = II B + II C – II D + I A

33 Haar Features for Face Detection * Feature Vector

34 Classifier for Face Detection Given the features for a window, how to decide whether it contains a face or not? ? ? ? ?

35 Feature Space f2f2 fNfN f1f1 ° ° ° ° ° Training Data of Face Training Data of Non-Face °

36 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Nearest samples decide the result of the classifier. Test Image

37 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Nearest samples decide the result of the classifier. Face

38 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Nearest samples decide the result of the classifier. Test Image

39 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Nearest samples decide the result of the classifier. Not Face

40 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Test Image Nearest samples decide the result of the classifier.

41 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° False Positive Larger the training set, more robust the NN classifier

42 f2f2 fNfN f1f1 Nearest Neighbor Classifier ° ° ° ° ° Training Data of Face Training Data of Non-Face ° Larger the training set, slower the NN classifier

43 f2f2 fNfN f1f1 Decision Boundary ° Training Data of Face Training Data of Non-Face A simple decision boundary separating the face and non-face classes will suffice. ° ° ° ° °

44 Decision Boundary ° ° ° ° ° ° ° ° ° ° ° Faces Non-Faces

45 Decision Boundary How to find the optimal decision boundary? ° ° ° ° ° ° ° ° ° ° ° Face Class Non-Face Class

46 Evaluating a Decision Boundary Margin or Safe Zone: The width that the boundary could be increased by before hitting a data point. Margin ° ° ° ° ° ° ° ° ° ° °

47 Evaluating a Decision Boundary Choose Decision Boundary with the Maximum Margin! Margin I ° ° ° ° ° ° ° ° Margin II ° ° ° ° ° ° ° ° + + Decision I: FaceDecision II: Non-Face

48 Support Vector Machine (SVM) Margin ° ° ° ° ° ° ° ° ° ° ° Classifier optimized to maximize Margin Support Vectors: Closest data samples to the boundary. Decision Boundary and the Margin depend only on the Support Vectors.

49 Support Vector Machine (SVM) Equation of Boundary: ° ° ° ° ° ° Find:

50 ° ° ° ° ° °

51

52 iPhone App using Face Detection Application ： Game I.15

53 Comments  Current face detection system: mature but not perfect  Critical to face-related vision/graphics tasks  Increasing requirement on accuracy and speed

54 References [Burges 1998] Burges, C. J. C. “A Tutorial on Support Vector Machines for Pattern Recognition”. 1998 [Freund 1996] Freund, Y. and Schapire, R.E. “Experiments with a new boosting algorithm”. 1996 [Viola 2004] Viola, P. and Jones, M.J. “Robust real-time face detection”. 2004.

55 Image Credits I.1http://images2.fanpop.com/images/photos/4700000/TBBT-Cast-the- big-bang-theory-4701578-594-455.jpg I.2http://www.google.com/search?q=gates I.3http://www.google.com/search?q=gates I.4http://pictures.labho.com/facebook-launches-facial-recognition- worldwide/ I.5http://www.youtube.com/watch?v=jsjf3IDXef8&feature=related I.6http://www.youtube.com/watch?v=meRSKCSod-A I.7http://www.wallpaperez.org/celebrities/Megan-Fox-face-758.html I.8http://www.arizonafoothillsmagazine.com/features/on-the-scene- with-nadine/2110-what-your-face-says-about-you.html I.9http://www.changeface.me/?c=cs I.10http://www.wired.com/gadgetlab/2008/06/four-crazy-conc/ I.11http://www.pets-and-all.com/?p=49

56 Image Credits I.12http://stereogum.com/48421scarlett_johansson_covers_jeff_buckley/ mp3s/ I.13http://www.slashgear.com/apples-iphone-os-4-0-brings-full-on- solution-for-multitasking-1177436/ I.14http://animal-world.com/dogs/Non-Sporting-Dog-Breeds/ NonSportingDogBreeds.php I.15http://www.visionhacker.com I.16http://www.wired.com/images_blogs/photos/uncategorized/ 2008/12/23/nikons60_2.jpg

Download ppt "Computer Vision Spring 2010 15-385,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #22."

Similar presentations

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
Detecting Faces in Images: A Survey

Detecting Faces in Images: A Survey
EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.

EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.
Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.

Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.
Face detection Behold a state-of-the-art face detector! (Courtesy Boris Babenko)Boris Babenko.

Face detection Behold a state-of-the-art face detector! (Courtesy Boris Babenko)Boris Babenko.
Face Detection & Synthesis using 3D Models & OpenCV Learning Bit by Bit Don Miller ITP, Spring 2010.

Face Detection & Synthesis using 3D Models & OpenCV Learning Bit by Bit Don Miller ITP, Spring 2010.
AdaBoost & Its Applications

AdaBoost & Its Applications
Face detection Many slides adapted from P. Viola.

Face detection Many slides adapted from P. Viola.
Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,

Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,
EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.

EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.
Viola/Jones: features “Rectangle filters” Differences between sums of pixels in adjacent rectangles { y t (x) = +1 if h t (x) >  t -1 otherwise Unique.

Viola/Jones: features “Rectangle filters” Differences between sums of pixels in adjacent rectangles { y t (x) = +1 if h t (x) >  t -1 otherwise Unique.
The Viola/Jones Face Detector Prepared with figures taken from “Robust real-time object detection” CRL 2001/01, February 2001.

The Viola/Jones Face Detector Prepared with figures taken from “Robust real-time object detection” CRL 2001/01, February 2001.
Computer Vision Spring 2006 15-385,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #20.

Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #20.
The Viola/Jones Face Detector (2001)

The Viola/Jones Face Detector (2001)
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
HCI Final Project Robust Real Time Face Detection Paul Viola, Michael Jones, Robust Real-Time Face Detetion, International Journal of Computer Vision,

HCI Final Project Robust Real Time Face Detection Paul Viola, Michael Jones, Robust Real-Time Face Detetion, International Journal of Computer Vision,
Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by.

Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by.
Face detection and recognition Many slides adapted from K. Grauman and D. Lowe.

Face detection and recognition Many slides adapted from K. Grauman and D. Lowe.
Face Recognition with Harr Transforms and SVMs EE645 Final Project May 11, 2005 J Stautzenberger.

Face Recognition with Harr Transforms and SVMs EE645 Final Project May 11, 2005 J Stautzenberger.
A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.

A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.

Similar presentations

Ads by Google