Defence Research and Development Canada Recherche et développement pour la défense Canada Canada Challenges and Potential Research Areas In Biometrics Qinghan Xiao and Karim Dahel Defence R&D Canada - Ottawa October 18, 2004

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Outline Spoofing & Anti-Spoofing –Liveness detection –Anti-spoofing Face Recognition –The most reliable passive biometric technology –Problems with 2D face recognition –Advantages and challenges of 3D face recognition Multimodal Biometrics –Multiple biometrics –Multi-modal biometrics Privacy Issue

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Fingerprint Sensor and Spoofing Popular Fingerprint Sensors –Optical sensor –Capacitive sensor –E-field sensor –Ultrasound sensor Spoofing and Anti-spoofing

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Optical Sensors Optical sensor is the oldest fingerprint-scanning device that consists of a source of light on one side and a camera with optical lens, on the other side to sense the transmitted light

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa The Advantages of Using CMOS Imagers Reduced Power Dissipation  not only extends battery life but also lower operating temperatures Flexible Access  allow to random access to a single pixel or a region of interest Increased Speed  in-pixel amplifier and on-chip A/D converter produce faster frame rates Easy Integration  on-chip integrated circuitry enables including processing and “seeing” functions in a signal package to act as a “smart” camera Lower Cost – can be fabricated at facilities that have higher volume and need less support circuitry to operate

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Capacitive Sensors The capacitive sensors capture the fingerprint pattern based on the measurement of the variation in capacity between skin and the sensor because there is a capacitive difference between skin-sensor and air-sensor.

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Electric-Field (El-Field ) Sensor Electric field (e-field) sensor is built of antenna array from a new electronic fingerprint technology developed by AuthenTec. Since it examines at the subsurface of the skin, skin surface issues, such as dry, worn, or dirty skin, cannot affect the image quality.

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Ultrasound Sensor Ultrasonic fingerprint scanner sends a short acoustic pulse toward a fingertip and measures the return echo signal. Based on the echo signal, a fingerprint image can be captured because there exists a difference in acoustic impedance between the skin and air.

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Spoofing Problem Fingerprint sensor can be attacked by –recovering latent fingerprint from sensor window, –using residual prints or –gelatine or silicon rubber to make fake fingers to fool the sensor

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Fingerprint Capture It is there Fingerprint can settle on the clean and smooth surface The problem is to make it visible Black toner is cheap and can be used to get the fingerprint

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Gummy Finger Put the plastic into hot water to soften it Press live finger against it The mold Pour the liquid into the mold Put it into a refrigerator to cool The gummy finger

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Anti-spoofing Techniques Temperature Heartbeat Skin Resistance Detection of Finger Bone LightPrint

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Face Recognition Problems with 2-D Facial Recognition –Illumination –Pose 3-D Facial Recognition –2D, 2.5D and 3D facial images –Major research areas –Multi-modal face recognition

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Illumination

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Poses

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa 2D Image Normal Intensity Image of The Face

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa 2.5D Image A Face Surface Representation

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa 3D Image Whole Head

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Research Areas in 3D Face Recognition Sensor Technology –Increased depth of field –Increased spatial resolution –Reduced acquisition time New Algorithms –Explore principal component analysis (PCA) –Use depth information provided by 2.5D range images –Investigate multi-modal face recognition

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Multiple and Multi-modal Biometrics Multiple Biometrics –Multi-input –Multi-sensor –Multi-algorithm –Multi-instance Multi-Modal Biometrics –Use more than one biometric modalities –Improve the flexibility –Increase the accuracy

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Multi-modal Biometrics Fusion Biometric Sensor I Match Decision Sensor Fusion Biometric Sensor II Confidence Fusion Decision Decision I Decision Fusion Accept Reject Decision II Templates Feature Extractor & Match II AcceptReject Feature Extractor & Match I AcceptReject Templates

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Independent Or Dependent Biometric Modality II Biometric Modality I Templates Matching Algorithm I Templates Matching Algorithm II Matching Score I Matching Score II Independent/ Uncorrelated Dependent/ Correlated FusionFusion Independent/ Uncorrelated Dependent/ Correlated Independent/ Uncorrelated

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Privacy Issues Consider essential and inessential privacy elements Build in protections for the privacy of the information in the system –Owner should have control of data Minimize the possibility of misuse or abuse of biometric technology –Biometric samples should never be exposed to unauthorized entities –Templates and credentials should be usable only by authorized application

Defence R&D Canada – Ottawa R & D pour la défense Canada – Ottawa Summary on Major Challenge and Research Areas Anti-Spoofing Accuracy Privacy Data Aging Problem Standards –Testing and evaluation –Template exchange