1. Modris Greitans, Arturs Kadikis, Rihards Fuksis Institute of Electronics and Computer Science Dzerbenes 14, Riga, Latvia e-mail: Rihards.Fuksis@edi.lv Biohashing and Fusion of Palmprint and Palm Vein Biometric Data Rihards Fuksis International Conference on Hand-based Biometrics International Conference on Hand-based Biometrics November 17-18, Hong Kong

2. Rihards Fuksis International Conference on Hand-based Biometrics Motivation Multimodal Palm Biometrics Provides: Easy enrolment Unique parameters Hard to falsify

3. Rihards Fuksis International Conference on Hand-based Biometrics Image Acquisition (I) White LEDs In visible light spectrum using white LEDs

4. Rihards Fuksis International Conference on Hand-based Biometrics Image Acquisition (II) IR LEDs In infrared light spectrum using IR LEDs

5. Rihards Fuksis International Conference on Hand-based Biometrics Image processing (I) Cross section of the ridge Cross section of the vessels

6. Rihards Fuksis International Conference on Hand-based Biometrics Image processing (II) Complex 2D Matched Filtering: Based on the matched filtering Improved processing speed Obtains vectors: magnitude – matching rate; angle - orientation in the image Cross section of the ridgeCross section of the vessels For further information: M.Greitans, M.Pudzs, R.Fuksis. Object Analysis in Images Using Complex 2d Matched Filters, Proceedings of the IEEE Region 8 Conference EUROCON 2009. Saint–Petersburg, Russia, May, 2009., pp. 1392-1397.

7. Rihards Fuksis International Conference on Hand-based Biometrics Image processing (III) Feature extraction Most significant vectors are extracted to describe the object. The result is a data set of 64 vectors (256 bytes) Filtering resultVector set

8. Rihards Fuksis International Conference on Hand-based Biometrics Vector set AVector set B Vector set from the database Acquired vector set Raw biometric data comparison

9. Rihards Fuksis International Conference on Hand-based Biometrics Vector comparison Magnitudes:

10. Rihards Fuksis International Conference on Hand-based Biometrics Vector comparison Magnitudes: Angles:

11. Rihards Fuksis International Conference on Hand-based Biometrics Vector comparison Magnitudes: Angles: Distance:

12. Rihards Fuksis International Conference on Hand-based Biometrics Vector comparison Magnitudes: Angles: Distance: Dot product

13. Rihards Fuksis International Conference on Hand-based Biometrics Vector set comparison Similarity of two vector sets: Similarity index is normalized so that S(A,B) is in the [0;1] Similarity index of two vectors:

14. Rihards Fuksis International Conference on Hand-based Biometrics Security of raw biometric data usage It is unsecure to use raw biometric data Therefore encryption must be introduced Raw biometric data 10110001 1110 0010 Encrypted data

15. Rihards Fuksis International Conference on Hand-based Biometrics Inner product Biohash CMF Palm image PixelsVectors Vector Set (u,v) dv du u1u1 v1v1 du 1 dv 1 1st vector uRuR vRvR du R dv R... R-th vector Inner product... Token Thresholding Random number matrix 101 Biocode Data vector consists of 4R components... Biocode consists of 4R bits

16. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(I) Filtered palm vein image

17. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(I) 762718749 831638744 528514683 41578751 Filtered palm vein image Extracted vector magnitudes

18. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(I) 762718749 831638744 528514683 41578751 0010 0100 0010 0000 Filtered palm vein image Extracted vector magnitudesMost intensive vector labeling

19. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(I) Filtered palm vein image Extracted vector magnitudesMost intensive vector labeling u1u1 v1v1 du 1 dv 1 uRuR vRvR du R dv R... Data vector + 001001...0 Most intensive vector information 762718749 831638744 528514683 41578751 0010 0100 0010 0000

20. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(I) Filtered palm vein image Extracted vector magnitudesMost intensive vector labeling u1u1 v1v1 du 1 dv 1 uRuR vRvR du R dv R... Data vector + Most intensive vector information New Data vector 762718749 831638744 528514683 41578751 0010 0100 0010 0000 001001...0

21. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(II) 110... 101 110 111 Person 1; Biocode No.1 Person 1; Biocode No.2 Person 1; Biocode No.3 Person 1; Biocode No.4 432 By looking at the values before the thresholding in Biohash algorithm, we can obtain the information about the distance from threshold value for each of the bits in biocodes Dot product Random number matrix Data vector Thresholding Capture this value Calculate the distance to the threshold

22. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(II) Bit #1Bit #2Bit #3 1 0.61 10.3300.04... 1 0.47 00.1210.15... 1 0.59 10.4700.18... 1 0.46 10.3910.14... 4 2.13 31.1920.29... Person 1; Biocode No.1 Person 1; Biocode No.2 Person 1; Biocode No.3 Person 1; Biocode No.4 Distance to the threshold Bit #1 Bit #2 Bit #3 If the distance to the threshold value is greater, the resulting bit most likely will not change between one persons biocodes...

23. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(II) Distance to the threshold Bits Distance to the threshold 4 3 2 Sort bits into groups

24. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(II) Distance to the threshold 4 3 2 Distance to the threshold 4 3 2 Sort bits in every group in ascending order

25. Rihards Fuksis International Conference on Hand-based Biometrics Biohash Advancements(II) Distance to the threshold 4 3 2 What we obtain is the indexes of the most stable bits in descending order. When comparing two biocodes this information is used to calculate weights for the errors of the bits by using exp or other function Weight function

26. Rihards Fuksis International Conference on Hand-based Biometrics Biocode comparison = 4 mistakes Similarity: l – length of the biocode D h – Hamming distance

27. Rihards Fuksis International Conference on Hand-based Biometrics Database evaluation Two databases; 500 images from 50 persons 5 images in IR and 5 in visible light spectrum Palm VeinsPalmprintsFused data Mean14.04312.0736.190 StDev1.1521.1020.803 Palm VeinsPalmprintsFused data Mean1.0730.4710 StDev0.3040.2310 Biohash test results [EER] Proposed Biohash test results [EER] Palm VeinsPalm PrintsFused data EER [%]0.322.790.1 Raw biometric data comparison results[EER]

28. Rihards Fuksis International Conference on Hand-based Biometrics Conclusions Complex 2D Matched Filtering approach speeds up the feature extraction procedure. Biohashing with proposed advancements can be used as a method for securing the biometric data with similar or better precision as raw biometric data comparison gives Future work: Tests on larger databases and evaluation of other biometric encryption methods

29. Rihards Fuksis International Conference on Hand-based Biometrics This presentation was supported by ERAF funding under the agreement No.2010/0309/2DP/2.1.1.2.0/10/APIA/VIA/012