We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byNina Hing
Modified over 2 years ago
Iris Recognition Device Usability as Observed in Comparative Testing The International Workshop on Usability and Biometrics 24 June 2008 Michael Thieme Director of Special Projects International Biometric Group Copyright © 2008 International Biometric Group
© Copyright 2007 International Biometric Group Page 2© Copyright 2008 International Biometric Group Page 2 Topics Iris recognition capture device landscape Application-specific usability Special considerations in mobile collection Evaluating usability through scenario testing Usability-related performance test results Observations on iris usability Potential research areas
© Copyright 2007 International Biometric Group Page 3© Copyright 2008 International Biometric Group Page 3 About International Biometric Group International Biometric Group, LLC –Founded 1996; 40 employees –Staff in New York, DC Metro, San Francisco –Technology-neutral, vendor-independent Biometric systems integration –Design, develop, implement biometric identification systems –From mobile data collection to large-scale matching Biometric R&D and evaluation –10+ years of biometric R&D and evaluation expertise –Conducted $5m+ in USG-funded biometric R&D Biometric consulting –SMEs for USG agencies: DHS, Executive Branch, IC –Insight into biometric vendors, industry landscape –Hands-on experience with all biometric technologies
© Copyright 2007 International Biometric Group Page 4© Copyright 2008 International Biometric Group Page 4 Iris Recognition Testing Experience Comparative Biometric Testing (1998-present) –Tested Panasonic AuthentiCam, LG2200, IrisGuard, JIRIS –Standardized scenario test methodology applicable to fingerprint, face, voice, signature, hand, vein –First test effort to measure and report false non-match and failure-to-enroll rates for iris recognition DHS Independent Testing of Iris Recognition Technology ( ) –Collected approximately 120,000 irises, conducted 2b matches –First test to evaluate interoperability across multiple iris devices –First test to measure statistically significant false match rates Currently performing operational testing for tactical field deployments of iris recognition devices (GWOT) –Factors: usability, data quality
© Copyright 2007 International Biometric Group Page 5© Copyright 2008 International Biometric Group Page 5 Iris Recognition Capture Device Landscape Considerable variation across iris recognition devices –Single vs. dual-iris imagers –Simultaneous vs. serial capture –User-adjusted vs. auto-adjusting –Fixed-focal length vs. auto-focus –Volumetric range –Audio and visual prompts –Single-capture enrollment vs. multi-capture enrollment Arguably greater inter-device variation than in any other modality
© Copyright 2007 International Biometric Group Page 6© Copyright 2008 International Biometric Group Page 6 Application-Specific Usability Registered traveler –Educated, tech-savvy, motivated users; low habituation; low throughput demands –Perception of invasiveness not tolerable High-end access control –Motivated, habituated users; rapid throughput required –Device must be calibrated for fast capture Benefits issuance / immigration control (Pak / UAE) –Low habituation, limited familiarity with technology; motivation may be questionable; can be invasive –Deployer may deploy head brace or other harness Mobile population control –Similar to preceding, with addition of environmental challenges (see discussion below); perceived invasiveness may be the point
© Copyright 2007 International Biometric Group Page 7© Copyright 2008 International Biometric Group Page 7 Special Considerations in Mobile Collection Mobile iris collection a dynamic area –~1m irises collected through BAT Adds the operator as a variable –What prompts are most instructive to an operator? –Does the operator have two hands free? –How close is too close? –Tactile vs. distance-based devices
© Copyright 2007 International Biometric Group Page 8© Copyright 2008 International Biometric Group Page 8 Measuring Usability in Scenario Testing Performance metrics applicable to usability –Failure to enroll / failure to acquire rate –Transaction time –False non-match rate –These are indirect measures of usability, conflated with other factors Challenge: how to habituate users in a highly compressed test timeframe, while still allowing for device- to-device differentiation –More training penalizes easy-to-use devices; less training penalizes difficult-to-use devices –Can run multiple, sequential recognition transactions to drive muscle memory in test subjects
© Copyright 2007 International Biometric Group Page 9© Copyright 2008 International Biometric Group Page 9 Usability and Transaction Duration
© Copyright 2007 International Biometric Group Page 10© Copyright 2008 International Biometric Group Page 10 Usability and FTE / Non-Match Errors
© Copyright 2007 International Biometric Group Page 11© Copyright 2008 International Biometric Group Page 11 FTA by Age Range LG IrisAccess 3000 Age Range Recognition Attempts Recognition Attempts with No Sample Acquired FTA Total % % % OKI IRISPASS-WG Age Range Recognition Attempts Recognition Attempts with No Sample Acquired FTA Total % % % Panasonic BM-ET300 Age Range Recognition Attempts Recognition Attempts with No Sample Acquired FTA Total % % %
© Copyright 2007 International Biometric Group Page 12© Copyright 2008 International Biometric Group Page 12 Observations on Iris Usability Iris recognition trails most other biometrics in terms of usability, but improvement is continual Dual-iris mirror imagers are problematic –Adjustment for stronger eyes lead to misalignment, looking with wrong eye – leads to failures or off-axis captures –Difficult to develop an interface intuitive for non-engineers –Primary value is in reducing sequencing errors, not simplifying capture Older users have more difficulty interacting with devices –Vision? Technology exposure? Other factors… Substantial progress has been made in vicinity capture –User stands in specified area, looks in general direction of imager; no explicit alignment –Attempt to eliminate problem of initial orientation (distance from device, where to look)
© Copyright 2007 International Biometric Group Page 13© Copyright 2008 International Biometric Group Page 13 Potential Research Areas Enrollment / recognition through multiple, lower-quality video frames Addressing dominant and weak eyes Correcting sequence errors Usability as a function of operator skills (mobile)
© Copyright 2007 International Biometric Group Page 14© Copyright 2008 International Biometric Group Page 14 Contact Michael Thieme (NY Office) (Mobile)
Measuring Usability of Biometrics Review of Experiences at NPL Linda Johnstone Sorensen
1 Note content copyright © 2004 Ian Sommerville. NU-specific content copyright © 2004 M. E. Kabay. All rights reserved. Software Evolution IS301 – Software.
1 EDC: THE EXPERIENCE OF A CRO. 2 INTRODUCTION Expenditure on research and development by pharmaceutical industry is increasing worldwide and is currently.
Berling Associates, Inc. 1 T.E.A.M. EFFORT A Primer on Process Management (A View From The Improvements Team Perspective)
MFG Assessment Application: Assessment Criteria and Metrics 1 Performance assessment criteria and metrics may be used as the basis for determining the.
Final Report – November 3, 2003 Organization of American States Management Study of the Operations of the General Secretariat Part I – Executive Summary.
1 Lecture 2. Integrated Logistics Support Lecturer: Prof. Anatoly Sachenko Informatics in Logistics Management.
A Practical Approach to Accelerating the Clinical Development Process Jerald S. Schindler, Dr.P.H. Assistant Vice President Global Biostatistics & Clinical.
10-1 McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved.
Training on Cost Estimation & Analysis Karen Richey Jennifer Echard Madhav Panwar.
Copyright © The David Consulting Group, Inc. 1 UNDERSTANDING and EFFECTIVELY USING FUNCTIONAL MEASUREMENT Presented By The David Consulting Group.
Next Generation – The Future for Emergency Communications.
Final Report – November 3, 2003 Organization of American States Management Study of the Operations of the General Secretariat Part II – Detailed Observations.
AMA Content Needs Assessment Nancy Pekala
1 Validation & Measurement Methods for the PHARE Demonstrations R A Whitaker Validation Project Leader.
International Workshop on Usability and Biometrics: NIST Welcome Martin Herman, Ph.D. Chief, Information Access Division.
© Copyright QinetiQ limited 2007 QinetiQ Proprietary Human Aspects of NEC: Decision- Making, Organisation and Information Dr Andy Belyavin.
RESPONSE TO INTERVENTION Information Session for Elementary Administrators Delaware Department of Education.
1 Chapter 12 User Interface Design. 2 Interface Design Easy to use? Easy to understand? Easy to learn?
Contact Solution Options Assessment and High Level Implementation Plan – Initial Draft Version East Devon District Council February, 2005.
Julie Poroznuk, ABC CEBS JP Communication May 2007 Managing and Measuring Intranet Content.
1.Five years after a new product has been introduced, sales begin to level off because customers are purchasing the competitor's brand. What strategy would.
Human Factors in VR Electrical and Computer Engineering Dept.
1 Problem Solving Model Preparation for Implementation Adapted from the NC Department of Public Instruction.
Intelligent Risk Management & Compliance Cost Reduction Creating a sustainable risk and compliance organization while reducing inefficiency and improving.
The Need for Finance Transformation NASACT Conference, Chicago, Illinois Sharon Minnich – Deputy Secretary for Finance Administration Christina Dorfhuber.
BPM from IBM: Strategy and Directions Clyde Hinshelwood BPM Leader Southwest Europe
Reward Systems. Fall 2008MGMT 412 | Reward SystemsPage 2 Compensation Theory, Job Evaluation and Pay Administration Why is compensation important to organizations?
© 2016 SlidePlayer.com Inc. All rights reserved.