INTERNATIONAL ISO/IEC STANDARD 19795-1 Second edition 2021-05 Information technology Biometric performance testing and reporting Part 1: Principles and framework Technologies de I'information - Essais et rapports de performance biométriques - Partie 1: Principes et canevas Reference number TEC IS0/IEC19795-1:2021(E) tso @IS0/IEC2021 IS0/IEC 19795-1:2021(E) COPYRIGHT PROTECTED DOCUMENT IS0/IEC2021 All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either IsO at the address below or IsO's member body in the country of the requester. ISO copyright office CP 401 : Ch. de Blandonnet 8 CH-1214 Vernier, Geneva Phone:+4122 749 0111 Email: [email protected] Website:www.iso.org Published in Switzerland i @ IS0/IEC 2021 - All rights reserved IS0/IEC 19795-1:2021(E) Contents Page Foreword .vi Introduction. ..vii 1 Scope. .1 2 Normative references. ..1 3 Terms and definitions .1 4 Abbreviated terms .5 5 Conformance. 6 6 General biometric system .6 6.1 Conceptual representation of general biometric system .6 6.2 Conceptual components of a general biometric system. 7 6.2.1 Data capture subsystem 7 6.2.2 Transmission subsystem 7 6.2.3 Signal processing subsystem. 7 6.2.4 Data storage subsystem. .8 6.2.5 Comparison subsystem. 8 6.2.6 Decision subsystem. .8 6.2.7 Administration subsystem 9 6.2.8 Interface to external application .9 6.3 Functions of general biometric system. 9 6.3.1 Enrolment 9 6.3.2 Verification of a positive biometric claim 10 6.3.3 Identification. 11 6.4 Enrolment, verification and identification transactions. 11 6.5 Performance measures .12 6.5.1 Error rates 12 6.5.2 Throughput rates. 12 6.5.3 Types of performance testing .13 7 Planning the evaluation .13 7.1 General 13 7.2 Determine information about the system .14 7.3 Controlling factors that influence performance 15 7.4 Test subject selection 16 7.5 Test size. 17 7.5.1 General 17 7.5.2 Collecting multiple recognition transactions per test subject per system .17 7.5.3 Requirements on test size. .18 7.6 Multiple tests .18 8 Data collection .19 8.1 Avoidance of data collection errors 19 8.2 Data and details collected. 19 8.3 Enrolments 20 8.3.1 Enroiment transactions 20 8.3.2 Enrolment conditions 21 8.3.3 Enrolment failures and presentation errors 21 8.4 One-to-one comparison trials. 22 8.4.1 General. 22 8.4.2 Collection conditions. 22 8.4.3 Frequency of use. 22 8.4.4 Systems performing optimization based on enrolled references. 23 8.4.5 Systems performing reference adaptation .23 8.4.6 Processes for data entry errors and system misuse 23 @ IS0/IEC 2021 - All rights reserved ii IS0/IEC 19795-1:2021(E) 8.4.7 Failures to acquire .23 8.4.8 Adding test data to the corpus .23 8.4.9 Online comparison trials .23 8.4.10 Offline comparison trials .24 8.4.11 Offline non-mated comparison trials when references are dependent .25 8.4.12 Offline non-mated comparison trials based on comparison of references 25 8.4.13 Use of samples from multi-capture comparison transactions. 25 8.5 Identification trials. .26 8.5.1 General. ..26 8.5.2 Identification testing with non-enrolled test subjects .26 8.5.3 Use of jack-knife approach for identification testing. .26 9 Analyses .26 9.1 General 26 9.2 Performance of biometric enrolment. .27 9.2.1 Failure-to-enrol rate.. .27 9.2.2 Enrolment transaction duration .27 9.3 Performance of biometric acquisition.. 28 9.3.1 Failure-to-acquire rate 28 9.3.2 Acquisition process duration. 28 9.3.3 Other aspects of acquisition performance .28 9.4 One-to-one comparison performance.. 29 9.4.1 False non-match rate. .29 9.4.2 False match rate. 29 9.5 Verification system performance metrics. .30 9.5.1 General. .30 9.5.2 False reject rate. .30 9.5.3 False accept rate. .3