Briefing for NIST Acting Director James Turner regarding visit from EAC Commissioners March 26, 2008 For internal use only 1.

Slides:



Advertisements
Similar presentations
TGDC Meeting, December 2011 Usability and Accessibility (U&A) Research Update Sharon J. Laskowski, Ph.D.
Advertisements

A technical analysis of the VVSG 2007 Stefan Popoveniuc George Washington University The PunchScan Project.
IEEE P1622 Meeting, Oct 2011 IEEE P1622 Meeting October 24-25, 2011 Overview of IEEE P1622 Draft Standard for Electronic Distribution of Blank Ballots.
TGDC Meeting, July 2011 Review of VVSG 1.1 Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
© Copyright 2009 TEM Consulting, LP - All Rights Reserved Presentation To Travis County, TX - May 27, 2009Rev 1 – 05/22/09 - HSB US Voting System Conformity.
TGDC Meeting, Jan 2011 VVSG 1.1 Test Suite Status Mary Brady National Institute of Standards and Technology
United States Election Assistance Commission Pilot Program Testing and Certification Manual & UOCAVA Pilot Program Testing and Certification Manual & UOCAVA.
Voting System Qualification How it happens and why.
12/9-10/2009 TGDC Meeting TGDC Recommendations Research as requested by the EAC John P. Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 UOCAVA Pilot Projects for the 2012 Federal Election Report from the UOCAVA Working Group Andrew Regenscheid National Institute of.
NVLAP Overview and Accreditation Process March 2006.
TGDC Meeting, July 2011 Overview of July TGDC Meeting Belinda L. Collins, Ph.D. Senior Advisor, Voting Standards, ITL
Election Assistance Commission United States VVSG Technical Guidelines Development Committee (TGDC) NIST July 20, 2015 Gaithersburg,
NIST VOTING PROGRAM MARY BRADY, PROGRAM MANAGER. Outline  Motivation & Congressional Mandates  Help America Vote Act  Current Challenges  Engage the.
Testing Summit Sacramento, CA November 28, 2005 Barbara Guttman National Institute of Standards and Technology
United States Election Assistance Commission EAC UOCAVA Documents: Status &Update EAC Technical Guidelines Development Committee Meeting (TGDC)
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
EAC-requested VVSG Research Overview and Status June 2008 Mark Skall Chief, Software Diagnostics and Conformance Testing Division National Institute of.
Demystifying the Independent Test Authority (ITA)
TGDC Meeting, July 2011 UOCAVA Roadmap Update Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
TGDC Meeting, July 2011 IEEE P.1622 Update John P. Wack Computer Scientist, Software and Systems Division, ITL
NIST HAVA-Related Work: Status and Plans June 16, 2005 National Institute of Standards and Technology
Making every vote count. United States Election Assistance Commission HAVA 101 TGDC Meeting December 9-10, 2009.
12/9-10/2009 TGDC Meeting NIST Research on UOCAVA Voting Andrew Regenscheid National Institute of Standards and Technology
IEEE P1622 Meeting, Feb 2011 Common Data Format (CDF) Update John P. Wack National Institute of Standards and Technology
Improving U.S. Voting Systems Interoperability in Election Data and Devices TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 1 John P. Wack.
Accreditation for Voting Equipment Testing Laboratories Gordon Gillerman Standard Services Division Chief
Usability and Accessibility Working Group Report Sharon Laskowski, PhD National Institute of Standards and Technology TGDC Meeting,
12/9-10/2009 TGDC Meeting Open Ended Vulnerability Testing Update Nelson Hastings National Institute of Standards and Technology
TGDC Meeting, December Common Data Format Directions John P. Wack National Institute of Standards and Technology
NIST Voting Program Activities Update February 21, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.
TGDC Meeting, Jan 2011 Accessibility and Usability Considerations for UOCAVA Remote Electronic Voting Systems Sharon Laskowski, PhD National Institute.
TGDC Meeting, Jan 2011 Auditability Working Group David Flater National Institute of Standards and Technology r4.
VVSG: Usability, Accessibility, Privacy 1 VVSG, Part 1, Chapter 3 Usability, Accessibility, and Privacy December 6, 2007 Dr. Sharon Laskowski
12/9-10/2009 TGDC Meeting Usability and Accessibility Progress and Challenges Sharon Laskowski, PhD National Institute of Standards and Technology
Panel One Why Audit? Mary Batcher Ernst & Young and Chair of ASA Working Group on Elections.
Test Plans, Test Cases, and Test Reports
Making every vote count. United States Election Assistance Commission EAC Voting System Certification TGDC Meeting December 9-10, 2009.
TGDC Meeting, July 2010 Report of the UOCAVA Working Group John Wack National Institute of Standards and Technology DRAFT.
1 The Evolution of Voting Systems Paul DeGregorio Vice Chairman Donetta Davidson Commissioner The U.S. Election Assistance Commission.
NC Voting Systems How do S.L and HAVA impact the voting system in your county and what duties must you quickly perform?
NIST Voting Program Page 1 NIST Voting Program Lynne Rosenthal National Institute of Standards and Technology
TGDC Meeting, December 2011 Overview of December TGDC Meeting Belinda L. Collins, Ph.D. Senior Advisor, Voting Standards
NIST Voting Program Barbara Guttman 12/6/07
TGDC Meeting, July 2011 Voluntary Voting System Guidelines Roadmap Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
TGDC Meeting, Jan 2011 Help America Vote Act (HAVA) Roadmap Nelson Hastings National Institute of Standards and Technology
TGDC Meeting, July 2010 Report on Other Resolutions from Dec 2009 TGDC Meeting John Wack National Institute of Standards and Technology
© Copyright 2005 TEM Consulting, LP - All Rights Reserved Presentation To EAC Aug. 23, 2005 Hearing, Denver, CORev 1 – 08/16/05 - HSB Considerations In.
TGDC Meeting, Jan 2011 Common Data Format (CDF) Update John P. Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 Review of UOCAVA Roadmap Nelson Hastings National Institute of Standards and Technology
NIST Voting Program Activities Update January 4, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.
Next VVSG Training Standards 101 October 15-17, 2007 Mark Skall National Institute of Standards and Technology
1 DECEMBER 9-10, 2009 Gaithersburg, Maryland TECHNICAL GUIDELINES DEVELOPMENT COMMITTEE Commissioner Donetta Davidson.
The VVSG Version 1.1 Overview Matthew Masterson Election Assistance Commission
EAC-requested VVSG Research Overview and Status June 2008 Mark Skall Chief, Software Diagnostics and Conformance Testing Division National Institute of.
Test Assertions What are they and why do we need them? Mark Skall 1.
TGDC Meeting, July 2010 Overview of NIST Activities and TGDC Meeting Agenda Martin Herman, PhD National Institute of Standards and Technology
Creating Accessibility, Usability and Privacy Requirements for the Voluntary Voting System Guidelines (VVSG) Whitney Quesenbery TGDC Member Chair, Subcommittee.
12/9-10/2009 TGDC Meeting The VVSG Version 1.1 Overview John P. Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 Development of High Level Guidelines for UOCAVA voting systems Andrew Regenscheid National Institute of Standards and Technology.
TGDC Meeting, Jan 2011 Path Forward for FY11 UOCAVA Activities Nelson Hastings National Institute of Standards and Technology
Briefing for the EAC Public Meeting Boston, Massachusetts April 26, 2005 Dr. Hratch Semerjian, Acting Director National Institute of Standards and Technology.
Next VVSG Training Security: Testing Requirements October 15-17, 2007 Nelson Hastings Alicia Clay Jones National Institute of Standards and Technology.
12/9-10/2009 TGDC Meeting NIST-developed Test Suites David Flater National Institute of Standards and Technology
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
TGDC Meeting, July 2011 VVSG 1.1 Test Suite Status Mary Brady Manager, NIST Information Systems Group, Software and Systems Division, ITL
12/9-10/2009 TGDC Meeting Alternatives to Software Independence Nelson Hastings National Institute of Standards and Technology
The VVSG 2005 Revision Overview EAC Standards Board Meeting February 26-27, 2009 John P. Wack NIST Voting Program National Institute.
National Institute of Standards and Technology
UOCAVA Electronic Blank Ballot Delivery Use Case
Presentation transcript:

Briefing for NIST Acting Director James Turner regarding visit from EAC Commissioners March 26, 2008 For internal use only 1

Briefing Purpose and Overview Purpose: to prepare for the EAC visit Overview: 1.Current NIST voting activities and plans 2.EAC concerns 3.Supporting background material 4.Detailed discussion 2

Current Voting Activities Work Plan Funding - $3.25M Assisting the EAC in vetting next VVSG – Met with Standards and Advisory Boards – Assist in resolution of public reviews – Participate in EAC public roundtable discussions – Perform additional research in support of EAC issues Developing test suite for next VVSG – Target areas where tests could apply to VVSG 2005 – Important to build test suite early on Feedback to standard while it can still be updated Helps manufacturers build quality products Preparing guidance for UOCAVA (Uniformed and Overseas Citizens Absentee Voting Act) issues Continuing NVLAP accreditation of voting system test labs 3

EAC Concerns 1.Changes to next VVSG Perform additional research in support of making major changes to key areas 2.Support for VVSG 2005 Retrofit VVSG 2005 with material from next VVSG Refocus next VVSG test development on VVSG Issues with NVLAP Review management practices of labs Review validity of lab-developed test suites 4

Supporting Background Material 1.HAVA and TGDC 2.Voting Standards and Test Development Activities 3.UOCAVA (Uniformed and Overseas Citizens Absentee Voting Act) support 4.NVLAP accreditation of voting system test labs 5

HAVA Passed in 2002 in wake of 2000 elections Gave money to states to buy new equipment Created EAC and TGDC to work in conjunction with NIST 6 NIST HAVA Responsibilities Chair TGDC Provide technical support to TGDC in development of VVSG Recommend independent testing labs to EAC for accreditation

2005 Voluntary Voting System Guidelines Created in 9 months Improves the 2002 VSS by addressing: – Human Factors – VVPAT (Voter Verifiable Paper Audit Trails) – Wireless – Software Distribution and Setup Validation – Conformance, Glossary, Error Rates 7

What is the Next VVSG? Complete re-write of VVSG 2005 More usable, precise standard Will be accompanied by a public test suite under development by NIST Key new items (of concern to EAC): – Software Independence (SI) – The Innovation Class – Open Ended Vulnerability Testing (OEVT) 8

Software Independence Voting systems must be SI – Accuracy of the election must not rely exclusively on the accuracy of the voting system software – Accuracy of the system’s electronic records will be able to be independently audited against an independent voter- verified record (IVVR) – Systems that do this currently are paper-based e.g., optical scan, VVPAT 9

Innovation Class Next VVSG includes an Innovation Class – Allows developers to create new and innovative, possibly paperless, voting system approaches that would still be independently auditable and conform to the next VVSG – May include newer, cryptographic-based systems that potentially promise greater usability and accessibility as well as security – Requires more definition by EAC to develop policy and procedures 10

OEVT Expert security review during conformance testing Involves a red-team* approach to finding problems not caught by other testing Concern expressed by EAC, test labs, election officials over its – repeatability – open-ended nature – potential cost * red team - independent review of voting system security 11

UOCAVA Uniformed and Overseas Citizens Absentee Voting Act support At request of EAC, NIST writing guidance to assist states in electronic alternatives to postal-based methods for sending registration and ballot materials Smaller effort than standards and testing efforts 12

NVLAP Mandated by HAVA to investigate and recommend voting system test labs to EAC NIST NVLAP has recommended 4 labs to EAC for accreditation as Voting System Test Labs (VSTLs) NVLAP examines labs capability to test voting systems according to standards in place 13

Discussion of EAC Concerns 1.Changes to next VVSG – Perform additional research in support of potential major changes to key areas 2.Support for VVSG 2005 – Retrofit VVSG 2005 with material from next VVSG – Refocus next VVSG test development on VVSG Issues with NVLAP – Review management practices of labs – Review validity of lab-developed test suites 14

1. Changes to Next VVSG EAC has extended public review of next VVSG: – Gathering input from public review, public roundtables – SI and other requirements caused controversy with election officials, Standards Board, manufacturers – Concern with increase in cost of testing EAC asked NIST to perform additional research: (formal letter sent to Mark Skall ) – Alternatives to SI that don’t require paper trails – Impact of certifying parts of voting systems (components) Output of research and recommendations should involve participation of TGDC 15

2. Support for VVSG 2005 EAC may ask NIST to: Add/retrofit material from next VVSG to VVSG 2005 – Possibly: Volume testing, aspects of OEVT Develop a test suite for VVSG 2005 – Says that current tests by labs not adequate, they think a common test suite is needed Concerns – Ambiguous, incomplete, un-testable requirements – Resource re-alignment 16

3. NVLAP 17 EAC has issues with some aspects of VSTL performance Letter sent to Mary Saunders – NVLAP to review how labs utilize appropriately qualified staff for testing – NVLAP to review validity of test methods used by labs

Discussion 18