NIST Voting Program Activities Update January 4, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.

Slides:



Advertisements
Similar presentations
TGDC Meeting, December 2011 Usability and Accessibility (U&A) Research Update Sharon J. Laskowski, Ph.D.
Advertisements

TGDC Meeting, July 2010 Report of the Auditability Working Group David Flater National Institute of Standards and Technology DRAFT.
Writing Quality Specifications July 9, 2004 Mark Skall Acting Director, Information Technology Laboratory National Institute of Standards and Technology.
TGDC Meeting, July 2011 Review of VVSG 1.1 Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
© Copyright 2009 TEM Consulting, LP - All Rights Reserved Presentation To Travis County, TX - May 27, 2009Rev 1 – 05/22/09 - HSB US Voting System Conformity.
Observation of e-enabled elections Jonathan Stonestreet Council of Europe Workshop Oslo, March 2010.
TGDC Meeting, Jan 2011 VVSG 1.1 Test Suite Status Mary Brady National Institute of Standards and Technology
Voting System Qualification How it happens and why.
12/9-10/2009 TGDC Meeting TGDC Recommendations Research as requested by the EAC John P. Wack National Institute of Standards and Technology
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Improving U.S. Voting Systems The Voters’ Perspective: Next generation guidelines for usability and accessibility Sharon Laskowski NIST Whitney Quesenbery.
Internal Auditing and Outsourcing
TGDC Meeting, July 2011 Overview of July TGDC Meeting Belinda L. Collins, Ph.D. Senior Advisor, Voting Standards, ITL
TGDC Meeting, December 2011 Michael Kass National Institute of Standards and Technology Update on SAMATE Automated Source Code Conformance.
TGDC Meeting, July 2011 Update on the UOCAVA Working Group Andrew Regenscheid Mathematician, Computer Security Division, ITL
Election Assistance Commission United States VVSG Technical Guidelines Development Committee (TGDC) NIST July 20, 2015 Gaithersburg,
3 Dec 2003Market Operations Standing Committee1 Market Rule and Change Management Consultation Process John MacKenzie / Darren Finkbeiner / Ella Kokotsis,
TGDC Meeting, July 2011 Usability and Accessibility Test Methods: Preliminary Findings on Validation Sharon Laskowski, Ph.D. Manager, NIST Visualization.
Testing Summit Sacramento, CA November 28, 2005 Barbara Guttman National Institute of Standards and Technology
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
EAC-requested VVSG Research Overview and Status June 2008 Mark Skall Chief, Software Diagnostics and Conformance Testing Division National Institute of.
Demystifying the Independent Test Authority (ITA)
NIST HAVA-Related Work: Status and Plans June 16, 2005 National Institute of Standards and Technology
Making every vote count. United States Election Assistance Commission HAVA 101 TGDC Meeting December 9-10, 2009.
12/9-10/2009 TGDC Meeting NIST Research on UOCAVA Voting Andrew Regenscheid National Institute of Standards and Technology
Laboratory Accreditation as a Component of the Help America Vote Act Mary H. Saunders Chief, Standards Services Division.
IEEE P1622 Meeting, Feb 2011 Common Data Format (CDF) Update John P. Wack National Institute of Standards and Technology
Improving U.S. Voting Systems Security Breakout Session Improving U.S. Voting Systems Andrew Regenscheid National Institute.
Accreditation for Voting Equipment Testing Laboratories Gordon Gillerman Standard Services Division Chief
Usability and Accessibility Working Group Report Sharon Laskowski, PhD National Institute of Standards and Technology TGDC Meeting,
Briefing for NIST Acting Director James Turner regarding visit from EAC Commissioners March 26, 2008 For internal use only 1.
NIST Voting Program Activities Update February 21, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.
TGDC Meeting, Jan 2011 Accessibility and Usability Considerations for UOCAVA Remote Electronic Voting Systems Sharon Laskowski, PhD National Institute.
TGDC Meeting, Jan 2011 Auditability Working Group David Flater National Institute of Standards and Technology r4.
VVSG: Usability, Accessibility, Privacy 1 VVSG, Part 1, Chapter 3 Usability, Accessibility, and Privacy December 6, 2007 Dr. Sharon Laskowski
Election Assistance Commission 1 Technical Guidelines Development Committee Meeting Certification Updates July 20, United States.
12/9-10/2009 TGDC Meeting Usability and Accessibility Progress and Challenges Sharon Laskowski, PhD National Institute of Standards and Technology
Panel One Why Audit? Mary Batcher Ernst & Young and Chair of ASA Working Group on Elections.
Test Plans, Test Cases, and Test Reports
Making every vote count. United States Election Assistance Commission EAC Voting System Certification TGDC Meeting December 9-10, 2009.
How and what to observe in e-enabled elections Presentation by Mats Lindberg, Election Adviser, Organisation for Security and Co-operation in Europe (OSCE)
TGDC Meeting, July 2010 Report of the UOCAVA Working Group John Wack National Institute of Standards and Technology DRAFT.
1 The Evolution of Voting Systems Paul DeGregorio Vice Chairman Donetta Davidson Commissioner The U.S. Election Assistance Commission.
NIST Voting Program Page 1 NIST Voting Program Lynne Rosenthal National Institute of Standards and Technology
TGDC Meeting, December 2011 Overview of December TGDC Meeting Belinda L. Collins, Ph.D. Senior Advisor, Voting Standards
NIST Voting Program Barbara Guttman 12/6/07
TGDC Meeting, July 2011 Voluntary Voting System Guidelines Roadmap Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
Project management Topic 3 Quality.
TGDC Meeting, Jan 2011 Help America Vote Act (HAVA) Roadmap Nelson Hastings National Institute of Standards and Technology
TGDC Meeting, July 2010 Report on Other Resolutions from Dec 2009 TGDC Meeting John Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 Review of UOCAVA Roadmap Nelson Hastings National Institute of Standards and Technology
Next VVSG Training Standards 101 October 15-17, 2007 Mark Skall National Institute of Standards and Technology
1 DECEMBER 9-10, 2009 Gaithersburg, Maryland TECHNICAL GUIDELINES DEVELOPMENT COMMITTEE Commissioner Donetta Davidson.
The VVSG Version 1.1 Overview Matthew Masterson Election Assistance Commission
EAC-requested VVSG Research Overview and Status June 2008 Mark Skall Chief, Software Diagnostics and Conformance Testing Division National Institute of.
TGDC Meeting, July 2010 Overview of NIST Activities and TGDC Meeting Agenda Martin Herman, PhD National Institute of Standards and Technology
Creating Accessibility, Usability and Privacy Requirements for the Voluntary Voting System Guidelines (VVSG) Whitney Quesenbery TGDC Member Chair, Subcommittee.
12/9-10/2009 TGDC Meeting The VVSG Version 1.1 Overview John P. Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 Development of High Level Guidelines for UOCAVA voting systems Andrew Regenscheid National Institute of Standards and Technology.
TGDC Meeting, Jan 2011 Path Forward for FY11 UOCAVA Activities Nelson Hastings National Institute of Standards and Technology
Briefing for the EAC Public Meeting Boston, Massachusetts April 26, 2005 Dr. Hratch Semerjian, Acting Director National Institute of Standards and Technology.
12/9-10/2009 TGDC Meeting NIST-developed Test Suites David Flater National Institute of Standards and Technology
Update: Revising the VVSG Structure Sharon Laskowski vote.nist.gov April 14, 2016 EAC Standards Board Meeting 1.
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
TGDC Meeting, July 2011 VVSG 1.1 Test Suite Status Mary Brady Manager, NIST Information Systems Group, Software and Systems Division, ITL
12/9-10/2009 TGDC Meeting Alternatives to Software Independence Nelson Hastings National Institute of Standards and Technology
The VVSG 2005 Revision Overview EAC Standards Board Meeting February 26-27, 2009 John P. Wack NIST Voting Program National Institute.
Introduction for the Implementation of Software Configuration Management I thought I knew it all !
Software Quality Control and Quality Assurance: Introduction
National Institute of Standards and Technology
Presentation transcript:

NIST Voting Program Activities Update January 4, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division

Page 2Voting Program Activities Update NIST’s Major Deliverables to the EAC List of recommended test laboratories NVLAP (National Voluntary Laboratory Accreditation Program) Next iteration of Voluntary Voting System Guidelines (VVSG 2007) Test materials for VVSG 2007 Delivered separately from VVSG 2007

Page 3Voting Program Activities Update List of testing labs NVLAP assesses potential voting system testing laboratories NIST Director recommends them to the EAC EAC makes decision whether to accredit them to test voting systems NVLAP performed pre/final assessments of 3 potential testing labs in 2006 Will make recommendations to EAC in early 2007

Page 4Voting Program Activities Update VVSG 2007 Complete re-write of VVSG 2005 in all areas Usability and Accessibility Security Core Requirements Deliver to EAC in July, 2007 NIST performs VVSG 2007 research for the EAC’s TGDC (Technical Guidelines Development Committee) TGDC makes recommendations NIST does not make recommendations NIST does the technical writing of the VVSG 2007

Page 5Voting Program Activities Update Dec 4-5 TGDC Meeting The meeting was perhaps the most important to date Major items for VVSG 2007 approved by the TGDC included: Software-independence - must use verifiable voting records for independent audits Process to include new and innovative voting systems with greater usability, accessibility, and security Prohibiting RF wireless Improving the methods for measuring reliability and accuracy of voting systems Improving and updating the usability and accessibility requirements Improving requirements for the overall reliability of VVPAT voting systems

Page 6Voting Program Activities Update Usability & Accessibility Updates to Usability requirements Usability performance benchmarks are being researched Result will be more accurate and realistic usability performance metrics - voting systems will be easier to use Research and requirements to be completed by 4/2007 Updates to Accessibility requirements Relatively minor updates from VVSG 2005 Updates to other requirements for Alternative languages Documentation Plain language Voter and system response timing

Page 7Voting Program Activities Update Security VVSG 2007 will require new voting systems to be software-independent: Accuracy of the election will not rely exclusively on the accuracy of the voting system software Accuracy of the system’s electronic records will be able to be independently audited against a voter-verified record Systems that do this currently are paper-based e.g., optical scan VVSG 2007 will include an Innovative Class TGDC is including a method for researchers or developers to create new and innovative, possibly paperless, voting system approaches that would still be independently auditable and conform to VVSG 2007 This may include newer, cryptographic-based systems that potentially promise greater usability and accessibility as well as security

Page 8Voting Program Activities Update Security (cont) Requirements to improve the accessibility of paper-based systems Requirements to improve the reliability and usability of VVPAT Radio-Frequency (RF) wireless will no longer be permitted for use on voting systems Requirements for test labs to conduct open-ended vulnerability testing on voting systems to search for vulnerabilities Setup validation requirements being updated to permit inspection of whether a voting system’s installed software is the correct software Other security areas: access control, auditing, cryptography, event logging, and physical security

Page 9Voting Program Activities Update Core Requirements Voting system quality, reliability (MTBF), and accuracy requirements being updated To improve voting system design and testing techniques To ensure that voting systems are robust and work properly To promote quality systems, requirements for vendors to comply with ISO 9000/9001 COTS testing requirements being written To make clearer whether to exclude certain COTS products from in-depth source code reviews COTS grouped into several categories Each category has its own testing requirements Conventions for software coding being examined E.g., requiring software languages that contain improved integrity and security constructs

Page 10Voting Program Activities Update Summary of TGDC Resolutions Innovation class - TGDC to include in VVSG 2007 a class for new, innovative voting system approaches, NIST to research high-level requirements Wireless security - no RF wireless in future voting systems Software Independence

Page 11Voting Program Activities Update Summary (cont) Recommendation to ICDR - TGDC recommends Interagency Committee on Disability Research include voting as topic of future conference Principal criteria - VVSG 2007 to include a stmt that voting systems should be reliable, secure, accurate, usable, accessible, fit for use Moving away from MTBF metric - TGDC directs NIST to research new reliability metric to replace older MTBF metric

Page 12Voting Program Activities Update Plans for Next 7 Months For VVSG 2007: 1-2 additional TGDC meetings; roughly 40 teleconferences Research will be completed for usability performance benchmarks Requirements for implementing software independence and other security improvements will be completed Requirements for voting systems to be more reliable and usable both for voters and election officials will be completed Delivery to EAC in July 2007 NVLAP will continue to investigate potential applicants for accreditation Test suite development for VVSG 2007 will start based upon FY07 fiscal appropriations

Page 13Voting Program Activities Update Plans Post-VVSG 2007 NIST is prepared to assist the EAC in vetting the VVSG 2007 with other organizations, including: the EAC’s Standards Board the Access Board other voting-related organizations, e.g., NASS, NASED NIST is prepared to assist the EAC, if requested, to perform research in response to public comments Continued development of test suites for VVSG 2007

Page 14Voting Program Activities Update Discussion