Improving U.S. Voting Systems The Voters’ Perspective: Next generation guidelines for usability and accessibility Sharon Laskowski NIST Whitney Quesenbery.

Slides:



Advertisements
Similar presentations
TGDC Meeting, December 2011 Usability and Accessibility (U&A) Research Update Sharon J. Laskowski, Ph.D.
Advertisements

1 | Notes from NIST Usability and Accessibility Roadmap Workshop Usability & accessibility of next generation elections NIST Roadmap Notes from the January.
TGDC Meeting, July 2011 Review of VVSG 1.1 Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
Human Factors in Voting Systems John O’Hara IEEE Usability-Accessibility Working Group Chair HFES Voting System Task Force Chair Advisory Board Meeting.
United States 1 Election Assistance Commission 1 Inspiring Change & Modernization in Election Administration Seattle, WA June 10, 2015.
12/9-10/2009 TGDC Meeting TGDC Recommendations Research as requested by the EAC John P. Wack National Institute of Standards and Technology
Accessibility and Usability Considerations for Remote Electronic UOCAVA Voting Sharon Laskowski, PhD National Institute of Standards and Technology
TGDC Meeting, July 2011 Overview of July TGDC Meeting Belinda L. Collins, Ph.D. Senior Advisor, Voting Standards, ITL
TGDC Meeting, July 2011 Update on the UOCAVA Working Group Andrew Regenscheid Mathematician, Computer Security Division, ITL
TGDC Meeting, July 2011 Usability and Accessibility Test Methods: Preliminary Findings on Validation Sharon Laskowski, Ph.D. Manager, NIST Visualization.
NIST VOTING PROGRAM MARY BRADY, PROGRAM MANAGER. Outline  Motivation & Congressional Mandates  Help America Vote Act  Current Challenges  Engage the.
United States Election Assistance Commission EAC UOCAVA Documents: Status &Update EAC Technical Guidelines Development Committee Meeting (TGDC)
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
Boston, 1803Boston, City Council Districts 181 Polling Locations 254 Precincts 38 Ballot Types Spanish/English for every precinct Bilingual Chinese,
12/9-10/2009 TGDC Meeting Vote-by-Phone David Flater / Sharon Laskowski National Institute of Standards and Technology
TGDC Meeting, July 2011 UOCAVA Roadmap Update Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
Oslo 23 October Basic Competence in Working Life Hanne Christensen Assistant Director Unit for Basic Skills Vox Norwegian Institute for Adult Learning.
1 WEB Engineering Introduction to Electronic Commerce COMM1Q.
PARCC Assessment Administration Guidance 1. PARCC System Purpose: To increase the rates at which students graduate from high school prepared for success.
NIST HAVA-Related Work: Status and Plans June 16, 2005 National Institute of Standards and Technology
12/9-10/2009 TGDC Meeting NIST Research on UOCAVA Voting Andrew Regenscheid National Institute of Standards and Technology
IEEE P1622 Meeting, Feb 2011 Common Data Format (CDF) Update John P. Wack National Institute of Standards and Technology
Improving U.S. Voting Systems Interoperability in Election Data and Devices TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 1 John P. Wack.
Usability and Accessibility Working Group Report Sharon Laskowski, PhD National Institute of Standards and Technology TGDC Meeting,
Briefing for NIST Acting Director James Turner regarding visit from EAC Commissioners March 26, 2008 For internal use only 1.
NIST Voting Program Activities Update February 21, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.
TGDC Meeting, Jan 2011 Accessibility and Usability Considerations for UOCAVA Remote Electronic Voting Systems Sharon Laskowski, PhD National Institute.
New Hanover County Schools End-of-Course Test Administration Training Online Administration Summer 2012.
VVSG: Usability, Accessibility, Privacy 1 VVSG, Part 1, Chapter 3 Usability, Accessibility, and Privacy December 6, 2007 Dr. Sharon Laskowski
12/9-10/2009 TGDC Meeting Usability and Accessibility Progress and Challenges Sharon Laskowski, PhD National Institute of Standards and Technology
Improving the Usability and Accessibility of Voting Systems and Products Dr. Sharon Laskowski July 9, 2004 TDGC Meeting.
Oct 15-17, : Integratability and Data Export Page 1Next VVSG Training Voting devices must speak (produce records) using a commonly understood language,
TGDC Meeting, July 2010 Report of the UOCAVA Working Group John Wack National Institute of Standards and Technology DRAFT.
1 The Evolution of Voting Systems Paul DeGregorio Vice Chairman Donetta Davidson Commissioner The U.S. Election Assistance Commission.
NIST Voting Program Page 1 NIST Voting Program Lynne Rosenthal National Institute of Standards and Technology
TGDC Meeting, July 2011 Voluntary Voting System Guidelines Roadmap Nelson Hastings, Ph.D. Technical Project Leader for Voting Standards, ITL
Whitney Quesenbery WQ usability.com | slideshare/whitneyq Center for Civic Design: UsabilityInCivicLife.org A Web For Everyone Accessibility.
TGDC Meeting, Jan 2011 Help America Vote Act (HAVA) Roadmap Nelson Hastings National Institute of Standards and Technology
TGDC Meeting, July 2010 Report on Other Resolutions from Dec 2009 TGDC Meeting John Wack National Institute of Standards and Technology
ITIL Intermediate Lifecycle program- Service Transition ST 1 Why bother paying extra money for all the bells and whistles that you're never going to use.
TGDC Meeting, Jan 2011 Review of UOCAVA Roadmap Nelson Hastings National Institute of Standards and Technology
NIST Voting Program Activities Update January 4, 2007 Mark Skall Chief, Software Diagnostics and Conformance Testing Division.
Next VVSG Training Standards 101 October 15-17, 2007 Mark Skall National Institute of Standards and Technology
1 DECEMBER 9-10, 2009 Gaithersburg, Maryland TECHNICAL GUIDELINES DEVELOPMENT COMMITTEE Commissioner Donetta Davidson.
Voting Accessibility Barriers Survey State AT Program & Protection & Advocacy networks -- N = 76, 24 states, 2 territories & 2 national organizations (HAVA.
Test Assertions What are they and why do we need them? Mark Skall 1.
TGDC Meeting, July 2010 Overview of NIST Activities and TGDC Meeting Agenda Martin Herman, PhD National Institute of Standards and Technology
Creating Accessibility, Usability and Privacy Requirements for the Voluntary Voting System Guidelines (VVSG) Whitney Quesenbery TGDC Member Chair, Subcommittee.
12/9-10/2009 TGDC Meeting The VVSG Version 1.1 Overview John P. Wack National Institute of Standards and Technology
TGDC Meeting, Jan 2011 Development of High Level Guidelines for UOCAVA voting systems Andrew Regenscheid National Institute of Standards and Technology.
TGDC Meeting, Jan 2011 Path Forward for FY11 UOCAVA Activities Nelson Hastings National Institute of Standards and Technology
Election Assistance Commission 1 Technical Guidelines Development Committee Meeting Post-HAVA Voting System Requirements – Federal Perspective February.
Structuring Next Generation Guidelines: VSTL Perspective.
Briefing for the EAC Public Meeting Boston, Massachusetts April 26, 2005 Dr. Hratch Semerjian, Acting Director National Institute of Standards and Technology.
TGDC Pre-Meeting July , 2015 NIST Facility - Gaithersburg, Maryland Members : Designated Federal Official Matthew V. Masterson, EAC Commissioner,
Election Assistance Commission 1 TGDC Meeting High Level VVSG Requirements: What do they look like? February, 09, United States.
Update: Revising the VVSG Structure Sharon Laskowski vote.nist.gov April 14, 2016 EAC Standards Board Meeting 1.
TGDC Meeting, Jan 2011 Report from Workshop on UOCAVA Remote Voting Systems Nelson Hastings National Institute of Standards and Technology
TGDC Meeting, Jan 2011 VVSG 2.0 and Beyond: Usability and Accessibility Issues, Gaps, and Performance Tests Sharon Laskowski, PhD National Institute of.
TGDC Meeting, July 2011 VVSG 1.1 Test Suite Status Mary Brady Manager, NIST Information Systems Group, Software and Systems Division, ITL
TGDC Meeting, Jan 2011 Accessibility and Usability Considerations for UOCAVA Remote Electronic Voting Systems Sharon Laskowski, PhD National Institute.
The VVSG 2005 Revision Overview EAC Standards Board Meeting February 26-27, 2009 John P. Wack NIST Voting Program National Institute.
National Institute of Standards and Technology
CDF for Voting Systems: Human Factors Issues
Preparedness for the 2016 Presidential General Election
Texas Secretary of State Elections Division
Voter’s Choice Act: Big Changes Ahead for California Elections
International University of Japan
Building a Network for Impact
Title I Document Training, Revision, Input Meeting
Presentation transcript:

Improving U.S. Voting Systems The Voters’ Perspective: Next generation guidelines for usability and accessibility Sharon Laskowski NIST Whitney Quesenbery Center for Civic Design 1 Improving U.S. Voting Systems TGDC Meeting July 20 – 21, 2015

Improving U.S. Voting Systems Usability and accessibility guidelines: Where we’ve been 2 TGDC Meeting July 20 – 21, 2015

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 3 standards) Next Generation: Improvement and innovation in election design

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 4 NIST Roadmap for usability and accessibility of next-gen elections Goals Increase the level of knowledge of usability and accessibility in elections Make systems more usable for everyone Guidance in the right form for the right purpose (not just certification requirements) Set priorities and objectives for research to fill gaps in knowledge

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 5 We need to consider the entire voter journey, not just systems Preparing to vote Choosing how to vote Getting to the 'polling place' Getting a ballot Marking the ballot Casting the ballot Getting the results At each stage Learn: voter questions Do: voter activities Use: election systems People: voters interact with Policy: election law Design challenges Barriers to voting Risks to elections

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 6 NIST Roadmap: Priority areas for work Voters Poll workers Election officials System designers System testers Voter advocates Support the design process Engage voters effectively Address the entire voting journey Support evolving technology Provide useful guidance & standards Improve testing in certification & design civicdesign.org/projects/ roadmap/

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 7 Objectives: Guidance, standards and testing Priority Area 5: Provide useful guidance and standards Merge usability and accessibility into a single universal standard Simplify guidance by focusing on principles Develop performance metrics Develop process standards Priority Area 6: Improve testing in design and certification Improve ways to test systems, including pilot testing as part of certification Certification of open, component-based election systems Establish qualifications of human factors evaluators

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 8 Objectives: Design process and technology Priority Area 1: Support the design process Design standards and guidance so they are easier to use Priority Area 3: Address the entire voter journey Create a risk model that includes both human factors and security Priority Area 4: Support evolving technology Use universal design to create systems that work for more voters Enable the use of personal devices and assistive technology to vote Update voting guidance to address new technologies and interactions

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 9 Changes throughout the voter journey change voter expectations Preparing to vote Choosing how to vote Getting to the 'polling place' Getting a ballot Marking the ballot Casting the ballot Getting the results Voter registration Information from official and other sources More options for voting New technologies in and out of elections More accessibility of everyday technology

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 10 Voting options and convenience voting have expanded “ Voting should be the most convenient government service as voting is a right and not just a privilege.” - Stephen Booth, NFB PCEA recommendation: Expand opportunities to vote before Election Day.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 11 Everyday technology has changed lives I feel like technology is finally catching up with what I truly need. Glenda Watson Hyatt DoItMyselfBlog.com The explosion of mobile devices came after the VVSG 1.0 and 1.1 were drafted PCEA recommendation: Establish advisory groups for voters with disabilities and limited English proficiency.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 12 Improving the voter experience

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 13 Plain interaction Easier Voters can miss instructions that are on the side of the screen because they are focused on the main interactive area.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 14 Plain language Below basic 30 million 14% Basic 63 million 29% Intermediate 95 million 44% Proficient 28 million 13% 43% of Americans don't read well U.S. National Assessment of Adult Literacy PCEA recommendation: Test all election materials for plain language and usability.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 15 E-pollbooks as design examples Election Administrators EveryoneCounts Votec KnowINK Robis Elections PCEA recommendation: Transition to electronic poll books.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 16 Changes in technology: Scrolling VVSG a The electronic ballot interface shall not require page scrolling by the voter Easier Scroll bars are difficult for many to understand and use But swipe gestures on mobile devices are more intuitive.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 17 Alternatives to scrolling Make the controls visible and part of the linear flow. Break content in the middle of a line to show that there is more information.

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 18 Font sizes VVSG d A voting system that uses an electronic image display shall be capable of showing all information in at least two font sizes: mm and mm Given a choice, participants in usability testing chose the largest size available – larger than the largest size in the VVSG. How do we set sizes so that they work appropriately on different sized devices?

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 19 Font and typography VVSG f Text intended for the voter should be presented in a sans serif font. Clearview font

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 20 Contrast VVSG a - Minimum uniform diffuse ambient contrast ratio for 500 lx illuminance: 10:1 WCAG The visual presentation of text and images of text has a contrast ratio of at least 7:1 This is 7:1 This is 10:1 This is b&w

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 21 Can we achieve universal design? All voters have the same options for marking and casting their ballots Flexible for personal preferences Built-in accessibility functions Ready to be used when voters arrive Options to use personal assistive technology

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 22 Improving the structure of the standards Principles Standards and test methods System or device- specific guidelines Guidance like training, scenarios, samples Monitoring in use

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 23 Some areas for new guidance How to use the WCAG 2.0 accessibility standards and the Section 508 refresh, especially for web-based systems Usability, accessibility and security for remote ballot marking tools New ways to represent voter choices beyond opscan: voter-selection-only ballots, QR and bar codes Expanded use of personal assistive technology Usability of new approaches to security, such as E2E cryptography

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 24 Areas for work in testing & certification Establish qualifications for people or labs testing usability and accessibility How to test components and ensure that they provide good usability and accessibility as part of a complete voting experience Guidance for usability testing throughout the design process, and for submitting test reports for certification

TGDC Meeting July 20 – 21, 2015 Improving U.S. Voting Systems 25 Sharon Laskowski civicdesign.org/projects/roadmap/