Focus Groups Experiences with Prêt à Voter Steve Schneider, University of Surrey 3 September 2010 TexPoint fonts used in EMF. Read the TexPoint manual.

Slides:



Advertisements
Similar presentations
Testing Relational Database
Advertisements

P-20 Data Collaborative Grant University/College Work Group February 24, 2010.
What is Public Opinion? Public opinion can be described as those attitudes held by a significant number of people on matters of government and politics.
Electronic Voting Systems
Evaluation Mary Rowlatt MDR Partners. Definition of project evaluation Evaluation focuses on whether the project was effective, achieved its objectives,
PB How can the Disabled Children’s Services National Indicator be used? Tuesday 8 th December.
6.5 Compare Surveys, Experiments, and Observational Studies p. 414 How do you accurately represent a population? What is an experimental study? What is.
User Satisfaction Why? User Satisfaction Surveys are conducted to ensure we receive feedback from our customers in order to gauge.
QBM117 Business Statistics Introduction to Statistics.
1 Web Usability and Age Thomas S. Tullis Ann Chadwick-Dias Human Interface Design Department,
1 Receipt-freedom in voting Pieter van Ede. 2 Important properties of voting  Authority: only authorized persons can vote  One vote  Secrecy: nobody.
For use only with Perreault/Cannon/ McCarthy texts, © 2009 McGraw-Hill Companies, Inc. McGraw-Hill/Irwin Chapter 8 Improving Decisions with Marketing Information.
OCR Nationals Level 3 Unit 3. March 2012 M Morison Know what is meant by ‘bias’ in a study Understand that bias needs to be eliminated from a study so.
Analyzing and Presenting Results Establishing a User Orientation Alfred Kobsa University of California, Irvine.
Usability and taste  Taste is subjective  but not necessarily trivial  Taste is subject to fashion  Changes over time  Influenced by other people.
William H. Bowers – Understanding Users: Qualitative Research Cooper 4.
Enhancing Teaching and Learning with Electronic Voting Feng Hao Newcastle University Learning and Teaching Conference, 2014.
Page 1 Auto RDD Usability Test Results | February 2015 Auto-RDD Usability Test Results Conducted by Jayne Schurick Usability Consultant
Observation of e-enabled elections Jonathan Stonestreet Council of Europe Workshop Oslo, March 2010.
Who are the participants? Creating a Quality Sample 47:269: Research Methods I Dr. Leonard March 22, 2010.
An evaluation framework
From Controlled to Natural Settings
User testing New Technology for Supporting Students.
[9.4] Market Research Essential idea: Market research is any organized effort to gather information about markets or customers.
Professor Sadie Creese Professor Koen Lamberts Nick Papanikolaou Research Fellow International Digital Laboratory University of Warwick
Comparative Evaluation of the Impact of e- participation in Local Climate Change Policy Programs The Effectiveness of E-Participation.
Cryptographic Voting Protocols: A Systems Perspective By Chris Karlof, Naveen Sastry, and David Wagner University of California, Berkely Proceedings of.
MANAGEMENT OF MARKETING
Attitudes to Further Education Loans BIS May 2012.
Information Systems Security Computer System Life Cycle Security.
Problem-based learning in a traditional curriculum
Evaluation Framework Prevention vs. Intervention CHONG POH WAN 21 JUNE 2011.
AGA 2009 Tracking Survey Perceptions of Governmental Financial Management Prepared for the Association of Government Accountants December 29, 2009 © Harris.
Technology Use in Elementary Schools Sally Winstead LSIS 5614 OL1 March 06, 2012.
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 6 Slide 1 Requirements Engineering Processes l Processes used to discover, analyse and.
A Good Start: Resilience in Families With a first Baby Irene de Haan BRCSS/SPEaR Colloquium.
Usability testing. Goals & questions focus on how well users perform tasks with the product. – typical users – doing typical tasks. Comparison of products.
NorthWise Services A Comparison Between Electronic and Paper Patient Diaries By Dr. Philip M. North ABEMEP Symposium Electronic Data Capture Friday 11.
Voting behaviour Joan Garrod FOTOLIA. Voting behaviour Falling turnout Politicians from all parties are increasingly concerned by the falling turnout.
Electronic Voting: The 2004 Election and Beyond Prof. David L. Dill Department of Computer Science Stanford University
Business English Upper Intermediate U1S09 John Silberstein
Chapter 15 Qualitative Data Collection Gay, Mills, and Airasian
4.1 WHAT IS MARKETING RESEARCH? 4.3 GATHERING PRIMARY DATA March 10, 2010.
VVSG: Usability, Accessibility, Privacy 1 VVSG, Part 1, Chapter 3 Usability, Accessibility, and Privacy December 6, 2007 Dr. Sharon Laskowski
User Interface Design & Usability for the Web Card Sorting You should now have a basic idea as to content requirements, functional requirements and user.
Implementation Requirements for UK General Elections TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A Chris.
Chapter Fourteen Communicating the Research Results and Managing Marketing Research Chapter Fourteen.
Requirements Validation
Usability Engineering Dr. Dania Bilal IS 592 Spring 2005.
By Godwin Alemoh. What is usability testing Usability testing: is the process of carrying out experiments to find out specific information about a design.
© 2001 South-Western College Publishing1 CHAPTER SEVEN DECISION SUPPORT SYSTEMS AND MARKETING RESEARCH Prepared by Jack Gifford Miami University (Ohio)
Electronic Voting R. Newman. Topics Defining anonymity Need for anonymity Defining privacy Threats to anonymity and privacy Mechanisms to provide anonymity.
Day 10 Analysing usability test results. Objectives  To learn more about how to understand and report quantitative test results  To learn about some.
Oct 211 The next two weeks Oct 21 & 23: Lectures on user interface evaluation Oct 28: Lecture by Dr. Maurice Masliah No office hours (out of town) Oct.
Evaluation of an E-Voting Device based on a Common Criteria Protection Profile Roland Vogt, DFKI GmbH Dr. Sönke Maseberg, datenschutz nord GmbH 8th ICCC,
Quick Write-Ultimate Rulers President Franklin D. Roosevelt once said, “Let us never forget that government is ourselves. The ultimate [fundamental] rulers.
April 2016 Discover England Fund Industry Consultation Survey.
Jim Alexander - Director. Agenda Why does satisfaction matter? How is it measured? What are the benefits of being customer driven?
The Initial Bulletin Board Posting 1 st Batch2 nd BatchEmpty forms Envelopes are: Opaque Sealed Bubbles unfilled Serial numbered (numbers unique per batch)
Intro to Probability and Statistics 1-1: How Can You Investigate Using Data? 1-2: We Learn about Populations Using Samples 1-3: What Role Do Computers.
The United Kingdom experience in data collection and statistics on disability Ian Dale Head of Disability Analysis Department for Work and Pensions Steel.
Demonstration of the Version 1 Prototype of Prêt à Voter Steve Schneider, Chris Culnane University of Surrey SecVote, Bertinoro 3rd September 2010 TexPoint.
Developing Community Assessments
User Interface Evaluation
EVoting 23 October 2006.
Electronic Voting Machine Using MSP430 With Voice Feedback System
Notes for helpers Supporting everyone to tell their story
From Controlled to Natural Settings
Soliciting Reader Contributions to Software Tutorials
User ScenarIOS.
Presentation transcript:

Focus Groups Experiences with Prêt à Voter Steve Schneider, University of Surrey 3 September 2010 TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A

Context General observations Experience with Prêt à Voter Contents

A `usability study’ of the existing Pret a Voter prototype. “Conducting this trial will enable us to discover what inadequacies there are with the prototype system: for example, are the participants able to understand the feedback that the system provides after they have voted? The trial will also give us insight into participants' trust in the system, and whether they believe that the system really does keep their vote secret, and really does protect against modification of the cast votes. We will also be looking to gauge participants' trust in cryptographically secured voting in general. Results of this initial study will be useful for identifying and defining the requirements of a trustworthy voting system in WP1.1, and will also inform the analysis of threat models in WP2.1. Ultimately, it will inform development of the full system in WP3.2.” Trustworthy Voting Systems Project Proposal

Background discussion on voting, including security issues Introduce Prêt à Voter system. Voting Tasks Vote for a particular candidate Check a receipt (visually) Audit a ballot form Check the vote on the bulletin board Groups took place in February and March 2010, in Crawley and Birmingham in the UK Focus Group Discussion Guide

Two `younger’ (<35), two `older’ groups; average 8 per group Run by a facilitator in each case. The academics (us) did not interact directly with the groups. We watched from behind a one-way mirror. Transcripts, DVDs, and `headline notes’ provided subsequently Intention to flush out and identify views and opinions. Not systematic user trials. Caveats: Not statistically significant: sample size too small to draw general conclusions. Maybe not all have voted recently? People provide inconsistent views (this should be no surprise) Groups can be swayed or influenced by a few individuals The groups

Perception that current UK system is “old fashioned”. The current UK system is trusted. The groups did not have security concerns about their voting (“this is England”). Trust in the system is therefore taken for granted Recognition that other parts of the world might have issues with the integrity of the voting process Recognition that secrecy of the ballot was important …though most participants said they personally were not worried about disclosing their vote, or having it known. (Some contradictions here) Some seemed to see how they vote as `consumer information’ Some General Observations

Understanding of vote casting process – people able to cast votes Understanding of random order for names Less understanding of need to shred list of names Less understanding of receipt Expectation it should say who you voted for `I don’t need a receipt, I know I’ve voted’ Less understanding of audit, and hence less motivation. Therefore auditing may be unreliable Checking the receipt on the web was easy, but varying expectations and understanding of what is being checked Experience with Prêt à Voter

Concerns that the process takes longer, that there are more steps in the voting process Possibly a concern if queues could form Introducing a new technology can raise expectations that are not currently present. Receipts seemed to introduce an expectation of what should be on them, people suddenly want a receipt of how they voted. The phrase `New voting system’ also seemed to raise expectations. Green issues – comments about the amount of paper involved People wanted/suggested an electronic interface (DRE) – ATM / Tesco analogy A mix of positive and negative group reactions to the system, across age ranges: one older group, one younger group more positive, and the other two were more negative Some reactions

voters carrying out the task correctly voters understanding why the system is this way [NB lack of understanding may impact on correct operation] voters’ attitudes to security in voting systems How much understanding do we need to impart to the voting public? Why, or just how? How much `market research’ – ask vs tell? What threat models are appropriate? Insider corruption; external coercer; external hacker; eavesdropper Impact on design: Best way of handling receipts – who, how? Best way of handling audit – who, how? Issues raised

Who are the customers: The election authorities, and experts? The general public? How much fanfare? People trust the existing voting system, and are uncomfortable hearing about flaws Security (but they appear take that for granted) Verifiability (but do they want that?) Countering fraud Usability Also saving money Convenience Sales pitch?