1. Test Plans, Test Cases, and Test Reports
Making every vote count.
United States
Election Assistance Commission
The Testing Process:
Test Plans, Test Cases, and Test Reports
TGDC Meeting
December 9-10, 2009

2. The Testing Process from Beginning to End (in an ideal world):
Making every vote count.
United States
Election Assistance Commission
The Testing Process from Beginning to End (in an ideal world):
Application for Testing
Creation, submission, and review of Test Plan
Creation, submission and review of test cases
Testing of the Voting System
Creation, submission and review of the test report
(This is how things have actually gone)

3. The Test Plan Package United States Election Assistance Commission
Making every vote count.
United States
Election Assistance Commission
The Test Plan Package
Test Plan Contains high level test methods for the testing engagement.
Contains standard lab test methods, system specific test methods, and pass/fail criteria.
Contains EAC Requirements Matrix.
EAC Technical Reviewers review test plan for completeness and to ensure system is tested to the standards.
EAC sends comments to test plan to VSTL for review and response.
VSTL submits new version of test plan for further review.

4. Test Case Submission United States Election Assistance Commission
Making every vote count.
United States
Election Assistance Commission
Test Case Submission
After approval of Test Plan VSTL creates system specific test cases.
Test cases are the step by step instructions given to test personnel to test the system.
VSTL is to notify EAC in writing when test cases are completed.
EAC may then request the test cases to be submitted to them for review.
Test cases are not approved or rejected by EAC.
EAC does spot check of various test cases in order to ensure test plan is being followed and system is being tested to the standards.

5. Testing of the Voting System
Making every vote count.
United States
Election Assistance Commission
Testing of the Voting System
Test cases used to test the voting system to the VSS or VVSG.
VSTLs are responsible for the quality and level of testing.
This includes review and approval of 3rd party lab testing.
Maintaining the independence of the testing process.
Documentation and resolution of all discrepancies and engineering change orders.

6. Test Report Submission and Review
Making every vote count.
United States
Election Assistance Commission
Test Report Submission and Review
Test Report Package represents the documentation of the testing performed and the results of that testing.
VSTL submits as part of the package:
Requirements Matrix
Same matrix as before but with the test report information complete
Test Report
Documents the testing process and results
Includes all discrepancies, resolutions, and engineering change orders.
VSTL attestation
VSTL makes recommendation and asserts all testing was done per the approved test plan.