National Highway Traffic Safety Administration Results from 22 Traffic Records Assessments John Siegler National Driver Register and Traffic Records Division Office of Traffic Records and Analysis

Safer drivers. Safer cars. Safer roads. Background 2 System ModulesManagement Modules Crash44TRCC Management19 Driver45Strategic Planning16 Vehicle39Data Use & Integration13 Roadway38 Citation & Adjudication54 Injury Surveillance123 In 2012, NHTSA and National Subject matter experts updated the Traffic Records Program Assessment Advisory

Safer drivers. Safer cars. Safer roads. TR Assessment: Comparing States to the Ideal System Assessment questions allow assessors to: Identify strengths and challenge areas Rank questions to help prioritize investment Supply brief recommendations for improvement 3

Safer drivers. Safer cars. Safer roads. Scoring 4 Question RatingQuestion Weight Meets3Very Important3 Partially Meets2Somewhat Important2 Does Not Meet1Less Important1 Possible Points = Question Weight X 3 (Meets) Question Score = Actual/Possible Points The Traffic records assessment is based on OMB’s Program Assessment Rating Tool (PART), which requires respondents to provide evidence for each question.

Safer drivers. Safer cars. Safer roads. Assessment Scores 5 Since 2012, NHTSA has facilitated traffic records assessments in 22 States. Average Assessment Score is 66.8%

Safer drivers. Safer cars. Safer roads. Average Score by System Modules 6

Safer drivers. Safer cars. Safer roads. National Recommendations 7 CrashVehicleDriverRoadway Citation/ Adjudication EMS/Injury Surveillance Description and Contents93.3%80.1%79.7%85.2%73.0%70.1% Applicable Guidelines89.4%78.4%87.9%67.4%65.9%79.6% Data Dictionaries70.5%75.1%74.6%63.9% 75.5% Procedures/ Process Flow74.9%66.7%80.0%70.4%67.7%75.9% Interfaces57.0%69.1%82.3%73.9%55.2%39.2% Data Quality Control Programs59.4%52.8%51.5% 50.8%53.5% Overall71.9%63.9%70.7%64.1%62.7%63.3% TRCC Management 86.2% Strategic Planning 77.1% Data Use and Integration 61.0%

Safer drivers. Safer cars. Safer roads. System Description80.2% Applicable Guidelines78.1% Procedures & Processes72.6% Data Dictionary70.6% Interfaces62.8% Quality Control53.2% System Module Component Scores 8

Safer drivers. Safer cars. Safer roads. Describes the purpose and function of each system module, the data that is collected, and system ownership and administration. Description and Contents 9 CRASH 93.3% Trauma Registry 78.3% ROADWAY 85.2% Vital Records 76.8% VEHICLE 80.1% Hospital Discharge 75.8% DRIVER 79.7% EMS 66.7% CITATION & ADJUDICATION 73.0% Emergency Department 62.6% INJURY SURVEILLANCE 70.1%

Safer drivers. Safer cars. Safer roads. Use data to identify crash risk factors and prioritize law enforcement Responsibility for crash database, vehicle registration, and driver are each located in one place More than 75% of the States Assessed Include rehabilitation data in the Injury Surveillance System Less than 25% of the States Assessed Description and Contents Strengths and Opportunities 10

Safer drivers. Safer cars. Safer roads. Lists the data standards and guidelines that States should use to manage their traffic records systems Applicable Guidelines 11 CRASH89.4%EMS87.9% DRIVER87.9%TRAUMA REGISTERY84.0% INJURY SURVEILLANCE79.6% EMERGENCY DEPARTMENT 80.3% VEHICLE78.4%HOSPITAL DISCHARGE45.5% ROADWAY67.4% CITATION/ ADJUDICATION 65.9%

Safer drivers. Safer cars. Safer roads. Use MMUCC to identify crash data elements and attributes to collect Has data on vehicle records recommended by AAMVA and/or received through NMVTIS Data interacts with the national driver registers PDPS and CDLIS Are NEMSIS-compliant More than 75% of the States Assessed Do not derive AIS and ISS scores from the State emergency department and hospital discharge data for motor vehicle crash patients Less than 25% of the States Assessed Applicable Guidelines Strengths and Opportunities 12

Safer drivers. Safer cars. Safer roads. Describes the recommended content and use for each component system’s data dictionary. Data Dictionary 13 INJURY SURVEILLANCE75.5%EMS83.3% VEHICLE75.1%TRAUMA REGISTERY80.3% DRIVER74.6%HOSPITAL DISCHARGE76.5% CRASH70.5% EMERGENCY DEPARTMENT 69.7% ROADWAY63.9%VITAL RECORDS67.4% CITATION/ ADJUDICATION63.9%

Safer drivers. Safer cars. Safer roads. Have data dictionaries for EMS, hospital discharge, and trauma registry systems. More than 75% of the States assessed Data dictionary does not indicate the data elements populated through links to other traffic records system components Less than 25% of the States assessed Data Dictionary Strengths and Opportunities 14

Safer drivers. Safer cars. Safer roads. Describes the ideal procedures for the collection and management of data for each system module Procedures and Process Flows 15 DRIVER 80.0% EMS 85.3% INJURY SURVEILLANCE 75.9% HOSPITAL DISCHARGE 76.5% CRASH 74.9% VITAL RECORDS 75.8% ROADWAY 70.4% TRAUMA REGISTERY 75.4% CITATION/ ADJUDICATION 67.7% EMERGENCY DEPARTMENT 67.9% VEHICLE 66.7%

Safer drivers. Safer cars. Safer roads. Have established procedures for identifying driver license fraud A single entity collects and compiles data from local EMS, hospital discharge Have diagrams for EMS key data flow processes Have separate procedures for paper and electronic filing of EMS patient care reports Allow outside parties to access aggregate hospital discharge data and vital records data for analytic purposes More than 75% of the States Assessed Procedures and Process Flow Strengths and Opportunities 16

Safer drivers. Safer cars. Safer roads. Describes the ideal real time relationships between data sets, which need to be connected and accessible at all times Identifies ideal interfaces between each data system Interface with Other Systems 17 DRIVER82.3% ROADWAY73.9% VEHICLE69.1% CRASH57.0% CITATION/ ADJUDICATION55.2% INJURY SURVEILLANCE39.2%

Safer drivers. Safer cars. Safer roads. Retrieve vehicle records using VIN, title number and license plate numbers. Driver information is accessed by authorized law enforcement and court personnel More than 75% of the States Assessed Share data between Crash and citation and Adjudication Crash and injury surveillance EMS and (1)Emergency department, (2) hospital discharge, and (3) trauma registry Vital statistics and hospital discharge Less than 25% of the States assessed Interface with Other Systems Strengths and Opportunities 18

Safer drivers. Safer cars. Safer roads. Describes the ideal practices and components for a comprehensive data quality management foe each component system. Data Quality Control 19 CRASH59.4%TRAUMA REGISTERY58.5% INJURY SURVEILLANCE53.5%EMS52.7% VEHICLE52.8%VITAL RECORDS51.4% ROADWAY51.5% EMERGENCY DEPARTMENT 51.3% DRIVER51.5%HOSPITAL DISCHARGE51.3% CITATION/ ADJUDICATION 50.8%

Safer drivers. Safer cars. Safer roads. Automate edit checks and validation rules for crash data Authorize staff to amend obvious errors and omissions for the crash and driver databases. More than 75% of the States Assessed Data Quality Strengths 20

Safer drivers. Safer cars. Safer roads. Conduct independent sample-based audits of crash reports and related database content. Produce data quality reports for their vehicle and driver databases. Less than 25% of the States Assessed Crash: Data Quality Opportunities 21

Safer drivers. Safer cars. Safer roads. TimelinessAccuracy CompletenessUniformityIntegration Accessibility Crash XX Vehicle X XXXXX Driver X Roadway XXXX Citation & Adjudication X X Less than 25% of the 22 States Assessed had Performance Measures in the following areas 22

Safer drivers. Safer cars. Safer roads. TimelinessAccuracy CompletenessUniformityIntegration Accessibility EMS XXX Emergency Room XXX Trauma Registry XXX Hospital Discharge XXX Vital Records XXXX Less than 25% of the 22 States Assessed had Performance Measures in the following areas 23

Safer drivers. Safer cars. Safer roads. Level of Effort for Assessments 19 Respondents 179 Hours States 12 Assessors 270 Hours NHTSA 24 There is a significant positive relationship between the assessment score and the average time responding in STRAP, r(19) =0.593, p<.05

Safer drivers. Safer cars. Safer roads. Changes to Assessment Process Revised Procedures Manual Enhancement to STRAP – Respondent Interface – Assessor Interface One -Page Summary Reports 25

Safer drivers. Safer cars. Safer roads. Questions? John Siegler, Ph.D.