1. NRS Data System Checkup Assessing Your Data System Do You Need an MIS Tune-up? American Institutes for Research February 2005

2. NRS Data System Checkup 2 NRS Data System Characteristics Functionally Complete Reliable Easy to Use Accessible to Users Not Resource Hungry Able to Mine Data to Learn About Opportunities/Needs? Takes Advantage of Data Synergies Other Considerations

3. NRS Data System Checkup 3 Functionality: Data for Monitoring and Program Improvement The Data System… Is a primary source of information on programs Provides data for monitoring of implementation of policies and procedures Is useful to program and State staff for evaluation and program improvement

4. NRS Data System Checkup 4 Functionally Complete Sufficiency and Granularity of Data Report for useful levels and demographics (program, site, class, teacher, ethnicity, age, etc.) Support monitoring of key assessment procedures (e.g., tests, forms, hours between pre-/post-test) Monitor follow-up procedures (exit quarters, goal setting)

5. NRS Data System Checkup 5 Desk Monitoring Functionality: Sample Data Elements Performance Standards NRS outcomes Compliance Issues Instructional hours offered Grant requirements Program Standards Retention—student attendance Pre-/post-test percentages Staff—number and qualifications Cost per student

6. NRS Data System Checkup 6 Able to Validate Data Completeness and Quality of Data Error Checks Electronic Desk-monitoring Report

7. NRS Data System Checkup 7 Timeliness of Data Monthly to Quarterly Submission To central State database, via Web or other electronic means Ability to Evaluate Trends Across Years Multi-year data

8. NRS Data System Checkup 8 Reliable Operates in field without tech problems Programs can get tables/data to state Doesn’t crash or slow down under load

9. NRS Data System Checkup 9 Easy to Use Screens are clear and concise Obvious operational flow All functions accessible

10. NRS Data System Checkup 10 Accessible Data entry staff can access by web or have properly equipped computer Decision-makers/Administrators can get reports easily

11. NRS Data System Checkup 11 Tech Support Hungry? Usability issues Reliability issues Training issues

12. NRS Data System Checkup 12 Data Mining Beyond NRS requirements, what else can your data tell you? What tools might help you understand issues and trends?

13. NRS Data System Checkup 13 Data Synergies Where are other useful data? Are they accessible? What might they be used for?

14. NRS Data System Checkup 14 Other Considerations Bug fixes New features Pet peeves