1. Work Session 1 Locating Baseline Data Office of Research, Evaluation and Policy Studies Ximena D. Burgin, Ed.D. November 30 th, 2010

2. Databases Restricted Databases Public Databases Commercial Databases Your Own

3. Restricted Databases:  Institute of Education Sciences (IES): Assessments Early Childhood Elementary / Secondary International Library Postsecondary

4. Public Databases:  Illinois Interactive Report Card (IIRC):

5. Commercial Databases:  Survey of Enacted Curriculum

6. Commercial Databases:  California Critical Thinking Skills Survey

7. Your own:  Alcohol, Tobacco, and Other Drug (ATOD)

8. Data Collection Techniques to collect data  Observations  Interviews  Questionnaires (open- ended questions)  Documents  Audiovisual materials Qualitative  Exploration of the unknown.  Understanding of a central phenomena. Quantitative  Trends or explanation of relationships among variables.

9. Data Analysis Textual analysis (Qualitative)  Perform preliminary exploratory analysis  Code the data  Create themes  Summarize findings (choose narrative discussion) Statistical analysis (Quantitative)  Descriptive statistics  Inferential statistics

10. Sample of ATOD Survey Questions

11. Validity “Whether an instrument measures what it is suppose to measure” Appropriateness, correctness, meaningfulness, and usefulness of the specific inferences made from data

12. Reliability Consistency of scores obtained from individuals Are results repeatable from one administration of instrument to another?

13. Validity and reliability

14. Assessing reliability Test-retest reliability Alternate (Parallel) forms reliability Alternate (Parallel) forms & test-retest reliability Internal consistency reliability Inter-Rater or Inter-Observer reliability

15. Internal consistency reliability

16. Inferential statistics Generalizing from samples to populations