1. Evaluation & Research Opportunities Evaluation of the LON-CAPA Project Evaluation of resource material quality & effectiveness of materials for learning Evaluation of material effectiveness for different types of students

2. Does the use of this technology impact learning? Four approaches to teaching Introductory Physics Large lecture w/computer-graded homework Large lecture w/ hand-graded homework Web-based format with online homework Self-paced format with on-demand exams Key: equivalency of the outcome measure –A subset of identical problems will be used on examinations in all four course styles.

3. Does the use of this technology impact learning? Comparison of student achievement in pre- technology courses with student achievement data in courses using the technology Data to be collected: –Student performance in the class »Before technology was implemented »After technology was in place –Copies of course materials used (e.g., handouts, exams, assignments) »Before technology was implemented »After technology was in place

4. Are the resource library materials educationally effective? Objective assessment of effectiveness. – Automated exam engine Subjective evaluation of effectiveness We will develop a standardized measurement instrument to assess: 1) Faculty evaluation of materials 2) Student evaluation of materials

5. Is the technology equally effective for all types of students? Are there differences in the effectiveness of technology in general? Are there differences in which types of materials are most effective? – Gender differences – Students with disabilities – Different Learning styles – Computer self-efficacy – Spatial or other abilities

6. Nuts & Bolts Getting approval for research with human subjects: The Institutional Review Board – Full/Expedited/Exempt Review Informed consent Obtaining data on student’s general levels of academic ability (e.g., GPA, SAT, ACT)