1. Program Evaluation Data Department of Education SUNY Cortland

2. Points of View

3. New York State Teacher Certification Examinations  Assessment of Teaching Skills (ATS)  Elementary Version  Required for provisional certificate  Taken upon completion of pedagogical coursework and field experiences  Liberal Arts and Sciences Test (LAST)  80 Multiple Choice Questions and an essay question  Taken sophomore or junior year  Required for provisional certification NYSTCE...

4. 14126 NYSTCE Records  Initial examination includes only Overall Scores (n = 2592)  In the Spring we plan to examine subtest scores NYSTCE...

5. 2592 Overall Records  Many test records were duplicated  Identical dates, tests, scores  Non-identical matriculation status  Non-identical degree type (i.e. BS or BA) NYSTCE...

6. 1387 Overall Test Scores  The LAST & ATS constituted 91% of the scores (1259 records)  The current analysis focuses on LAST & ATS results NYSTCE...

7. Tests taken more than once  An additional 63 cases were removed from analysis because they were retaken  Test retakes occurred when students failed the first administration  If students failed the retake, their most recent attempt was kept for analysis (previous administrations were removed)  Many of the students in the 2001 administrations have not had the opportunity to retake the test, therefore their scores are lower

8. Number of Tests Taken  Less than 100 test scores were reported in 1998  The number of test records have increased substantially each year  2001 administration includes non-graduates (sophomores, juniors & seniors) NYSTCE...

9. The Pass Rate: Graduates NYSTCE... Decline in 2001 attributable to lack of opportunity for students who failed to retake the exam

10. Mean Scores: Graduates NYSTCE...  Scores show a slight decline since 1998  The cut score for passing = 220  The highest possible score = 300

11. Field Supervisor Ratings  Field supervisors rate candidates’ performance at the end of student teaching  Evaluation rating scales aggregated for the past three years (1999-2001)  Rating scale was modified after the 2000 administration Student Teaching Evaluations

12. Rating Scale Modifications  19 old items were deleted and 18 new items were added  19 items only partially overlapped  43 items with nearly complete overlap  Only the 43 overlapping items were compared across years Student Teaching Evaluations

13. Overall Evaluations  43 items  Large dip in the spring 2000 ratings Student Teaching Evaluations

14. Content Knowledge  5 items Student Teaching Evaluations

15. Implementing & Facilitating  10 items Student Teaching Evaluations

16. Communicating & Questioning  8 items Student Teaching Evaluations

17. Dispositions  14 items Student Teaching Evaluations

18. Graduate Survey  Aggregated student opinion surveys 1998-2000  Survey format changed somewhat, but questions comparable Grad Survey...

19. Faculty Advisement Grad Survey...

20. Faculty Support Grad Survey...

21. Quality of Teaching Grad Survey...

22. Quality of Courses Grad Survey...

23. Student Teaching Grad Survey...

24. Academic Preparation Grad Survey...