Presentation on theme: "Writing an NCATE/IRA Program Report"— Presentation transcript:
1Writing an NCATE/IRA Program Report Prepared by Barbara Chesler, Longwood University, on behalf of the International Reading Association
2Questions That Guide Reports Do candidates meet state licensure requirements?Have candidates mastered the content knowledge?Can candidates conceptualize and plan their teaching or other professional educational responsibilities?Are candidates effective in promoting student learning?
3Focus of Reports Assessments are aligned with IRA standards 7-8 required assessmentsReviewers will examine:the quality of assessmentsthe appropriateness of the assessments to the standards
4New Report Format Section I: Contextual Information Section II: Standards-Assessment ChartSection III: Required AssessmentSection IV: Evidence for Meeting StandardsSection V: Use of Assessment Results to Improve Candidate and Program Performance
5Cover Sheet Information on the Institution Information on the State Grade levels candidates are prepared to teachDegree awardedIf program is offered at more than one siteTitle of state licenseProgram report statusInformation on the StateIs there a state licensure test for reading specialist/literacy coach
6Section I: Contextual Information Information is provided that will be used later for the Unit’s Institutional Report (IR)
7Section I: Contextual Information (cont.) Provides general information and description of the program.Provides information for the “Overview” of the Unit Institutional Report (IR).Number of candidates and completers are reported.Provides information on three years’ of data on candidates enrolled and completing the program.
8Section I: Contextual Information (cont.) Provides information on faculty (used for IR report – Standard 5)Links to a tableDescribes the relationship of the program to the Unit’s Conceptual Framework
9Section I: Contextual Information (cont.) Describes the relationship of assessments used in the program to the Unit’s Assessment System (Standard 2).Key assessments used in the program, are derived from or inform, the assessment system of the Unit.
10Section II: Assessment Chart List of key assessments that are used with all candidates in the program.Assessments will probably provide evidence for more than one standard.Think about the four transition points in the program assessment system or the unit assessment system.
11Section II (cont.)For each assessment listed (7-8), an attachment will be sent of the following:The assessment with instructions to candidates about the assigned task.Scoring guides or criteria used to score candidate response on assessment.A table with aggregated results of the assessment providing recent data.Data organized according to scoring guideProvide percentage of candidates achieving at each category
12Samples of Assessments Research reportsTeacher work samplesUnit/lesson plansCase studyInterviewsObservationsAction research projectsOnline tutorialComprehensive exams
13Section III: Standards Assessment Chart Assessments are aligned with the IRA standardsMust meet:ALL 5 standardsAll 19 elementsComponents within the elements will be a holistic assessment by reviewers
14Section III (cont.) Assessment evidence in three categories: Content knowledgePedagogical/professional: Knowledge, skills, and dispositionsCandidates effects on student learning
15Section IV: Evidence for Meeting Standards Information provided on each of the 7-8 requiredassessmentsEach assessment is briefly described and limited to 2 pages each.Statement on how the assessment aligns with the specific standard indicated in Section III.Brief summary statement of the data findings that were attached with Section II.Interpretation of how data provides evidence for meeting standards.
16Assessment #1: Content Knowledge Data from state licensure tests or professional examination of content knowledgeAssessment must show alignment with IRA standardsMust have 80% pass rate
17Assessment #2: Content Knowledge Includes but not limited to standards1 and 5Appropriate assessments may be:Child studiesPortfoliosResearch reportsAction research
18Assessment #3: Pedagogical and Professional Knowledge Includes but not limited to standards 2 –5Assessments that demonstrate:candidates knowledge, skills, and dispositionscandidates can effectively plan reading and literacy educationcandidates can fulfill other professional responsibilitiesExamples are lesson plans, teacher work samples, literacy profiles, coaching experiences, staff development experiences
19Assessment #4: Pedagogical and Professional Knowledge Includes but not limited to standards 2-5Assessment instrument used to evaluate internships, practicum, or clinical experiences should be submittedAssessment should demonstrate candidates knowledge, skills, and dispositions are applied effectively in practice
20Assessment #5: Effect on Student Learning Includes but not limited to standards 2–5Assessment of candidates effectiveness on student learning and provision of supportive learning environments for student learningExamples are teacher work samples, literacy profiles, follow-up studies
21Assessment 6 to 7 or 8: Additional Assessment Includes but not limited to standards 2 –5Additional assessment that is needed meet standards
22Section V: Use of Assessment Results for Candidate and Program Performance Evidence that the results of the assessment have been analyzed and used by faculty.A summary of principle findings should include:faculty interpretationschanges made to the programsteps taken in using dataOrganized around (Unit Standard 1):Content KnowledgeProfessional and Pedagogical Knowledge SkillsEffects on Student Learning and creating environments that support learning
23Tips…… Align assessments instructions with IRA standards. Align rubrics and other scoring instruments with IRA standards.Scoring guides need to be clear, fair, and free from bias.Scoring guides should have written and shared criteria for judging performance that indicate the qualities by which levels of performance can be differentiated.
24More Tips………..We suggest you do not use GPA or grades from classes. If you do you must show how these align with the standards.If you use a generic practicum or internship evaluation you must align this with IRA standards and possibly write an addendum to evaluation.