Michigan Career Education Conference February 6, 2012
Presentation Overview Federal requirements Selection process MTTC test Field testing Value of test results
CTE Assessment Selection Assessment to be selected is— Standardized Reliable and valid Independently graded Knowledge-based Administered nationally or internationally
Additional Selection Criteria If possible, assessment also — Results in recognized credential or benefit Provides results immediately Has cut scores set using standards-setting process Represents employer relevance Sufficiently linked with academic subject
Test Adoption Process Overview Establish Cluster Advisory Group Identify Technical Skills Assessments Conduct Field Test of Assessments Adopt Assessment Implement Assessment We are here
Assessment Advisory Group Program Area Teachers Postsecondary Teacher Educators Assessment Expert Elementary Practitioners CTE Administrator MDE Staff – Professional Preparation and Early Childhood Education
Assessments Reviewed Eleven (11) initially identified Information compiled and compared Criteria applied Narrowed to two Presentation by vendors Field test and feedback Final selection
Test Specification AssessmentAssessment ItemsCut Score Validity ReliabilityStandard Setting Persons Education Michigan Test for Teacher Certification— Basic Skills Reading: 36 Multiple Choice Math: 36 Multiple Choice Writing: 1 Constructed Response Scaled Score 220 ContentReading: Criterion: Content Panel Review Math: Writing:
MTTC: Reading Determine the meaning of words and phrases Understand the main idea and supporting details in written material Identify a writer’s purpose, point of view, and intended meaning Analyze the relationship among ideas in written material Use critical reasoning skills to evaluate written material Apply study skills to reading assignments
Communicate in connected writing to a specified audience with attention to appropriateness, unity and focus, development, organization, sentence structure, usage, and mechanical conventions MTTC: Writing
MTTC: Math Fundamental Math Use number Concepts and Computation skills Solve word problems involving integers, fractions or decimals Interpret information from a graph, table or chart Geometry and Reasoning Understand operations with algebraic expressions Solve problems involving geometric figures Apply reasoning skills
Algebraic Graphing, Equations and Operations Graph numbers or number relationships Solve one- and two variable equations Solve work problems involving one and two variables MTTC: Math
Field Test Results N Reading % Pass Math % Pass Writing % Pass Field Test Statewide - first attempt1699* * Statewide scores typically included students enrolled in postsecondary education
CTE Test Results Spring 2011
Support Materials Online information Free access to most information Test blueprint (what is on the test) Sample test questions Video-Preparing Practice test (order for a fee)
MTTC Information Links Study Guides: Video Overview (Test Preparation): Test Objectives: Requesting alternative testing arrangements:
Test Administration Date and Site Selection Registration Process Paying for Testing Transportation Test Follow Up (score interpretation) Student Survey
Registering Students Identify appropriate students Paper or on line Significantly in advance Accommodation request at time of registration- documents required Select Michigan CTE Education Program (97)
Logistics Must be on time Must have acceptable Identification (see website) Must bring “ticket” May not use calculators Remember they are still “adolescents”
Nice to Know Students need to know SSN Students get scores (not school) Basic skills is a lifetime score Students need encouragement Benefit from knowing what to expect
Benefits of Test Industry based credential (job) Required (postsecondary education programs) Pre student teaching (state law) Pre-admission to program (increasing) Identifies area(s) of weakness Provides measure for Perkins CPI
Questions
Contacts Jacqueline Dannis, Research Consultant Office of Career and Technical Education 517 ( ) Steven J. Stegink, Higher Education Consultant Office of Professional Preparation Service (517) Norma R. Tims, Title IX Coordinator Office of Career and Technical Education (517)