ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D.

Slides:



Advertisements
Similar presentations
Assessment and Evaluation. Assessment and evaluation Evaluation is a judgement Evaluation is a judgement. How well is this course (part of the course)
Advertisements

Iowa Assessment Update School Administrators of Iowa November 2013 Catherine Welch Iowa Testing Programs.
Praxis Assessment Overview Educational Testing Service Kentucky Education Professional Standards Board Frankfort, Kentucky January 21, 2007 Copyright 2004.
Evaluating Competency Based Education in Clinical and Translational Science Wishwa Kapoor, MD, MPH.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Michigan Assessment Consortium Common Assessment Development Series Module 6 – The Test Blueprint.
Presented by: Diane Burtchin, Karlene Fredericks, Tricia Hastings, Rachel Hinz, and Christine Price Rossford Exempted Village School District.
NYS Assessment Updates & Processes for New Social Studies Regents Exams September 18, 2014 Candace Shyer Assistant Commissioner for Assessment, Standards.
Curriculum and Assessment Overview Educ What is Curriculum? A course of study What to teach - content Everything that students learn from in the.
Grade 12 Subject Specific Ministry Training Sessions
Analyzing and Improving College Teaching: Here’s an IDEA Alan C. Lacy, Associate Dean College of Applied Science and Technology Illinois State University.
AnalyseDesignDevelopImplementEvaluate ADDIE - Model.
Islamic studies standardized tests
TIMELESS LEARNING POLICY & PRACTICE. JD HOYE President National Academy Foundation.
Creating a Movement Creating a Movement. Secondary Mathematics News and Next Steps Staff Development Day March 18, 2011.
New Advanced Higher Subject Implementation Events
Information on New Regents Examinations for SCDN Presentation September 19, 2007 Steven Katz, Director Candace Shyer, Bureau Chief Office of Standards,
New York State Education Department Understanding The Process: Science Assessments and the New York State Learning Standards.
Understanding by Design
NEXT GENERATION BALANCED ASSESSMENT SYSTEMS ALIGNED TO THE CCSS Stanley Rabinowitz, Ph.D. WestEd CORE Summer Design Institute June 19,
Common Core Assessments What do they mean for you and your child? Hauppauge Public Schools
Common Core Implementation Update SEPTEMBER 4, 2014 CAMBRIAN SCHOOL DISTRICT.
Building Effective Assessments. Agenda  Brief overview of Assess2Know content development  Assessment building pre-planning  Cognitive factors  Building.
The Third Year Review A Mini-Accreditation Florida Catholic Conference National Standards and Benchmarks.
Looking At Your Assessment System: A Graphical Perspective Michigan Educational Research Association Fall Conference 2012 Monday, November 19, 2012.
Common Core State Standards (CCSS) September 12, 2012.
District 786 Islamic Studies Standardized Testing.
Technology Use Plan Bighorn County School District #4 Basin / Manderson, Wyoming “Life-long learning through attitude, academics, and accountability.”
EHS and EMS Presentation 11/12/10 With thanks to Lucille E. Davy, Senior Advisor, James B. Hunt, Jr. Institute.
Key System Features and Next Steps. Features: Computer Adaptive Testing Adaptive assessment provides measurement across the breadth of the Common Core.
Technical Assistance Paper Program Year Miami-Dade County Public Schools Adult ESOL Program presents: ADULT ESOL Technical Assistance Paper
Designing Local Curriculum Module 5. Objective To assist district leadership facilitate the development of local curricula.
EDU 385 CLASSROOM ASSESSMENT Week 1 Introduction and Syllabus.
What is design? Blueprints of the instructional experience Outlining how to reach the instructional goals determined during the Analysis phase The outputs.
Mt. Diablo Unified School District Elementary Mathematics Adoption Buy Back Day Thursday, August 27, 2009.
Oregon’s Core Standards and Assessment Standards & Assessment Task Force March 20, 2008.
Nodal Education Initial Staff Concepts 11/30/05. Agenda Integrated Approach Roadmap and Processes Curriculum Development ERCOT Education Advisory Council.
Illinois Community College BoardIllinois State Board of Education Programs of Study Self-Assessment: Starting the Journey on the Right Foot February 4,
“Developing an Implementation Map: Mapping / Mapping ” Dr. Ann Johnson
The PLC Team Learning Process Review Step One: Identify essential (key) learning standards that all students must learn in each content area during each.
PLC Team Leader Meeting
Race to the Top Assessment Program: Public Hearing on Common Assessments January 20, 2010 Washington, DC Presenter: Lauress L. Wise, HumRRO Aab-sad-nov08item09.
ANNOOR ISLAMIC SCHOOL AdvancEd Survey PURPOSE AND DIRECTION.
Phases of Curriculum Design: Evaluation Stufflebeam’s CIPP Model Dr. Katherine Korkidis April 19, 2009.
Test Administrators. Be aware of what’s new this year in OAKS Understand the roles and responsibilities of test administrators Understand how to use valid.
Test Administrators. 1/28/2016Free Template from 2 Be aware of what’s new this year in OAKS Understand the roles and responsibilities.
Overview and Update.  LBUSD is currently facing a unique set of challenges and opportunities. It is imperative that we look intensely and thoroughly.
Test Administrators. 2/25/2016Free Template from 2 Be aware of what’s new this year in the statewide assessment system Understand.
Curriculum Overview May 2011 Travis Bracht Director of Student Learning.
CREATING A LOCAL SYSTEM OF ASSESSMENTS WCPS ACTION PLAN.
1 BUILDING QUALITY LEARNING USING PERIODIC ASSESSMENTS Session Outcomes: Use diagnostic Periodic Assessments as instructional tools for quality enhancement.
Assessment Literacy and the Common Core Shifts. Why Be Assessment Literate? ED Test and Measurement 101 was a long time ago Assure students are being.
ASSESSMENT and EVALUATION (seeing through the jargon and figuring out how to use the tools)
Math Study Group Meeting #1 November 3, 2014 Facilitator: Simi Minhas Math Achievement Coach, Network 204.
Instructional Design Course Evaluation Phase. Agenda The Evaluation Process Expert Review Small Group Review The Pilot Feedback and Revision Evaluation.
CEIT 225 Instructional Design Prof. Dr. Kürşat Çağıltay
1 Teacher Evaluation Institute July 23, 2013 Roanoke Virginia Department of Education Division of Teacher Education and Licensure.
Presentation to the Nevada Council to Establish Academic Standards Proposed Math I and Math II End of Course Cut Scores December 22, 2015 Carson City,
CALIFORNIA DEPARTMENT OF EDUCATION Tom Torlakson, State Superintendent of Public Instruction CISC General Membership Meeting March (Excerpted version.
Instructional Leadership and Application of the Standards Aligned System Act 45 Program Requirements and ITQ Content Review October 14, 2010.
MATHEMATICS YEAR TWO LEADERSHIP SERIES IMPLEMENTING STRATEGIES TO ENGAGE STUDENTS AND RAISE ACHIEVEMENT FEBRUARY 19, MARCH 26, MAY 21, 2014.
Instructional Leadership Supporting Common Assessments.
Making an Excellent School More Excellent: Weston High School’s 21st Century Learning Expectations and Goals
School – Based Assessment – Framework
It’s All About the Data, Folks!
Assessments for Monitoring and Improving the Quality of Education
Assessing the Common Core Standards
Roadmap November 2011 Revised March 2012
Discussion on Virginia’s State Assessment Program
Doug Glasshoff Greg Gaden Darin Kelberlau
Presentation transcript:

ASSESSMENT DEVELOPMENT: BUILDING VALID AND RELIABLE TESTS Habeeb Quadri, M.Ed Denis Jarvinen, Ph.D.

Overview  Good and Bad of Standardized Testing in Religious Studies Courses  Review General Test Development Model  Purpose and Design Shape Assessments  Important Questions to be Asked  The Development and Review Process  Making Sense of Data within Islamic Studies Courses

Standardized Testing and Religious Studies Future of Standardized Testing - Evaluate curriculum effectiveness - Evaluate student achievement - Track student achievement over time - Ensure transferability of students - Evaluate instructional methods and best practice - Market the School - Muslim Common Core -Experiential learning can not be measured -Formal Assessments is one tool to measure student mastery of a concept

General Test Development Sequence Establish a Clear Purpose for the Assessment Define the Content for the Assessment Begin Item Development/Selection Field Test Items Implement the Assessment Step 1 Step 2 Step 3 Step 4 Step 5

Establish a Clear Purpose for the Assessment  Why is the assessment being administered?  What knowledge/skills will be assessed?  Who will take the assessment?  When will the assessment be administered?  How will the assessment be scored?  Information?  How will the assessment data be used?  What decisions will be made using the data (e.g., accountability, curriculum, instruction)?  By whom (e.g., administrators, staff, teachers, students)?  How will information from this assessment be integrated with other schools?

Research Process: Islamic Standards Selected Panel Members Experts Revise Standards Incorporate Feedback Develop Accepted Standards Educators Researched Textbooks I Love Islam IQRA’ Good Word Charted Commonalities Pilot Test Textbooks Approached Major Schools Gathered Curricula Charted Commonalities Schools

Content for Assessment – Comparing Curriculums

ISST Advisory Committee What item formats will be used (item specifications)? How will appropriate test content be determined? Who will review and approve the specific learning objectives to be covered (pacing guide)? Who will create final test specifications (content/item matrix)? Meeting with Panel

Since 2010 Over 27 schools across the U.S. implemented formal assessments for Islamic Studies

Implementing the Assessment

Making Sense of Data Individual Report

Making Sense of Data Class Report

Making Sense of Data School Report

Sample Items Qur’anic Studies Sirah and Hadith

Sample Item