Data Collection Strategies An Overview. How Do We Assess ?

Slides:



Advertisements
Similar presentations
© expat technology forum 2004 all rights reserved expatriate programme performance metrics EPPM Survey: an online instrument which delivers a clear insight.
Advertisements

Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Critical Reading Strategies: Overview of Research Process
Progress Towards Reading Success: The Reading First Evaluation Prepared by: Amy Kemp, Ph.D. Research Associate and Patricia A. Muller, Ph.D. Associate.
Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
Evaluation Mary Rowlatt MDR Partners. Definition of project evaluation Evaluation focuses on whether the project was effective, achieved its objectives,
Nettie’s Nickel 4 Comprehensive AT Report Writing 2 Support a District’s Offer of FAPE Nettie Fischer, ATP July 22, 2014.
Utah Effective Teaching Standards-based Jordan Performance Appraisal System Orientation (UETS-based JPAS)
“Data Walk” Faculty Orientation
SEM A – Marketing Information Management
2.06 Understand data-collection methods to evaluate their appropriateness for the research problem/issue.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
COMPREHENSIVE SCHOOL REFORM PROGRAM (Obey-Porter) CSR Program Overview January 2002.
May 5, 2015 Strategies for Evaluation Data Collection Eric Graig, Ph.D.
Kotler / Armstrong, Chapter 4
Minnesota Manual of Accommodations for Students with Disabilities Training Guide
Data Collection* Presenter: Octavia Kuransky, MSP.
Lesson Eight Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test Scaling.
CLAS Assessment: The Next Steps Developed By: Maria Cimitile, Julie Guevara, Kylene Dalton-Koons, Jennifer Glaab.
Title I Needs Assessment and Program Evaluation
Minnesota Manual of Accommodations for Students with Disabilities Training Guide
Title Exploring the Effect of Participation in the Bridge to College (B2C) Programme on Learners Aoife Gaffney MSc Technology & Learning.
Understanding the Science and Social Studies Tasks.
Title I Needs Assessment/ Program Evaluation Title I Technical Assistance & Networking Session October 5, 2010.
The European Peer Review Procedure in Dutch VET (part 1) Willem de Ridder ROC Aventus.
Chapter 5 Training Discuss how training can contribute to companies’ business strategy. Explain the role of the manager in identifying training needs and.
Assessment Literacy Series
Developing Evaluation Instruments
Business and Management Research
Local Evaluation Overview and Preliminary Findings Diane Schilder, EdD.
Data Analysis for Evaluation Eric Graig, Ph.D.. Slide 2 Innovation Network, Inc. Purpose of this Training To increase your skills in analysis and interpretation.
A Model for EAP Training Development Zhiyun Zhang IDE 632 — Instructional Design & Development II Instructor ： Dr. Gerald S. Edmonds.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
Evaluation and Assessment October 13, 2009 Diane Schilder, Project Evaluator Schilder, Can be used with attribution.
INTERNATIONAL LABOUR ORGANIZATION Conditions of Work and Employment Programme (TRAVAIL) 2012 Module 13: Assessing Maternity Protection in practice Maternity.
Using CIITS to Create Common School & District Assessments Copyright © 2011 Schoolnet, Inc. All rights reserved.
The Analysis of the quality of learning achievement of the students enrolled in Introduction to Programming with Visual Basic 2010 Present By Thitima Chuangchai.
General Information Iowa Writing Assessment The Riverside Publishing Company, 1994 $39.00: 25 test booklets, 25 response sheets 40 minutes to plan, write.
Assessment of an Arts-Based Education Program: Strategies and Considerations Noelle C. Griffin Loyola Marymount University and CRESST CRESST Annual Conference.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
Issues in Selecting Assessments for Measuring Outcomes for Young Children Issues in Selecting Assessments for Measuring Outcomes for Young Children Dale.
Introduction Gathering Information Observation Interviewing Norm Referenced Tools Authentic Assessment Characteristics of Authentic Assessment – 7M’s Validity.
NAME Evaluation Report Name of author(s) Name of institution Year.
Developing High Quality Student Learning Objectives
University Teaching Symposium January 9,  Individual Development and Educational Assessment  Kansas State University  A diagnostic to.
Identify a Health Problem Qualitative Quantitative Develop Program -theory -objectives -format -content Determine Evaluation -design -sampling -measures.
The ArtWorx Museum Training Program for Volunteers The heart of a volunteer is not measured in size, but by the depth of the commitment to make a difference.
Reflections on the Migration of Medical Simulators from Training Tools to Assessment Tools Rich Shavelson Stanford Education Assessment Lab Invited Talk.
Title of presentation (text is sample)
Formative and Summative Evaluation. Formative Evaluation The goal of formative assessment is to Monitor student learning Provide ongoing feedback Improve.
Local Evaluation Overview and Preliminary Findings Diane Schilder, EdD.
ADMS 631 Evidence Based Decision Making Action Based Research Plan By Christopher Martinez.
RESEARCH IN MATH EDUCATION COLLECTING DATA. 2 Collecting Data in Quantitative Research Who will I study? Who will I study? What permission will I need?
Assessing Information Literacy with SAILS Juliet Rumble Reference & Instruction Librarian Auburn University.
Assessment Ice breaker. Ice breaker. My most favorite part of the course was …. My most favorite part of the course was …. Introduction Introduction How.
Minnesota Manual of Accommodations for Students with Disabilities Training January 2010.
Validity Evaluation NCSA Presentation NAAC/NCIEA GSEG CONSTORIA.
Massachusetts Department of Elementary & Secondary Education 11  What role will student feedback play in your district next year?
Report on the NCSEAM Part C Family Survey Batya Elbaum, Ph.D. National Center for Special Education Accountability Monitoring February 2005.
1 Chapter 22 Assessing Motor Behavior © Gallahue, D.L., & Ozmun, J.C.. Understanding Motor Development. McGraw-Hill.
Standards-Based Tests A measure of student achievement in which a student’s score is compared to a standard of performance.
1 Conceptual Framework Research Questions Data Collection.
COM 535, S08 Designing and Conducting Formative Evaluations April 7, 2008.
Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
Planning a Customer Survey Part 1 of 3 Elaine Carlson, Westat Anne D’Agostino, Compass Evaluation & Research.
CaMSP Science Assessment Webinar Public Works, Inc. Sharing Lessons Learned in the Development and Use of Science Assessments for CaMSP Teachers and Students.
Instrument Development and Psychometric Evaluation: Scientific Standards May 2012 Dynamic Tools to Measure Health Outcomes from the Patient Perspective.
Business and Management Research
An Introduction to Evaluating Federal Title Funding
Students can fail professionally if they:
Presentation transcript:

Data Collection Strategies An Overview

How Do We Assess ?

Data Collection Strategies BEFORE collecting data, your first question should be.... Has someone already collected the information from my sample of interest?

Data Collection Strategies Personal interview Focus group Telephone poll Telephone interview Classroom assessment Paper/pencil survey Web survey Database/Warehouse Existing Reports Naturalistic observation Direct ContactIndirect Contact

Assessment Instruments Standardized Build Your Own When selecting assessment tools you have a choice …

Existing Standardized Instruments Proven item pool Reliability / Validity Clarity of directions Scoring Benchmark comparisons Data analysis Reporting formats Cost Processing Delay Item pool Inappropriate norms Pros Cons

Build Your Own Instruments Relevant item pool Stakeholder involvement Theory/Model based Lower Cost Processing control Data analysis control Report format Long development time Local technical expertise Unknown reliability/validity Length Poorly worded items Pros Cons

Evaluating Existing Instruments Does the title convey the content to student? Review content of EVERY item by team. Are items relevant to ALL students?

Evaluating Existing Instruments Does manual report reliability ? Does manual report validity evidence? How appropriate is normative/benchmark data?

Evaluating Existing Instruments Are results timely? Is the cost worth the benefit?

Sources for Assessment Instruments Instrument Sources

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com Inc. All rights reserved.