The Role of Formative Research in Media Development Rosemarie T. Truglio, Ph.D. Sesame Workshop 1.

Slides:



Advertisements
Similar presentations
10 th – 12 th Grade Journalism EDU 2200 Technology for Teachers Fall 2009.
Advertisements

Evaluating Risk Communication Katherine A. McComas, Ph.D. University of Maryland.
From Harm to Home | Rescue.org Advancing Research and Learning on Parenting Interventions in Low-Resource or Humanitarian Settings Dr. Jeannie Annan Director,
Overview of Formative Assessment (Diagnostic & Feedback) vs. Summative Assessment (Mastery & Standardised) Presented by Philip Holmes-Smith School Research.
Using Mixed-Methods and Survey Research in Project Evaluation/Assessment Pat Campbell QEM Workshop on Assessment and Evaluation August 7-8, 2009.
Introduction We’ll present ways to develop effective faculty development.
The Family as a Context for Learning Aggression and Violence Steven Swinford, PhD Department of Sociology & Anthropology Montana State University.
1 Presentation to OHM Conference ‘Whose Health Service is it anyway?’ ‘Developing Children-centred Childcare’ Jenny Bernard Early Childcare Services Manager.
Regional Weather Tracking Unit Portfolio Presentation Courtney Nielsen.
Assessment OF Learning (Summative) vs
Usability Evaluation Evaluation should occur continually through the design and implementation process. Evaluation methods are applied as the interface.
Evaluation of Instructional Technologies, Programs CYS Technology I.
1 Types of Evaluation Decide on the Purpose: Formative - improve and inform Summative- identify value/effect.
HS 325 Tests of Motor Development Mon, Nov. 13: Meet in Rolle, dressed for activity Volunteers needed to help with gym set-up.
CIPPI introduction to the model
Account Planning and Research Chapter 06 McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
Grade 12 Subject Specific Ministry Training Sessions
Employment Interview Frequently used to make selection decisions (over 90% usage) Social exchange (interpersonal) process Search for information.
Multiple Modes for Evaluating Teaching Terri Riffe & Kris Weatherly University Teaching Center Gretchen Gibbs Learning Technology Center.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Instructional Design presented by Roberto Camargo
Instructional Design Aeman Alabuod. Instructional Design instructional Design (also called Instructional Systems Design (ISD)) is the practice of creating.
Instructional System Design
What do Parent’s Want? An Exploratory assessment of the parenting needs and desires of parents with children 0-6 years residing in the Calgary Health Region.
Words Have Power A week long language arts/current events module for students in a middle school language arts class.
LISA HOLMES INSTRUCTIONAL DESIGN. The process of creating an effective learning experience that takes into consideration: what needs to be learned what.
Instructional System Design
AN INTRODUCTION TO THE BENEFITS AND REQUIREMENTS PATRICIA EARLE M.A.T. 1.
1 Problem Based Instruction: Making Learning Real Violet Harada and Linda Kim AASL Conference Kansas City, MO October 25, 2003.
Huntington English & Media Faculty Coaching for Better Learning.
Sophia Gatowski, Ph.D., Consultant National Council of Juvenile & Family Court Judges Sophia Gatowski, Ph.D., Consultant National Council of Juvenile &
Interstate New Teacher Assessment and Support Consortium (INTASC)
Communication Degree Program Outcomes
1 6-8 Smarter Balanced Assessment Update English Language Arts February 2012.
Outline Consumer behavior Social and cultural influences on consumers Psychological influences on consumers The decision process Chapter 5 Account Planning.
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
Four Basic Principles to Follow: Test what was taught. Test what was taught. Test in a way that reflects way in which it was taught. Test in a way that.
Capstone- Teaching with Common Core in a school garden. By: Susan Spigelmire.
The Partnership for a Healthy Mississippi: A Comprehensive Prevention Program for the Washington County and Greenville, Mississippi, School District Teddy.
 2008 Johns Hopkins Bloomberg School of Public Health Evaluating Mass Media Anti-Smoking Campaigns Marc Boulay, PhD Center for Communication Programs.
Assessment and Grading A student gets a “B” in Chemistry 11. What does this mean?
Teacher Evaluation Jie-Qi (Jackie) Chen Erikson Institute, Chicago i3 learning community October 16, 2012.
1 Learning for Everyone Creating Making Models using universal design.
S-TEAM PROJECT: Dialogic Inquiry University of Leeds January 2010 Jaume Ametller and Phil Scott School of Education University of Leeds.
Summary of Local Seminars & Focus Groups 20/06/ Athens WP8 – TESTING II coordinated by IFI.
Chapter = 6 Advertising Process.
Formative Assessment vs. Summative Assessment Assessment OF Learning (Summative) vs. Assessment FOR Learning (Formative)
USS Midway Museum Building a Sustainable Future for All Generations Jacobs and Clevenger Casewriters’ Workshop October 2015 Blodwen Tarter Golden Gate.
Assessment and Differentiation of Instruction. Assessment for Learning.
Evaluation Aims Process-focused: To monitor and improve the quality of the socio-cognitive engineering process Product-focused: To assess and improve the.
Evaluation and Assessment Mike Fleming. Assessment can be source of disagreement and tension implications for a Framework of reference for Languages of.
QRIS Validation Study Massachusetts Quality Rating and Improvement System Presentation to EEC Board March 11, 2014.
National Aeronautics and Space Administration Usability Work Update
John N. Lavis, MD, PhD Professor and Canada Research Chair in Knowledge Transfer and Exchange McMaster University Program in Policy Decision-Making McMaster.
Data Driven Planning and Decision-making for Continuous School Improvement: Developing a Program Evaluation Plan Leadership for Innovative Omani Schools.
C4EO – Ways of Working Heather Rushton, Planning and Performance 1.
Digital Storytelling Using E- Portfolios Sean Keesler – The Living SchoolBook Project Manager.
Teaching and Learning with Technology ETEC 562 Chapter 2 Robert Calvery Elizabeth McMurphy.
Teaching Parents About Food Safety: Strategies and Considerations Tina Vazin, Ph.D. Alabama State University.
Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
Rubric Exercises PERFORMANCE RATING PERFORMANCE CRITERIA Beginning 1 Developing 2 Accomplished 3 Content Diagnosis (Application & Analysis) PERFORMANCE.
Presenters: Drs. Thomas Koballa, Jr. & Tracy Linderholm
Summary of Evidence/Reason for Referral
Evaluation Jacqui McDowell.
Assessment OF Learning (Summative) vs
Unit 7: Instructional Communication and Technology
Developmentally Appropriate Practices (DAP)
Student’s Presentation
© The Author(s) Published by Science and Education Publishing.
Outline Consumer behavior Social and cultural influences on consumers Psychological influences on consumers The decision process Chapter 5 Account Planning.
Presentation transcript:

The Role of Formative Research in Media Development Rosemarie T. Truglio, Ph.D. Sesame Workshop 1

Defining Formative Research “ When the cook tastes the soup, that’s formative; when the guests taste the soup, that’s summative” Robert Stakes 2

Defining Formative Research “When the cook tastes the soup, that’s formative; when the guests taste the soup, that’s summative” Robert Stakes REVISION: “When the cook provides a tasting menu to the customers before finalizing the menu, that’s formative!” 3

Phases of Formative Research Defining the “IT” (goals of product addressing a particular need) Executing the goals Developing evaluation methods (with an eye toward summative) A CONTINUOUS & ITERATIVE PROCESS 4

Important Considerations Assessing the Needs What are the greatest needs to be addressed? What are the goals of the project? 5

Important Considerations: Understanding the Target Audience Who will use the materials? (e.g. children, parents, childcare providers-center and family based) How will the materials be used by the audience (e.g. homes / schools) 6

Important Considerations: Determining the Content What are the messages? How should the messages be presented? How can the messages be tested? 7

Measurement & Evaluation Appeal: What do respondents like the materials? What changes do they suggest? Usability: How will respondents use the materials? How can we make them more user-friendly? Comprehension: Do respondents understand the materials? How can we improve the materials to make them clearer? Transfer/Application: Will respondents use knowledge learned in other contexts? 8

Measurement & Evaluation Challenges 9 Self-Report: Bias in self-report data Interviews: Non-verbal measures Observations: Observer influence; settings (home vs. school)

Beyond the Cook….. …….Before Zagats 10 Decide to go healthy Know your customer Develop the menu Run the taste tests Refine the recipes Finalize the Menu New Grand Opening Earn a 5 star rating!