From Administration to Z-Scores: An Overview of Survey Research

Slides:

Advertisements

Similar presentations

Data Collection Strategies An Overview. How Do We Assess ?

Advertisements

Surveys 1 compiled by Anna Bączkowska 2 Attractions -Scan wide field of issues, populatins, programmes (large-scale data - generalisable results) -gathers.

Maximizing Your NSSE & CCSSE Results

Survey Design Teri Peterson Acknowledgements The Survey Kit By Arlene Fink Survey Design and Sampling Procedures By Tony Babinec Statistics.com.

Postsecondary Education Sample Studies and Data Tools Susan Aud, Ph.D. National Center for Education Statistics Institute of Education Sciences U.S. Department.

2012 National Survey of Student Engagement Jeremy D. Penn & John D. Hathcoat.

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy

Pre-Conference Workshop ELI06 January 29, Student and Faculty Surveys Paul R. Hagner Associate Program Director EDUCAUSE Learning Initiative Copyright.

POPULATION RESEARCH SEMINAR SERIES Sponsored by the Statistics and Survey Methods Core of the U54 Partnership Questions? Comments? Send us an !

René Cintrón, Ph.D. NONPROFIT BOARD COMPETENCIES AND ORGANIZATIONAL EFFECTIVENESS.

{ Driving Up or Dialing Down Competition in Introductory STEM Courses: Individual and Classroom Level Factors Bryce E. Hughes, Sylvia Hurtado, and M. Kevin.

Educational Outcomes: The Role of Competencies and The Importance of Assessment.

Update from the UNC General Education Council [presented to the UNC Board of Governors’ Educational Planning, Programs, and Policies Committee on February.

Reversing Underrepresentation: The Impact of Undergraduate Research Programs on Enrollment in STEM Graduate Programs Sylvia Hurtado, M. Kevin Eagan, Tanya.

Illinois CEE Student Survey Results Dr. Julia Melkers, Associate Professor School of Public Policy Georgia Institute of Technology, Atlanta, Georgia Summary.

Chapter 13 Survey Designs

NSSE Foundations: An Introduction to the National Survey of Student Engagement Regional Users’ Workshop October 6-7, 2005.

Meal Time/Family Time: An Evaluation of a Nutrition Education Program Sondra M. Parmer, MS Alabama Cooperative Extension System Auburn University.

What’s in the works for General Education Assessment? Dan McCollum, Ph.D. Associate Director of Academic Assessment.

Critical Thinking Test Selection - Process & Evaluation Frances Dearing, PhD Assistant Dean of Assessment, Academic Support and Placement, Westchester.

Causal-Comparative Research

Academic Work Environment Survey 2004 Barbara Silver, ADVANCE Program Director Presented at the ADVANCE National Conference, G-Tech, Atlanta, Georgia April.

Gauging the Impact of Student Characteristics on Faculty Course Evaluations Laura Benson Marotta University at Albany – SUNY.

Two Decades of User Surveys The Experience of Two Research Libraries from 1992 to 2011 Jim Self, University of Virginia Steve Hiller, University of Washington.

1 A Comparison of Traditional, Videoconference-based, and Web-based Learning Environments A Dissertation Proposal by Ming Mu Kuo.

Our Group Plan for a Mixed Methods Study by John W. Creswell, Ph.D. and Vicki L. Plano Clark, M.S. University of Nebraska-Lincoln

Review of SUNY Oneonta Course Evaluation Form Report and Recommendations from The Committee on Instruction: Part II October 4, 2010.

Washington State Prevention Summit Analyzing and Preparing Data for Outcome-Based Evaluation Using the Assigned Measures and the PBPS Outcomes Report.

Chapter 9 Descriptive Research. Overview of Descriptive Research Focused towards the present –Gathering information and describing the current situation.

Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.

Survey Designs EDUC 640- Dr. William M. Bauer

Survey Design: Sharing What We ’ re Learning. Health Behavior Survey (HBS) CASE DPM DPNbS ODOS VPSA UVA ESHC OHP Health Promotion Survey (HPS) SOM ISAS.

Registration Satisfaction Survey FAS Report, Fall Presented by: K. El Hassan, PhD. Director, OIRA.

Questionnaires and Interviews

FAEIS Project User Opinion Survey 2005 Thursday, June 23, 2005 Washington, D.C. H. Dean SutphinYasamin Miller ProfessorDirector, SRI Agriculture & Extension.

The Voluntary System of Accountability (VSA SM ).

Key steps in conducting survey research Decide if a survey is the best design to use Short time, economical, dispersed population, anonymity Report what.

RESERCH METHODS COURSES AT MAKERERE UNIVERSITY M. Nabasirye FACULTY OF AGRICULTURE.

Title Author Names Author Pictures Faculty Advisor: C. Christopher Lee, PhD Lake Superior State University Spring 2014.

Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.

Evaluating a Research Report

Final Update on the New Faculty Course Evaluation & Online System November, 2003.

BY THE NUMBERS: QUANTITATIVE DATA ANALYSIS Sheika Kendi Georgia State University.

Chapter 5 (first half). Research Design A set of advance decisions that make up the master plan specifying the methods and procedures for collecting and.

AIR 2000 On-line vs. Paper-and-Pencil Surveying of Students’ Willingness to Re-enroll: A Case Study Phil Handwerk, Cristi Carson, and Karen Blackwell University.

Students Course and Teacher Evaluation Please refer to notes at the bottom of this slide.

1a Introduction to Quantitative Tools and Techniques Materials Developed by The IRIS Center at the University of Maryland.

NAME Evaluation Report Name of author(s) Name of institution Year.

SURVEY RESEARCH.  Purposes and general principles Survey research as a general approach for collecting descriptive data Surveys as data collection methods.

Chapter 17 Introduction to Survey Research. Surveys – why a survey? Surveys are conducted to describe the characteristics of a population. Examples of.

Principles of Instrument & Measurement Development Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

Developing NAEP Frameworks: A Look Inside the Process Mary Crovo Deputy Executive Director National Assessment Governing Board November 17, 2007.

© 2007 SRI International CPATH Principal Investigators Meeting: Program Evaluation Update March 26, 2010 By the Center for Education Policy Dr. Raymond.

Instructors’ General Perceptions on Students’ Self-Awareness Frances Feng-Mei Choi HUNGKUANG UNIVERSITY DEPARTMENT OF ENGLISH.

Family Outcomes and SSIP State of North Carolina Infant Toddler Program Gary Harmon, PhD Part C Data Manager.

March 14, 2009 ACRL 14 th National Conference Seattle, WA ClimateQUAL™: Organizational Climate and Diversity Assessment Presented by Martha Kyrillidou,

C R E S S T / U C L A 1 UCLA Graduate School of Education & Information Studies Center for the Study of Evaluation (CSE) National Center for Research on.

Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.

Chapter 2: Research in Child Development 2.1 Doing Child-Development Research 2.2 Child-Development Research and Family Policy.

Agenda: Surveys –In-person, Paper, telephone, and web –Computer assisted –Instrument Design Administrative data WorkFirst Longitudinal Study Hands-on surveys.

COLLECTING DATA: SURVEYS AND ADMINISTRATIVE DATA PBAF 526 Rachel Garshick Kleit, PhD Class 8, Nov 21, 2011.

Practical issues in research. The Research Question Design Sample Variables Data collection Statistical analysis Presentation.

Chapter 2: Research in Child Development Module 2.1 Doing Child-Development Research Module 2.2 Child-Development Research and Family Policy Children and.

1 Identifying Instruction-Related Research Issues Deborah Lines Andersen School of Information Science and Policy University at Albany June 26, 2004.

Research Study.

Ellen Bara Stolzenberg, Ph.D. Assistant Director, CIRP

College Sexual Violence in Context:

Improving and Using Family Survey Data

Work Schedule Methodological Issues Variables Constant

Presentation transcript:

From Administration to Z-Scores: An Overview of Survey Research Ellen Bara Stolzenberg, Ph.D. Dominique Harrison UCLA Higher Education Research Institute

Survey Administration Before During After ADMINISTRATION & PLANNING BEST PRACTICES COLLEGE IMPACT

ADMINISTRATION & PLANNING: FIVE Ws and an H Who What When Where Why How *Not necessarily in this order

WHAT & WHY Overall purpose of survey/study Research questions Goals for data use, policy, & practice Longitudinal or cross-sectional

WHAT & WHY (continued) Audience? Stakeholders? Is a survey the best option? Existing instrument vs. Design your own

Existing instrument vs. Design your own Existing instruments? Existing literature? Pilot Focus groups to help design/redesign Types of Questions Validity & Reliability

Validity & Reliability Does it measure what it is designed to measure? Reliability Does the measurement give consistent results?

WHO Population vs. Sample Population of interest Freshmen Faculty Graduate Students STEM Undergraduates Etc. Survey all or sub-sample?

WHO (continued) Personal Identifiers Confidentiality vs. Anonymity Merging data

3 Dreaded Letters

WHEN, WHERE, & HOW Time of year Time of term Time of week Time of day Mode of administration Proctored setting Pre-notification Incentives

BEST PRACTICES Administration Paper vs. Web Follow-up (reminders, communication) Advertising Survey length

COLLEGE IMPACT Reports & Deliverables Disseminating Data Merging Data Format Audience Mode Merging Data Analysis & Interpretation

Analysis & Interpretation Descriptives Frequency distributions Crosstabs Factor Analysis/Constructs Group Comparisons T-tests/ANOVA & Post-hoc tests Longitudinal Studies Regression

Discussion & Questions Campus-specific concerns? Examples with varying levels of success? General questions?

Contact Information www.heri.ucla.edu Ellen Stolzenberg stolzenberg@gseis.ucla.edu 310-825-6991 Dominique Harrison heri@ucla.edu 310-825-7079