OSCAR MCKNIGHT PH.D. ASSISTANT DEAN FOR STUDENT AFFAIRS DIRECTOR OF PSYCHOLOGICAL COUNSELING SERVICES ASHLAND UNIVERSITY Student Affairs Program Evaluation:

Slides:

Advertisements

Similar presentations

PhD Completion Project of Brown University Overview and Plans Sheila Bonde Dean, Graduate School July 11, 2007.

Advertisements

Introduction to Competency-Based Residency Education

Research Training/Education Core Overall Goal - to enhance the interdisciplinary education pipeline and expand the number of persons working collaboratively.

Chapter 17 Overview of Multivariate Analysis Methods

Psychology 202b Advanced Psychological Statistics, II April 7, 2011.

Academic Assessment Workshop: A Review of the Student Satisfaction Inventory Implementation & Implication Liz Baldizan, Ed.D., Assistant Dean, Academic.

Graduating Senior Exit Survey Lindsay Couzens, M.S. And Bea Babbitt, Ph.D. Academic Assessment 1.

Assessment of Student Affairs Initiatives for First-Year Students National Conference on First-Year Assessment October 12-14, 2008 San Antonio, Texas Jennifer.

When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.

Process Management Robert A. Sedlak, Ph.D Provost and Vice Chancellor, UW-Stout Education Community of Practice Conference At Tusside in Turkey September.

19-1 Chapter Nineteen MULTIVARIATE ANALYSIS: An Overview.

1 CCLI Proposal Writing Strategies Tim Fossum Program Director Division of Undergraduate Education National Science Foundation Vermont.

The Evergreen State College Game show Your hosts: The folks from Institutional Research and Assessment.

Goals of Factor Analysis (1) (1)to reduce the number of variables and (2) to detect structure in the relationships between variables, that is to classify.

Shimon Sarraf Center for Postsecondary Research, Indiana University Bloomington Using NSSE to Answer Assessment Questions Regional User’s Workshop October.

Correlational Designs

The Process of Scope and Standards Development

DESIGNING, CONDUCTING, ANALYZING & INTERPRETING DESCRIPTIVE RESEARCH CHAPTERS 7 & 11 Kristina Feldner.

BASIC STATISTICS WE MOST OFTEN USE Student Affairs Assessment Council Portland State University June 2012.

Factor Analysis Psy 524 Ainsworth.

Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Factor Analysis PowerPoint Prepared by Alfred.

Outcomes Assessment and Program Effectiveness at Florida Atlantic University : Student Affairs Gail Wisan, Ph.D. July 13, 2010.

Enhancing Parents’ Role in Higher Education Assessment Anne Marie Delaney Director of Institutional Research, Babson College.

C onceptual Framework A ssumption University May 8-9, hrs. Bancha Saenghiran, f.s.g., Ph.D. Student Affairs.

Performance Improvement in a Medical School: Defining Baseline Metrics – Pursuing Benchmark Targets.

September The Division of Student Affairs provides student learning and leadership opportunities that enhance overall academic, professional and.

Dr. Kevin Bailey Vice President Division of Student Affairs at.

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Creating a Culture of Student Affairs Assessment Katie Busby, Ph.D. Jessica Simmons Office of Student Affairs Assessment & Planning University of Alabama.

L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.

ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.

Factor Analysis in Individual Differences Research: The Basics Psych 437.

NSSE 2013 How to Use Results (or “Why you should care about NSSE”) 8/26/

Thursday AM  Presentation of yesterday’s results  Factor analysis  A conceptual introduction to: Structural equation models Structural equation models.

Factor Analysis Revealing the correlational structure among variables Understanding & Reducing Complexity.

Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.

The Satisfied Student October 4 th, Today’s Presentation  Present data from Case’s Senior Survey and the National Survey of Student Engagement.

OBJECTIVE 7. STUDENTS WILL DEMONSTRATE UNDERSTANDING BY EXPLAINING QUANTITATIVE RESEARCH METHODS.

DON’T REINVENT THE WHEEL: INFORMING OUTCOMES ASSESSMENT WITH EXISTING SURVEY DATA Holly Hoffman, Ph.D. Research Analyst University of San Diego.

Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.

Our Story: Our Story: The Story of One Student Affairs Division’s Quest to Improve Assessment Don Whalen, Coordinator of Assessment, Department of Residence.

Education 795 Class Notes Factor Analysis Note set 6.

Chapter 15 The Chi-Square Statistic: Tests for Goodness of Fit and Independence PowerPoint Lecture Slides Essentials of Statistics for the Behavioral.

Institutional Effectiveness: Sophomores’ Evaluations of UNC Charlotte Findings from the Sophomore Surveys Cathy Sanders Director of Assessment.

 Retention  Liability.  Studies show that students receiving counseling services are more likely to stay in school than students who don’t receive.

OUTCOMES ASSESSMENT BREAKOUT SESSION All College Day August 17, 2012 Lisa Level, Student Services John Thomford, SLO Coordinator.

Multivariate Data Analysis Chapter 3 – Factor Analysis.

Factor Analysis I Principle Components Analysis. “Data Reduction” Purpose of factor analysis is to determine a minimum number of “factors” or components.

Factor Analysis Basics. Why Factor? Combine similar variables into more meaningful factors. Reduce the number of variables dramatically while retaining.

CCSSE 2012 Findings for Southern Crescent Technical College.

Principal Component Analysis

Chapter Seventeen Copyright © 2004 John Wiley & Sons, Inc. Multivariate Data Analysis.

Background Objectives Methods Study Design A program evaluation of WIHD AfterCare families utilizing data collected from self-report measures and demographic.

Kapil Bawa, Ph.D., Professor of Marketing, Zicklin School of Business Micheline Blum, Director, Baruch College Survey Research, Distinguished Lecturer,

Student Affairs Assessment and Research Conference 2014 The Ohio State University Ohio Union.

Chapter 14 EXPLORATORY FACTOR ANALYSIS. Exploratory Factor Analysis  Statistical technique for dealing with multiple variables  Many variables are reduced.

From Program Theory to Systems Theory: Using Logic Analysis to Re- conceptualize an Evaluation Lori L. Bakken, PhD; Jonathan M. Ross, MD; Curtis A. Olson,

McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.

Institutional Effectiveness: Seniors’ Evaluations of UNC Charlotte Findings from the Senior Surveys Cathy Sanders Director of Assessment Office.

Methods of multivariate analysis Ing. Jozef Palkovič, PhD.

Creating a Comprehensive Early Warning System to Further Student Success and Retention Shane Hammond CCLA June, 2007.

Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.

Division of Student Affairs

What you need to know now to be promoted later!

Principal Component Analysis

PhD Completion Project of Brown University Overview and Plans

Interpreting & Summarizing

Presentation transcript:

OSCAR MCKNIGHT PH.D. ASSISTANT DEAN FOR STUDENT AFFAIRS DIRECTOR OF PSYCHOLOGICAL COUNSELING SERVICES ASHLAND UNIVERSITY Student Affairs Program Evaluation: A Factor Analytic Solution

Program Overview 1. This program addresses the use of factor analysis in program evaluation. 2. Specific focus will highlight the development and selection of marker items. 3. The goal is to label and interpret factors according to targeted questions of interest. 4. Therefore, results are not only descriptive, but predictive - with practical application to student retention and satisfaction.

Student Affairs Assessment Benchmark best practices Measure student satisfaction and learning Track student participation Evaluate program results Determine future program or service needs Assess effectiveness of delivered programs

SA Assessment: Typical Survey Format

Typical Findings (example 1)

Typical Findings (example 2)

Using Factor Analysis In Student Affairs Factor analysis originated in the behavioral sciences - primarily psychometrics. Today factor analysis is equally useful in all social sciences; specifically, Student Affairs Assessment.

Exploratory Factor Analysis Factor analysis is a statistical method used to reduce the set of variables in a dataset; it can describe unobserved latent variables. Factor analysis is appropriate for program evaluation; given the use of created or identified marker items.  Varimax rotation: is an orthogonal rotation, minimize correlation between factors.  Direct oblimin rotation: factors are allowed to be correlated – resulting in diminished interpretation.

Marker Item(s) Individual Marker: an identified variable used to segment population data; for example, senior class member. Clustered Marker: jointing individual classifications into one conceptual grouping; for example, Student Affairs Divisions.

Correlation Relationships Correlation: a relationship in which two or more things are mutual or complementary - can indicate a predictive relationship; however, statistical dependence is not sufficient to demonstrate the presence of a causal relationship. Factor loadings*: are the correlation coefficients between the variables and factors (think Pearson's r)

Correlation Matrix: Marker Items (Ind.)

Marker Items (Cluster) Student Affairs Satisfaction = Community Service + Residence Life + Safety Services + Counseling + Health Center + Greek Life + Minority Services + Recreation Services + Career Services + Leadership + Commuter Services + Student Activities University Excitement = student activities, weekend life, Recreation Services Academic Satisfaction = major, faculty and advising Living Experience = Residence life and Convo

Correlation Matrix: Marker Items (cluster)

Factor Matrix (Clustered Marker): Total Variance

Rotated Factor Matrix (Clustered Marker)

Factor Matrix (Individual Marker): Total Variance

Rotated Factor Matrix (Individual Marker)

Factor Matrix (Individual Markers): Student Affairs - Total Variance

Rotated Factor Matrix (SA - Individual Markers)

Career Center: Promotions

Career Center: Satisfaction By College and Year

Career Center: Services

Career Center Services: Relative Importance

Summary Factor analysis is a viable research process for Student Affairs Assessment. Marker items have utility in developing conceptual areas of assessment. Answering specific questions of interest can be practical given the factor structure. Outcomes can describe a current situation. Results can be segmented and predictive. Overall, there are practical applications for Factor Analysis in Student Affairs – remember to combine it with other assessments!