Usage Numbers Track participation in programs or services Methods : existing data, tracking system, calendar system, Key Performance Indicator (KPI) Student.

Slides:



Advertisements
Similar presentations
Graduation and Employment: Program Evaluation Using Dr. Michele F. Ernst Chief Academic Officer Globe Education Network.
Advertisements

Evaluation for 1st Year Grantees Shelly Potts, Ph.D. Arizona State University
What Behaviors Indicate a Student is Meeting Course Goals and Objectives? “Indicators”
A Guide for College Assessment Leaders Ursula Waln, Director of Student Learning Assessment Central New Mexico Community College.
Grantee Program Plan. Components of the Program Plan Goals  Objectives  Activities  Techniques & Tools  Outcomes/Change.
4 Conducting Marketing Research 1. What is Marketing Research? Marketing research is the systematic design, collection, analysis, and reporting of data.
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
Graduate Program Assessment Report. University of Central Florida Mission Communication M.A. Program is dedicated to serving its students, faculty, the.
Qualitative Methods Lisa Harrison: Chapter 5. Qualitative and Quantitative (74) Quantitative: Focuses on the analysis of numerical data (statistics, polling),
47.269: Research I: The Basics Dr. Leonard Spring 2010
Observing Behavior A nonexperimental approach. QUANTITATIVE AND QUALITATIVE APPROACHES Quantitative Focuses on specific behaviors that can be easily quantified.
Initiative Changes Deletion: Develop teaching and learning strategies specifically designed to enhance online courses.
A Toolkit of Assessment Methods: Multiple Approaches for Collecting Meaningful Data Nathan Lindsay, Ph.D. MUS Assessment Workshop October 2, 2014.
How to Use Baseline: Key Performance Indicators Presented by: Melissa Wright, M.A. Assistant Director, Campus Labs Team September 21,
Developing an Assessment Plan Owens Community College Assessment Day Workshops November 13-14, 2009 Anne Fulkerson, Ph.D. Institutional Research.
BASIC STATISTICS WE MOST OFTEN USE Student Affairs Assessment Council Portland State University June 2012.
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Guide to Evidence for WASC Accreditation Dr. Robert Gabriner City College of San Francisco Student Learning Outcomes Workshop Strand 3.
Foundations of Assessment II Methods, Data Gathering and Sharing Results.
Step 4: Gather Evidence Luann D’Ambrosio, MEd. Review: What to measure What amount of $ and time were invested What did the program actually consist of.
ASSESSMENT Formative, Summative, and Performance-Based
Direct vs Indirect Assessment of Student Learning: An Introduction Dr. Sheila Handy, Chair Business Management and Co-Chair University Assessment Committee.
The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.
Lesson 2 – Studying Marriages and Families Robert Wonser.
David Gibbs and Teresa Morris College of San Mateo.
Assessment of Information Skills. There is more teaching going on around here than learning and you ought to do something about that. Graduating Senior.
Please review this power point presentation after reading Chapter 1 in the text – you will have quiz questions that pertain to this material.
Diagnostic & Corrective Reading.  Review of Formal/Informal Assessments  Interest Inventories  Attitude Surveys  Efficacy and Awareness Surveys 
Student Engagement Survey Results and Analysis June 2011.
Chapter 13 Data Sources, Sampling, and Data Collection.
Bill Knight Institutional Effectiveness Student Affairs Assessment: Developing an Effective Assessment Plan.
Student Services Assessment Workshop College of the Redwoods Angelina Hill & Cheryl Tucker Nov 28 th & 30 th, 2011.
Assessing Program Quality with the Autism Program Environment Rating Scale.
Building Your Assessment Plan Esther Isabelle Wilder Lehman College.
Evaluating a Research Report
Overview of Evaluation Designs. Learning objectives By the end of this presentation, you will be able to: Explain evaluation design Describe the differences.
Foundations of Assessment I Understanding the Assessment Process.
TAH Project Evaluation Data Collection Sun Associates.
Teaching Today: An Introduction to Education 8th edition
Educational Effectiveness Fall Faculty Retreat 2006 Leanne Neilson Halyna Kornuta.
ASSESSMENT OF CORE SKILLS/ GENERAL EDUCATION OUTCOMES Angelina Hill, PhD Associate Director, Office of Academic Assessment.
ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.
Cultural Voices: Perceptions of Faculty, Staff and Students A Cultural Study funded by the Equal Opportunity Panel University of Kentucky.
Selected Teaching-Learning Terms: Working Definitions...
Assessing Your Assessments: The Authentic Assessment Challenge Dr. Diane King Director, Curriculum Development School of Computer & Engineering Technologies.
Exploring Evidence.
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Eleven Watching And Listening: Qualitative Research For In-depth Understanding.
Paradigms/Research Traditions “Instead of asking, how can this be true? We could ask, what if this were true? What then?” (Bochner, 2000, p. 267)
0 1 1.Key Performance Indicator Results ( ) KPI Survey Statistics Student Distribution by Year in Program KPI Overall Results Student Satisfaction.
Beginning with the End in Mind: Choosing Outcomes and Methods
AMSc Research Methods Research approach IV: Experimental [1] Jane Reid
VT University Libraries: Identifying, Teaching, and Assessing What Matters Most Office of Academic Assessment Ray Van Dyke,
Measuring for Success Module Nine. Reflecting on the Previous Session What was most useful? What progress have you made? Any comments or questions?
What Are the Characteristics of an Effective Portfolio? By Jay Barrett.
Consistency of Assessment (Validation) Webinar – Part 1 Renae Guthridge WA Training Institute (WATI)
Guide to Evidence for WASC Accreditation Dr. Robert Gabriner City College of San Francisco Student Learning Outcomes.
Student Learning Outcomes and SACSCOC 1.  Classroom assessment ◦ Grades ◦ Student evaluation of class/course  Course assessment –????  Academic program.
Understanding Assessment The Basics Office for Institutional Effectiveness and Assessment.
Developing Rubrics within the Context of Assessment Methods Peggy Maki Senior Scholar Assessing for Learning AAHE
How do you know your product “works”? And what does it mean for a product to “work”?
Assessing Student Learning Outcomes Andrew Swan What are Student Learning Outcomes?  Education reform in the 1990s pushed for more sophisticated goals.
 Summative  Formative  Individuals,  Assignments,  Learning activity  Courses,  Programs,  Institutions.  Assessment at a point in time.
So You Think You’ve Made a Change? Developing Indicators and Selecting Measurement Tools Chad Higgins, Ph.D. Allison Nichols, Ed.D.
Educational Effectiveness Assessing WIC Student Learning Outcomes October 2006 Halyna Kornuta.
2009 TACUSPA Fall Conference October 5, 2009 El Paso, Texas.
Highline community college
Data Collection Methods
The Scientific Method in Psychology
Presented by: Skyline College SLOAC Committee Fall 2007
Type of Assessment Usage Numbers Track participation in programs or services Methods: existing data, tracking system, calendar system, Key Performance.
Presentation transcript:

Usage Numbers Track participation in programs or services Methods : existing data, tracking system, calendar system, Key Performance Indicator (KPI) Student Needs Keeps you aware of student body or specific populations Methods : survey, focus group, visual methods Program Effectiveness Level of satisfaction, involvement, effectiveness helpfulness, etc. Methods : survey, focus group, observation Cost Effectiveness How does a program/service being offered compare with cost? Methods : existing data, comparative data, Key Performance Indicator (KPI) Campus Climate Assess the behaviors/attitudes on campus Methods : focus group, document analysis, survey, existing data, case study, observation Learning Outcomes Assess how a participant will think, feel, or act differently as a result of your program/course/service Methods : survey/quiz, rubric, portfolio, one- minute assessment Comparative/ Benchmarking Comparing a program/service against a comparison group Methods : survey, rubric, existing data, Key Performance Indicator (KPI) National Standards or Norms (i.e, CAS) Comparing a program/service with a set of pre-established standards (e.g., CAS, Information Literacy) or normative data (e.g., ACT scores) Methods : survey, document analysis, existing data Types of Assessment ACP 2012 – Selecting a Method Handout Some materials originate from Student Voice HO #1

Direct Methods Any process employed to gather data which requires subjects to display their knowledge, behavior, or thought processes (when assessing learning). Any process employed to gather data which asks subjects to reflect upon their knowledge, behaviors, or thought processes (when assessing learning). e.g. Where on campus would you go or who would you consult with if you had questions about which courses to register for the fall? e.g. I know where to go on campus if I have questions about which courses to register for in the fall. Strongly agree, Neither agree nor disagree, Strongly disagree Focus on numbers/numeric values Who, what, where, when Match with outcomes about knowledge and comprehension (define, classify, recall, recognize) Allows for measurement of variables Uses statistical data analysis May be generalize to greater population with larger samples. Easily replicated. Focus on text/narrative from respondents Why, how Match with outcomes about application, analysis, synthesis, evaluate Seeks to explain and understand Ability to capture “elusive” evidence of student learning and development Indirect Methods Methods : “quiz” type survey, rubric, document analysis, observation, portfolio, visual methods, one-minute assessment, and/or case study Methods : survey, focus group, document analysis, and/ or one-minute assessment Methods : survey, existing data, rubric (if assigning #’s), tracking, system, observation, document analysis, KPI Methods : focus grp/ interview, portfolio, rubric (if descriptive), visual methods, one-minute assessment, open-ended survey question, observation document analysis, case study Quantitative MethodsQualitative Methods ACP 2012 – Selecting a Method Handout Some materials originate from Student Voice HO #2