Assessed: 2010, 2011, 2012. SLO 4.1: Identify and describe the impact of the global economy on business decisions. SLO 4.2: Explain and apply a global.

Slides:



Advertisements
Similar presentations
The Assessment Imperative: A Work in Progress A Focus on Competencies Ricky W. Griffin, Interim Dean Mays Business School Texas A&M University.
Advertisements

Dept. of Computing and Technology (CaT) School of Science and Technology B.S. in Computer Information Systems (CIS) CIP Code: Program Code: 411.
Learning without Borders: Internationalizing the Gator Nation M. David Miller Director, Quality Enhancement Plan Timothy S. Brophy Director, Institutional.
2013 Spring Assessment Colloquium Beth Tipton CBPA Associate Dean “CLOSING THE LOOP” AND IMPROVING STUDENT LEARNING VIA ONGOING ASSESSMENT.
CWU Writing Assessment. Why? To improve student learning.
Scoring Rubrics Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
Graduate Program Assessment Report. University of Central Florida Mission Communication M.A. Program is dedicated to serving its students, faculty, the.
School of Business University of Bridgeport Admissions Presentation Robert Gilmore, Ph.D. Associate Dean School of Business.
A Definition of Distance Education Distance education is a formal educational process in which the majority of the learning occurs when student and instructor.
SCHOOL OF BUSINESS Masters in Business Administration CIP Code: digit Program Code: Program Quality Improvement Report
Beginning the Adventure of Your Thesis/Project (SWRK500) or Advanced Research (SWRK501) & Capstone Course (SWRK502) ~ Culminating Experience ~ Prepared.
QEP Update CFCC Planning Retreat June 19, QEP Update Mid-Term Report Global Outcomes 1.Measurable improvement of students’ critical thinking skills.
Applying Learning Assessment Results to Strategic Planning at Multiple Levels Jannie R. Cobb, Librarian & Professor Jennifer M. Harrison, Associate Professor.
Assessing Students Ability to Communicate Effectively— Findings from the College of Technology & Computer Science College of Technology and Computer Science.
Assessment of Ethics Jones College of Business MTSU July 29, 2015.
Assessed: 5 Cycles 2006, 2009, 2010, 2011, 2013.
How to Use Data to Improve Student Learning Training Conducted at Campus-Based SLO Summit Spring 2014 How to Use Data to Improve Student Learning.
TaskStream Training Presented by the Committee on Learning Assessment 2015.
BY Karen Liu, Ph. D. Indiana State University August 18,
Overhaul of a Graduate Program in Arts Administration Master of Arts in Arts Administration – Initiated in 2003 – Low-residency—one weekend per month (over.
What do our students know?. What do we want our UG students to know? Student Learning Outcome Cycle #1 Assessed in: Cycle #2 Assessed in: Cycle #3 Assessed.
Computing and Technology Department School of Science and Technology BS in Information Technology CIP Code Program Code 414 Fall 2010 Program Quality.
Unit 1 – Preparation for Assessment LO 1.1&1.2&1.3.
Strategies for Implementing Program-Level Assessment through Outcomes Jeremy Anderson Manager, Academic Computing Dr. Kaitlin Walsh Instructional Designer/Technologist.
Assessment in General Education: A Case Study in Scientific and Quantitative Reasoning B.J. Miller & Donna L. Sundre Center for Assessment and Research.
Chapter 5 ©2001 South-Western College Publishing Pamela S. Lewis Stephen H. Goodman Patricia M. Fandt Slides Prepared by Bruce R. Barringer University.
National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.
Human Resource Management Lecture 09
College of Business Administration Lessons Learned Part I Assurance of Learning: Strategic Planning through Programmatic Assessment Kathleen A. Krentler.
Preparing and Evaluating 21 st Century Faculty Aligning Expectations, Competencies and Rewards The NACU Teagle Grant Nancy Hensel, NACU Rick Gillman, Valporaiso.
Combining Cases and Computer Simulations in Strategic Management Course. Mitchell, Rex C (2004). Combining cases and computer simulations in strategic.
Fall 2015 Professional Development Days C. Cruz-Johnson & R. Gamez August 28, Walking with Integrity Towards Student Success.
Assessed: 2007, 2010, 2011,  PHIL 101 (Introduction to Philosophy: Ethics)  GE elective choice  BA 300 (Ethical Decision Making in Business)
What the*!?# is an SLO? Train the Trainers Workshop Marcy Alancraig Cabrillo College
NCATE for Dummies AKA: Everything You Wanted to Know About NCATE, But Didn’t Want to Ask.
Institutional Planning, Assessment & Research 2010 Institutional Planning, Assessment & Research Assessment Review Committee Report College of Technology.
THE SLO PROCESS #1 create/update SLO’s, rubrics, & assessment methods #2 assess all students in all sections of all courses #3 maintain SLO assessment.
College of Business California State University, Monterey Bay February 28, 2014 College of Business Committee Structure: Preparing for AACSB.
What do our students know? A complete cycle of assessment: the common learning outcomes we hold for our UG students: Round IV,
Beginning the Adventure of Your Thesis/Project (SWRK500) or Advanced Research (SWRK501) & Capstone Course (SWRK502) ~ Culminating Experience ~ Prepared.
External Review Team: Roles and Responsibilities A Very Brief Training! conducted by JoLynn Noe Office of Assessment.
Assessment of Course-Level Learning Outcomes in Psychology.
Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Strategy for Human Resource Management Lecture 15
HRM 498 ASSIST Teaching Effectiverly/hrm498assist.com FOR MORE CLASSES VISIT
Assessment Plans Council of Deans, March 22, 2007.
Reading and Literacy M.Ed. Program.  Graduate programs across the university require some sort of exit option that shows that the student has mastered.
Assurance of Learning “Eberly AOL” All College Meeting – January 21, 2009 Prashanth Bharadwaj, Dean’s Associate Cyndy Strittmatter, Assistant Dean.
Managing Corporate Reputation Sarah Williams Senior Examiner December 2013 / March 2014 Assignment Brief.
Laboratory Science and Quantitative Core Requirements.
Quality Online Preparation: Qualities of Faculty, Courses, and Preparation Programs By Dr. Erin O’Brien Valencia College League of Innovation Conference,
CIAS Program Level Assessment Office of Educational Effectiveness Assessment September 6, 2016.
The Assessment Imperative: A Work in Progress
Developing Rubrics to Measure Learning at MICA
HRM 498 ASSIST Experience Tradition/hrm498assist.com
Keywords: Engineering ethics, design education,
Tia N. Dumas, Ph.D. Assistant Dean for Professional Development & Inclusive Excellence
Closing the Assessment Loop
Institutional Student Learning Outcome Assessment Report Fall 2015 Assessment Cycle
General Education Assessment
General Education Assessment Revision Plan Proposal
Course Evaluation Ad-Hoc Committee Recommendations
Dr. James W. Dottin Department Chair Business Administration
Collecting Data to Assess Capstone and Culminating Courses
General Education Assessment Revision Plan Proposal
Assessing Academic Programs at IPFW
What do our students know?
Department Chair: Liz Brown Date of Presentation: 01/20/17
SLO Assessment Cycle Instructional Breakout Session
Presentation transcript:

Assessed: 2010, 2011, 2012

SLO 4.1: Identify and describe the impact of the global economy on business decisions. SLO 4.2: Explain and apply a global perspective in making business decisions. Goal adopted May 2009, Assessed for the first time Spring 2010 (Cycle #2); again in Spring 2011 (Cycle #3); in Spring 2012 only the second SLO was assessed.

 Integrated into:  Preparation for the Major Requirements  Core Courses in the BSBA Major  Advanced Courses in the BSBA Major  MGT 405: International Business Strategy & Integration  Required capstone course for all BSBA students

CYCLE #  Final exams completed for the college-wide CBA capstone course (MGT 405) were examined.  Course Instructor and Director of Assessment developed a rubric after reviewing several from the global skills literature.  Rubric was widely distributed to students during the semester.  Course Instructor & Director of Assessment rated the final exams using the rubric following a training and norming session.

 7 Point scale from Weak to Excellent.  6-7: Exceeds Expectations  5: Meets Expectations  4: Approaches Expectations  2-3: Below Expectations  1: Fail  SLO mapped to Rubric criterion then criterion mapped to exam question.

 SLO #1: Identify and describe the impact of the global economy on business decisions.  Rubric Dimension: Understanding and Application of the relevant concepts and frameworks.  Exam Question: Describe the fundamental challenges faced as [a chosen case company] expands its products [internationally].

 SLO #2: Explain and apply a global perspective in making business decisions.  Rubric Dimension: Strategically integrate (i.e. integrate across internal and external environment; across functional areas; holistically from a firm perspective).  Exam Question: What recommendations would you offer to deal with these challenges [identified in previous response].

DimensionFail (1) Below (2 to Expectations 3) Approaches Expectations (4) Meets Expectations (5) Exceeds (6 to Expectations 7) #1 (mapped to SLO #1) #2 (mapped to SLO #2)

CYCLE #  Final exams completed for the college-wide CBA capstone course (MGT 405) were examined.  Course Instructor and Director of Assessment refined the Cycle #2 rubric based on mapping & experience. This resulted in SLO #2 being expanded to 2 dimensions.  Rubric was widely distributed to students during the semester.  Two independent CBA faculty members rated the final exams using the revised rubric following training and norming sessions.

 SLO #2: Explain and apply a global perspective in making business decisions.  2 Rubric Dimensions: ▪ Strategically integrate (i.e. integrate across internal and external environment; across functional areas; holistically from a firm perspective). ▪ Arrive at logical and well-reasoned conclusions/recommendations.  Exam Question: What recommendations would you offer to deal with these challenges [identified in previous response].

CYCLE #  Final exams completed for the college-wide CBA capstone course (MGT 405) were examined.  Director of Assessment & raters post-hoc determined question asked did not adequately assess SLO 4.1 hence decision to use data only to assess SLO 4.2 in this cycle.  Rubric used in Cycle #3 collapsed to a single dimension.  “Approaches” eliminated from rubric, 3 point scale used.  Two independent CBA faculty members rated the final exams using the revised rubric following training and norming sessions.

 Cycle #2:Spring Semester 2010 in MGT 405 ▪Sample Size: 124  Cycle #3: Spring Semester 2011 in MGT 405 ▪Sample Size: 120  Cycle #4: Spring Semester 2012 in MGT 405 ▪Sample Size: 162

 BENCHMARKS:  70% of our students should meet or exceed expectations for global perspective skills  30% of our students should exceed expectations for global perspective skills

Cycle #2

10.5% 25.8% 33.9% 29.8% “70% should meet or exceed expectations”; 36.3% actually did “30% should exceed expectations”; 10.5% actually did

ALL STUDENTS MGMT MAJORS STUDIED ABROADIB MAJORS Mean: 3.89 Mean: 3.95 Mean: 3.61Mean: 3.22

8.1% 30.1% 37.4% 24.2% “70% should meet or exceed expectations”; 38.2% actually did “30% should exceed expectations”; 8.1% actually did

ALL STUDENTS MGMT MAJORS STUDIED ABROADIB MAJORS Mean: 3.96 Mean: 3.92 Mean: 3.83 Mean: 3.78

 Possibilities discussed after Cycle #2:  Required global/international course for all BSBA students ▪ Choice from existing courses, OR ▪ Development of a common global course ▪ Some evidence suggests that MGMT majors, who currently take a required global course perform better.  Required International Dimension for all BSBA students (students choose from menu of international experience options)  Optional Global Certificate Program ▪ Consideration – Cycle #2 evidence did not suggest that studying abroad enhanced global perspective.

 Decision made to reassess the goal after one year before implementation of any major curricular changes.  Optional Global Certificate Program (GEP) moved forward in the college.  Associate Dean charted global competence in the CBA based on recommendations from the AACSB taskforce on global education.

Cycle #3

8.3% 40.8% 22.5% 28.3% “70% should meet or exceed expectations”; 49.1% actually did “30% should exceed expectations”; 8.3% actually did

ALL STUDENTS MGMT MAJORS STUDIED ABROAD IB Majors Mean: 4.30 Mean: 4.14 Mean: 4.28 Mean: 4.17

11.7% 48.3% 15.0% “70% should meet or exceed expectations”; 60% actually did “30% should exceed expectations”; 11.7% actually did 25.0%

11.7% 48.3% 15.0% “70% should meet or exceed expectations”; 51.7% actually did “30% should exceed expectations”; 11.7% actually did 25.0%

ALL STUDENTS MGMT MAJORS STUDIED ABROAD IB Majors Mean: 4.45 Mean: 4.36 Mean: 4.49 Mean: 4.31

SLO #1SLO #2 * SLO #2 dimensions combined to form single SLO measure for Cycle #3

Movement in a positive direction was noted between Cycle #2 & #3. This was particularly notable in moving students from approaching to meeting expectations, less so in moving students to exceeding expectations. A significant segment of students continue to fail to meet expectations.

Students required to take one global course (MGT majors) do not significantly outperform others. International Business majors do not outperform others but students who study abroad do perform slightly better.

 The AACSB taskforce on global education continues to be an important source of direction for our Global Perspective goal.  Plans to reassess again in one year to check for trends.  Proposal for the institution of a Global Perspective requirement across the college has been introduced at both the graduate and undergraduate level and is currently in the governance process.

Cycle #4

57.4% 25.3% 14.2% “70% should meet or exceed expectations”; 82.7% actually did “30% should exceed expectations”; 57.4% actually did

Results of assessment in Cycle #4 produced dramatically different results than the previous cycles. Which (if any) results were valid? The assessment process requires investigation. In Cycle #4 it was determined that SLO 4.1 was not accurately assessed by the measure. If this was also true in previous cycles, findings of Cycles #2 & #3 (at least for SLO 4.1) may not be valid. Alternatively, the 3 point scale used in Cycle #4 may be inadequate to fully assess nuances of difference between responses vis-à-vis expectations.

 A thorough review of the assessment process – measures, rubric, and rating process is imperative.  This will be undertaken by the CBA Undergraduate Committee during the academic year.  The proposed revisions to the BSBA program include the addition of a one-unit Global Perspective course.