1. A Comprehensive Process Linking Accreditation and Long-term Assessment Efforts Bill Neal Helena Hannonen Johnson Mak Paul Freebairn 2009 AIR Forum, Atlanta, GA June 2, 2009

2. Brigham Young University–Hawaii Small, 4-year comprehensive university About 2400 students Highly international campus Programs in art, business, computing, education and science Located near Oahus north shore

3. Our presentation today… 1.Nuts and Bolts of BYUHs Assessment Process 2.Department Portfolio (a work in progress) 3.Impact of Assessment at the Department Level 4.Linking Assessment to Accreditation 5.Sharing Best Practices 6.Summary and Q&A

4. Institutional Change is Challenging Click on the box below to view movie.

5. PART 1 BYUHs Assessment Process

6. 1996 Accreditation & 2000 Interim Report Realignment – Director of University Assessment & Testing (Fall 2000) Search for an assessment model Nichols visit to campus (March 2001) University Assessment Committee (UAC) – Organized in June 2001 Now in our eighth assessment cycle Campus-wide assessment begins (Continuous Process)

7. Searched for simplified processes and documents Developed an online website and portfolio system to showcase results Accreditation Documents & Processes

8. Assessment Model Criteria Short Simple Mission-driven Results focused Leads to continuous improvement (on-going) Used for academic and administrative units

9. BYUH Annual Assessment Plan (Template)

10. Faculty/Staff Engagement Nichols workshops training (2001) Meetings with key faculty & admin. Leaders Accreditation (faculty survey, focus groups & writing team) Assessment Website – Assessment Guidebook – Other online resources Mary Allen workshops (2005) Assessment/accreditation Conferences & Workshops Best Practices (awards, luncheon & posters) Assessment Budget

11. BYUH Multi-year Assessment Plan (Template)

12. University Assessment Committee 12 members (including 4-6 faculty) Advisory capacity (our strength) Each member helps 3-4 other departments Simplified assessment plan template Sharing the rubric in advance (what to expect) Accountability – annual report – 30-minute presentation – What did you learn? What actions did you take? January to March (2-3 review teams)

13. Developing & Using a Rubric A way to formalize feedback to departments Last years results Next years outcomes & means of assessment Linked to the multi-year assessment plan

14. Developing & Using a Rubric

15. PART 2 Assessment Website and Online Department Portfolios

16. Portfolio Development Internship (Web programmer) Input from departments Depository for key elements Tied to Faculty Portfolio system Access to key documents Display for accreditation

17. Key Portfolio Elements Assessment Plan Multi-year Assessment Plan Assessment Rubric Outcomes and MatrixCourse Alignment Self-study/Department Review Syllabi (course alignment) Sample Student Work/Displays Reflection and Usage of Data Faculty Profile

27. PART 3 Impact of Assessment (at the Department Level) BUSINESS MANAGEMENT

28. Develop principled and innovative business leaders for Asia, the Pacific and beyond.

29. Number of students: 518 from 48 countries – BUSM 362 (246 in January 2008) – HMT 156 Number of full-time faculty: – BUSM 8 – HTM 3 Majors in Bachelors degree: – International Business Management – Hospitality and Tourism – Business Management Developed A.S. in Business Management in 2008-09

32. 1. Demonstrate a knowledge of fundamental areas of business 2. Have a knowledge of international business fundamentals 3. Have a knowledge of inter-cultural understanding basics 4. Demonstrate commitment of ethical behavior 5. Be able to solve problems 6. Work effectively in teams 7. Communicate effectively 8. Demonstrate commitment to service-mindedness 9. Demonstrate the ability to lead 10. Be able to prepare a business plan.

33. Multi-year plans cover 8-10 years – Quick matrix which summarizes outcomes and means of assessment Annual plans focus on 2-3 outcomes – Detailed matrix which covers outcome, means of assessment, findings and actions Outcomes are rotated every year – Report results and findings – Plan for the upcoming year

34. Reinstituted the national Major Field Test in 2008 (administered in capstone course) Added a management course to IBM major in January 2008 Discontinued Integrated Business Core in December 2008 (refocused teaching on business fundamentals)

37. Improve legal, quantitative, finance, and information systems categories Monitor testing process in HTM and BUSM – All students need to take MFT seriously – Study differences in scores among students from different geographic areas Reward students for excellence – Deans Award of Excellence

40. Provided training for faculty, teaching assistants, and students Used Bb as a teaching and faculty development tool Results: – 97% of students use Blackboard – 100% of IBM faculty use Blackboard – Courses are offered in F2F, hybrid, and online formats

41. Sample of Student Work

42. Goal: Assessment is a way of life, not a program – Assessment is on every department agenda. – Faculty members attend assessment conference and share lessons learned with others. – Add assessment to lesson plans Syllabi, rubrics, reflection – Share assessment tools and tips formally and informally. Blackboard site for sharing, e-portfolio for administration and learning

43. Easy to access, review and revise Quick search of other departments assessment information Provides transparency of the process and results Prepares for self-study/program review Reduces stress

44. PART 4 Linking Assessment to Accreditation

45. Web Resources Online Department Portfolios Assessment website Accreditation website Institutional Research website

46. Web Resources Online Department Portfolios Assessment website – Academic and administrative departments – Empowers departments – Training tools and document templates – Encourages sharing of best practices – Provides a user-friendly process (easy at all levels to administer, change or update) – http://www.byuh.edu/pirat/Assessment/ http://www.byuh.edu/pirat/Assessment/ Accreditation website Institutional Research website

48. Web Resources Online Department Portfolios Assessment website Accreditation website – Emphasizes accountability (both internal & external) – Documents processes and engagement – Encourages campus dialog – Supports WASC standards – Highlights themes and reports – http://www.byuh.edu/pirat/Accreditation/ http://www.byuh.edu/pirat/Accreditation/ Institutional Research website

54. Web Resources Online Department Portfolios Assessment website Accreditation website Institutional Research website – Data exhibits – Campus surveys – Defines key performance indicators – Comparison schools – http://www.byuh.edu/pirat/Institutional_Research/ http://www.byuh.edu/pirat/Institutional_Research/

56. PART 5 Sharing Best Practices

63. PART 6 Summary and Q&A

64. Support for Departments Working individually with each department Being accountable (return and report) Providing financial/budgetary support Participating in conferences, workshops and training Linking accreditation and program reviews Sharing best practices (online & awards)

65. Assessment Score Card (How are we doing at BYUH?) Completion rates of about – 65% Academic units – 64% Administrative units Unofficial commendation on our assessment process (WASC visiting team) Challenge of major campus restructuring and faculty load A VERY LONG JOURNEY – (a process, not an event) Still much to do! Our program is growing …evolving …

66. Whats helped us? Process that is conceptually sound Engaged faculty Commitment to improvement (at all levels) Support from key academic and administrative leaders Financial support (institution and department level budgets) Effective organizational structure (i.e. University Assessment Committee) Very Important: A great web programmer

67. Future Directions Sustainable processes Continuous improvement Archiving and effective documentation Preparation for 2012? (when we begin our next formal cycle and have a special visit) Further ease of online data entry (assessment plans and rubrics)

68. Q & A

69. Need any help? Bill Neal nealw@byuh.edunealw@byuh.edu Helena Hannonen hhannone@byuh.eduhhannone@byuh.edu Johnson Mak jmak@byuh.edujmak@byuh.edu Paul Freebairn freebaip@byuh.edufreebaip@byuh.edu