Assessment Overview Drake CPHS 2011

Overview Scholarship highlights of College Status of Annual Surveys Overview of IDEA Data Assessing college-wide teaching goal Curricular Review uses

CY 2010 Scholarship Peer Reviewed – 19 articles – 11 podiums – 23 posters – 13 non-peer-reviewed articles/columns 47 Invited Podiums 15 Invited Posters $427,000+ in new grant funding Students cited 42 times on abstracts or publications

2011 Annual Surveys This year, all 4 surveys were conducted. Results have been tallied, compared to the national average and our previous results – Alumni Results forwarded to CAC for review – May 2011 Graduate results forwarded to SAC for review – Preceptor results forwarded to Experiential Review Committee – Faculty results forwarded to FAC – Each committee will be reviewing results during the year and suggesting actions (which may include no action at this time)

Survey highlights P4 survey; improved on 8% of questions; declined on 39%. Faculty survey; improved on 34% of questions; declined on 23%. Preceptor survey; improved on 19% of questions; declined on 29%. Alumni survey; improved on 10% of questions; declined on 29%. Across all four (205 questions), our college was at or above the national average on 79% of the questions.

2011 PharmD Graduates A REAS OF I MPROVEMENT : – Pharmacy-related elective courses met my needs as a Pharm.D. student. Improved to 83.4% – My introductory pharmacy practice experiences were valuable in helping me to prepare for my advanced pharmacy practice experiences. Improved to 77.7% – My introductory pharmacy practice experiences permitted my involvement in direct patient care responsibilities in both community and institutional settings. Improved to 83.4% – The process by which I was assigned sites for advanced pharmacy practice experiences was fair. Improved to 98.6% – Career planning and guidance met my needs. Improved to 63.9% – The college/school of pharmacy had a student government that effectively communicated student opinions and perspectives to the faculty or administration. Improved to 77.8%

2011 PharmD Graduates A REAS OF D ECLINE OR B ELOW N ATIONAL A VERAGE : The PharmD program prepared me to interpret economic data relevant to treatment of disease. Dropped to 65.3% and also below national average of 80.6% The PharmD program prepared me to interpret and apply drug use policy and health policy. Dropped to 80.6% and also below national average of 90% The PharmD program prepared me to promote wellness and disease prevention services. Dropped to 91.7% and also below national average of 97% The PharmD program prepared me to accept and respond to constructive feedback. Dropped to 91.7% I developed the skills needed to prepare me for continued learning after graduation. Dropped to 94.5% The sites available for introductory pharmacy practice experiences were of high quality. Below the national average of 79.8% The process by which I was assigned sites for introductory pharmacy practice experiences was fair. Dropped to 79.1% and also below national average of 83.6% In the ambulatory care setting, I was able to apply my patient care skills. Dropped to 92.4% I was academically prepared to enter my advanced pharmacy practice experiences. Dropped to 90.3% Academic advising met my needs. Below the national average of 69.3% Tutoring services met my needs. Dropped to 19.5% and also below national average of 39.5%

2011 PharmD Graduates A REAS OF D ECLINE OR B ELOW N ATIONAL A VERAGE : Financial aid advising met my needs. Dropped to 51.4% and also below national average of 64.6% Student health and wellness services (e.g. immunizations, counseling, primary care clinics, etc.) met my needs. Dropped to 77.8% Information was made available to me about additional educational opportunities (e.g., residencies, fellowships, graduate school). Dropped to 87.5% The college/school's administration responded to problems and issues of concern to the student body. Dropped to 82% I was aware of the process for raising issues with the college/school administration. Dropped to 69.5% and also below national average of 80.9% The college/school of pharmacy is welcoming to students with diverse backgrounds. Below the national average of 94.7% The admissions process of the college/school of pharmacy was well organized. Dropped to 86.2% and also below national average of 91% The college/school of pharmacy had a student government that effectively communicated student opinions and perspectives to the faculty or administration. Below the national average of 83.6% I was aware of expected behaviors with respect to professional and academic conduct. Dropped to 92.2% and also below national average of 98.4%

2011 PharmD Graduates A REAS OF D ECLINE OR B ELOW N ATIONAL A VERAGE : The college/school of pharmacy effectively managed academic misconduct by students. Dropped to 63.9% and also below national average of 71.2% The college/school of pharmacy effectively managed professional misconduct by students. Dropped to 52.8% and also below national average of 71.4% I was aware of opportunities to participate in research activities with faculty. Below the national average of 75.2% The classrooms in the college/school of pharmacy or elsewhere on campus were conducive to learning. Dropped to 72.2% and also below national average of 91.8% The study areas in the college/school of pharmacy or elsewhere on campus were conducive to learning. Dropped to 84.7% The common spaces such as lounges, lobbies or other areas for relaxation and socialization available in the college/school of pharmacy or elsewhere on campus met my needs. Dropped to 84.7% I am prepared to enter pharmacy practice. Dropped to 91.7% If I were starting my college career over again I would choose to study pharmacy. Dropped to 80.6% and also below national average of 84.7% If I were starting my pharmacy program over again I would choose the same college/school of pharmacy. Dropped to 75% and also below national average of 83.9% I would recommend a career in pharmacy to a friend or relative. Dropped to 82%

2011 Faculty Survey A REAS OF I MPROVEMENT : The college/school's administrators function as a unified team. Improved to 96.9% The college/school's administrator(s) are aware of my needs/problems. Improved to 87.8% The college/school's administrator(s) are responsive to my needs/problems. Improved to 84.8% I have access to documents that detail policies related to my performance as a faculty member. Improved to 93.9% My performance assessment criteria are explicit and clear. Improved to 81.8% My allocation of effort has been clearly stated. Improved to 75.7% Criteria for my performance assessment are consistent with my responsibilities. Improved to 81.8% I receive formal feedback on my performance on a regular basis. Improved to 87.9% The performance feedback I receive is effective. Improved to 87.9% I receive adequate support staff resources. Improved to 81.8% I have adequate laboratory and/or clinical space for my research and/or scholarship needs. Improved to 75.8% The college/school has appropriate physical facilities to allow me to fulfill my responsibilities. Improved to 90.9%

2011 Faculty Survey Areas of Improvement: The college/school has a sufficient number of qualified faculty. Improved to 72.8% The program's resources can accommodate present student enrollment. Improved to 81.8% The physical facilities enable out-of-class interaction among administration, faculty, and students. Improved to 60.7% I receive adequate guidance on career development. Improved to 84.9% Funds are available to support my faculty development. Improved to 100% Laboratories and other non-classroom environments are conducive to learning. Improved to 90.9% The PharmD Program prepares students to…Develop disease management programs. Improved to 81.8% The college/school effectively manages academic misconduct by students (e.g., plagiarism). Improved to 81.8% The college/school effectively manages poor academic performance of students. Improved to 97.9% In my opinion, the proportion of my time spent on research is appropriate. Improved to 100%

2011 Faculty Survey A REAS OF D ECLINE OR B ELOW N ATIONAL A VERAGE : Faculty meetings function effectively as part of the governance of the college/school. Dropped to 60.6% and also below the national average of 77.3% I have adequate office space. Below the national average of 90.3% I have adequate laboratory and/or clinical resources for my research and/or scholarship needs. Dropped to 54.6% and below the national average of 68% The physical facilities enable out-of-class interaction among administration, faculty, and students. Below the national average of 74.4% Programs are available for non-practice faculty to orient them to the pharmacy profession and professional education. Below the national average of 40.5% Programs are available to me that help me develop my competence in research and/or scholarship. Dropped to 63.7% and below the national average of 67.5% Curricular collaboration among disciplines is encouraged at my college/school. Dropped to 84.8%

2011 Faculty Survey Areas of Decline or Below National Average: The PharmD Program prepares students to…Develop and use patient-specific pharmacy care plans. Dropped to 78.8% and below the national average of 85.6% The PharmD Program prepares students to Manage the system of medication use. Dropped to 81.8% The PharmD Program prepares students to Evaluate the health sciences literature. Dropped to 87.9% The PharmD Program prepares students to Demonstrate expertise in the area of informatics (resources, devices, and methods required to optimize the acquisition, storage, retrieval, and use of information in pharmacy and healthcare). Dropped to 75.8% The PharmD Program prepares students to Apply state and federal laws and regulations to the practice of pharmacy. Dropped to 87.9% The PharmD Program prepares students to Maintain professional competence. Dropped to 91% In my opinion, the proportion of my time spent on service is appropriate. Dropped to 51.6% and below the national average of 76.4% In my opinion, the proportion of my time spent on clinical service is appropriate. Dropped to 39.4% and below the national average of 51.2%

2011 Alumni Survey A REAS OF I MPROVEMENT : The college/school communicates effectively with alumni about college/school activities. Improved to 89.4% The college/school provided an adequate number and mix of practice facilities for experiential education (rotations). Improved to 98.4% The PharmD Program prepared me to apply state and federal laws and regulations to the practice of pharmacy. Improved to 98.5%

2011 Alumni Survey Areas of Decline or Below National Average: The current Dean is providing leadership in pharmacy. Dropped to 59.1% and below the national average of 68.2% The current Dean encourages alumni to stay involved. Dropped to 57.6% and below the national average of 64.4% Since graduation, the college/school has solicited my input/feedback for programmatic improvement. Dropped to 45.5% and below the national average of 58.1% The curriculum was properly sequenced. Dropped to 75.7% and below the national average of 87.5% If I were starting my education over today, I would choose pharmacy as a career. Dropped 78.8% and below the national average of 84.8% The PharmD Program prepared me to develop disease management programs. Dropped to 72.7% and below the national average of 86.4% The PharmD Program prepared me to promote the availability of health promotion and disease prevention initiatives. Dropped to 81.8% and below the national average of 92.5% The PharmD Program prepared me to search the health sciences literature. Below the national average of 95.9% The PharmD Program prepared me to demonstrate expertise in the area of informatics (resources, devices, and methods required to optimize the acquisition, storage, retrieval, and use of information in pharmacy and healthcare). Dropped to 74.2% and below the national average of 82.4%

2011 Preceptor Survey A REAS OF I MPROVEMENT : The responsibilities as a preceptor have been defined at my site. Improved to 96.7% I use feedback about my site to make improvements to my student practice experience. Improved to 94.1% I am aware of the mechanism to provide feedback to the college/school regarding the Pharm.D. curriculum. Improved to 71.9% I have ongoing contact with the Office of Experiential Education. Improved to 81% I receive needed support from the Office of Experiential Education. Improved to 87.5% The college/school has an effective continuing professional development program for me that is consistent with my preceptor responsibilities. Improved to 82.3%

2011 Preceptor Survey Areas of Decline or Below National Average: I receive the results from student evaluations of my rotation. Dropped to 70.6% I know how to utilize the process that exists within the college/school to effectively manage academic misconduct (e.g., plagiarism) by students. Below the national average of 78.5% I know how to utilize the process that exists within the college/school to effectively manage professional misconduct (e.g., plagiarism) by students. Below the national average of 83.1% I know how to utilize policies of the college/school that deal with harassment and discrimination. Below the national average of 77% I am aware of the mechanism to provide feedback to the college/school regarding the Pharm.D. curriculum. Below the national average of 77.1% The PharmD program prepares students to develop disease management programs. Below the national average of 82.9% The PharmD program prepares students to manage the system of medication use. Below the national average of 88.2% The PharmD program prepares students to promote the availability of health promotion and disease prevention initiatives. Dropped to 79.1% and also below the national average of 87.2%. The PharmD program prepares students to demonstrate expertise in the area of informatics (resources, devices, and methods required to optimize the acquisition, storage, retrieval, and use of information in pharmacy and healthcare). Dropped to 81% and also below the national average of 87.3%.

I. Teaching Goal Great Universities measure what they value (anonymous) The IDEA results are one piece of teaching review Goal: 80 percent of our classes similar to, higher than, or much higher than the national benchmark for ‘progress on relevant objectives’

Progress on Relevant Objectives vs. IDEA National Database Converted Scores Much Higher (10% of courses) 5.5%1.6%1.4%1.1% Higher (20% of courses) 34.2%26.6%18.3%24.2% Similar (40% of courses) 42.5%43.8%57.8%50.6% Lower (20% of courses) 12.3%15.6%15.5%15.4% Much Lower (10% of courses) 5.5%12.5%7.0%8.8% Goal Progress 82.2% ✓ 72%77.5%75.9%

Actions What actions have been taken? – Faculty Development & meetings on: Soul searching on what I’m trying to achieve How to choose objectives (right ones, right number) Should our teaching methods be adjusted? Linking course content and methods to the objective More use of IDEA resources (POD notes, etc.) Tie results to faculty annual goals Initiate FIF’s early in semester Good discussions and culture of assessment have taken place!

Primary Instructional Approach (10-11)

Instructor Related Course Requirements (Some or Much required)

Percent of CPHS classes selecting objective as either Essential or Important (FIF)

1=no progress 2=slight progress 3=moderate progress 4=substantial progress 5=exceptional progress Student ratings of progress on objectives chosen as Essential or Important

AY AY AY AY Average% of classes below 3.0 % of classes 4.0 or above Amount of Reading CPHS % 41% 46% 42% 8% 16% 22% 23% IDEA3.233%15% Amount of work in other (non-reading) assignments CPHS % 32% 39% 28% 20% 8% 13% IDEA3.421%18% Difficulty of subject matter CPHS % 33% 35% 29% 33% 31% 26% 28% IDEA3.420%18% Values are similar if within 0.3 1=Much less than most courses, 2=less than most, 3=about average, 4=more than most, 5=much more Amount and Difficulty of Course work: Student Ratings

2011 Faculty trends towards using more on-line evaluations Average combined response rate was 78% Average Class size was 79 Average number of objectives by faculty decreased to 3.6 (from 4.1 in previous years)

Future/ongoing areas Identifying embedded assessments Re-evaluate our educational outcomes? Populate new AAMS system (AACP’s Assessment and Accreditation Management System) Re-write (condense) our Assessment Plan HSCI Program Review PharmD Accreditation ( )

Questions/Discussion Are these results indicative of where we want our curriculum and teaching to be?