1 GETTING STARTED WITH ASSESSMENT Barbara Pennipede Associate Director of Assessment Office of Planning, Assessment and Research Office of Planning, Assessment and Research March 2002

2 WORKSHOP TOPICS What is assessment? What is assessment? Why is assessment important to Pace University? Why is assessment important to Pace University? Why assessment in Administrative and Educational Support Units (AES) Why assessment in Administrative and Educational Support Units (AES) Steps in developing an assessment plan for your unit. Steps in developing an assessment plan for your unit.

3 What is assessment? ASSESS (V): TO EXAMINE CAREFULLY ASSESS (V): TO EXAMINE CAREFULLY “Assessment is the systematic collection, review and use of information about educational programs undertaken for the purpose of improving student learning and development.” ( Marchese 1987) “Assessment is the systematic collection, review and use of information about educational programs undertaken for the purpose of improving student learning and development.” ( Marchese 1987)

4 The Importance of Assessment to Pace University To improve the effects of teaching on student learning and development To improve the effects of teaching on student learning and development To examine and enhance institutional effectiveness To examine and enhance institutional effectiveness To advance the reputation and image of Pace through the quality of its programs To advance the reputation and image of Pace through the quality of its programs

5 The Importance of Assessment to Pace University To attract and retain qualified students To attract and retain qualified students To maintain and strengthen its standing among its competitors To maintain and strengthen its standing among its competitors To satisfy the requirements of accrediting agencies To satisfy the requirements of accrediting agencies

6 Statement by the Middle States Commission An accredited institution is characterized by: An accredited institution is characterized by: Linkage of outcomes assessment to the institution’s ongoing planning and resource allocation process and to strategic efforts to improve institutional quality. Linkage of outcomes assessment to the institution’s ongoing planning and resource allocation process and to strategic efforts to improve institutional quality.

7 Why Assessment in Administrative and Education Support Units? To know if we are offering the right services and how well we are providing them To know if we are offering the right services and how well we are providing them

8 Reasons Often Cited Effective linking of AES services to academic programs Effective linking of AES services to academic programs Accreditation requirements Accreditation requirements Continuous quality improvement Continuous quality improvement Institutional effectiveness Institutional effectiveness

9 Administrative and Education Support Units Administrative Provide services which maintain the institution Provide services which maintain the institution Are essential to its operations Are essential to its operations No direct impact on instructional programs No direct impact on instructional programs Educational Support May not be primarily instructional or academic Contributes directly to student learning or instruction

10 Underlying Assumptions for Assessment in AES The primary aim of assessment is the continuous improvement of campus operations, especially as they support and promote the University’s teaching and learning environment The primary aim of assessment is the continuous improvement of campus operations, especially as they support and promote the University’s teaching and learning environment Assessment is to be embedded as part of the normal order of business Assessment is to be embedded as part of the normal order of business Assessment will be a cyclic process and an ongoing unit or programmatic activity. Assessment will be a cyclic process and an ongoing unit or programmatic activity.

11 Steps for Assessment Process Establish a linkage to the University’s Mission and Goals Establish a linkage to the University’s Mission and Goals Prepare the Unit Mission Statement Prepare the Unit Mission Statement Formulate Measurable Objectives Formulate Measurable Objectives Identify Activities and Strategies to Achieve Objectives Identify Activities and Strategies to Achieve Objectives Identify Unit Means of Assessment and Criteria for Success Identify Unit Means of Assessment and Criteria for Success Conduct Assessment Activities Conduct Assessment Activities Document use of Results for Service Improvements Document use of Results for Service Improvements

12 The Pace University Mission Statement “In keeping with its motto, Opportunitas, Pace University offers qualified students the opportunity to discover and fulfill their potential. At Pace, supportive and challenging programs prepare graduates for meaningful lives and successful careers in a rapidly changing world. The University’s commitments combine respect for traditional academic values with readiness to meet the challenges of the future with energy and innovation.” “In keeping with its motto, Opportunitas, Pace University offers qualified students the opportunity to discover and fulfill their potential. At Pace, supportive and challenging programs prepare graduates for meaningful lives and successful careers in a rapidly changing world. The University’s commitments combine respect for traditional academic values with readiness to meet the challenges of the future with energy and innovation.”

13 Pace Mission Statement Core Values Giving highest priority to teaching and learning Giving highest priority to teaching and learning Placing the liberal arts and sciences at the center of undergraduate education Placing the liberal arts and sciences at the center of undergraduate education Stressing critical thinking, communication, and technological competence as essential skills Stressing critical thinking, communication, and technological competence as essential skills Fostering intellectual growth, ethical maturity, and civic responsibility Fostering intellectual growth, ethical maturity, and civic responsibility

14 Core Values continued… Balancing theory with practical applications Balancing theory with practical applications Responding to the individual needs of an increasingly diverse society and global economy Responding to the individual needs of an increasingly diverse society and global economy Preparing students for an increasingly diverse society and global economy Preparing students for an increasingly diverse society and global economy Emphasizing service as an integral part of teaching and life-long learning Emphasizing service as an integral part of teaching and life-long learning

15 Pace Mission Statement Commitments Access and opportunity for qualified students of diverse backgrounds Access and opportunity for qualified students of diverse backgrounds Maintaining collegiality and the free exchange of ideas Maintaining collegiality and the free exchange of ideas Engaging students actively in the learning process Engaging students actively in the learning process Involving students and faculty in decision- making Involving students and faculty in decision- making

16 Pace Mission Statement Commitments continued… Managing the University responsively, effectively, and with financial responsibility Managing the University responsively, effectively, and with financial responsibility Providing an excellent, affordable private education Providing an excellent, affordable private education Continuing experimentation in the use of new technologies to support more effective teaching and extend educational opportunities Continuing experimentation in the use of new technologies to support more effective teaching and extend educational opportunities

17 Pace Mission Statement “Our assets, values, and commitments enable us to further individual opportunities to learn, teach, and expand knowledge. Thus, Pace University continues to embody Opportunitas, renewing this theme for new generations to whom we offer an education focused on student achievement and the promotion of patterns of living and learning that will enlighten and endure.” “Our assets, values, and commitments enable us to further individual opportunities to learn, teach, and expand knowledge. Thus, Pace University continues to embody Opportunitas, renewing this theme for new generations to whom we offer an education focused on student achievement and the promotion of patterns of living and learning that will enlighten and endure.”

18 Characteristics of Unit Mission Statement Describes the purpose of the unit, services and clients Describes the purpose of the unit, services and clients Is brief in length Is brief in length Provides linkage to and support of University mission and goals Provides linkage to and support of University mission and goals Is understood and accepted by employees within the unit Is understood and accepted by employees within the unit

19 Examples of AES Mission Statements Career Center Career Center Library Library Accounting Office Accounting Office

20 Formulate AES Objectives Purpose of objectives: Purpose of objectives: * support the Unit’s mission statement * support the Unit’s mission statement * provide the linkage to the means of * provide the linkage to the means of assessment assessment

21 Types of AES Objectives Process Oriented Volume of unit activity EfficiencyCompliance Outcomes Oriented Effectiveness Attitudinal Oriented Satisfaction What unit intends to accomplish What clients are able to do after receiving AES services How satisfied are clients with AES services

22 Formulating Unit Administrative Objectives Administrative Objectives should be: Linked to the Unit Mission Statement Linked to the Unit Mission Statement Realistic Realistic Limited in number Limited in number Measurable Measurable

23 Choosing the Short List of Administrative Objectives Administrative Objectives initially chosen should be: Targeted on those areas that can be improved using currently available resources and personnel Targeted on those areas that can be improved using currently available resources and personnel Related to the services the unit provides Related to the services the unit provides Relatively easy to assess within one cycle Relatively easy to assess within one cycle Directly under the control of the AES unit Directly under the control of the AES unit

24 Identifying the Means of Assessment “When” will assessment activities take place? “When” will assessment activities take place? Where will we find information that will reflect accomplishment of our objective? Where will we find information that will reflect accomplishment of our objective? Exactly “How” will the assessment be accomplished? Exactly “How” will the assessment be accomplished? “How well” should the unit perform on the means of assessment identified, if the unit is functioning the way it should? “How well” should the unit perform on the means of assessment identified, if the unit is functioning the way it should?

25 Common Assessment Activities Client satisfaction measures Client satisfaction measures Direct counts Direct counts Results of external evaluation Results of external evaluation Outcome measures Outcome measures

26 Unit Criteria of Success Identify a reasonable level of service improvement to expect given the resources and personnel of the unit Identify a reasonable level of service improvement to expect given the resources and personnel of the unit Set performance levels as reference points or benchmarks Set performance levels as reference points or benchmarks Select a percentage of improvement for its services Select a percentage of improvement for its services Use peer institutions who provide the same service to help identify Use peer institutions who provide the same service to help identify

27 Use of Results for Service Improvement Changes in organizational structure Changes in organizational structure Changes in process procedures Changes in process procedures Relations with the constituencies Relations with the constituencies Changes in assessment procedures Changes in assessment procedures Changes to comply with regulatory requirements Changes to comply with regulatory requirements Internal resource reallocation Internal resource reallocation Justification for additional resources Justification for additional resources