Presentation on theme: "Assessing Experiential Learning"— Presentation transcript:
1 Assessing Experiential Learning Are students learning what we want them to learn?
2 What have you learned from experience? ExamplesDevelopmental Psychology students and the “older” generationPie making with Grandma LucyMy student teacher and her Christmas Vacation sagaWhat do these have in common?They were direct encounters with the “phenomena being studied rather than merely thinking or only considering the possibility of doing something about it.”They resulted in an education that occurred as a result of direct participation in the events of life—learn by doing!What was learned?
3 Successful Assessment of Experiential Learning involves Defining terminologySequencing experiences and Designing opportunities and assessmentsAssessingWhat I’ve learned from culture building…
4 A “Culture” of Experiential Learning? LanguageHow do you define Experiential Learning in your department/program?Symbols and PracticeWhat are your program’s practices with regard to experiential learning?StoriesWhat experiential learning experiences have you used thus far OR what successes have been used at ISU thus far and how can we learn from them?
5 What is Assessment exactly? Assessment is the ongoing process of:Establishing clear, measurable expected outcomes of student learning.Ensuring that students have sufficient opportunities to achieve those outcomes.Systematically gathering, analyzing, and interpreting evidence to determine how well student learning matches our expectations.Using the resulting information to understand and improve student learning.How do you know that experiential learning is meeting the needs of your program?
6 The Assessment Process Establish Learning OutcomesProvide Opportunities for Learning (Map outcomes to the curriculum)Assess Student LearningUse the Results
7 Be honest about why you are doing assessment ComplianceCommitmentExternal QuestionsInternal QuestionsNumber & AmountQuality & UtilityReportingInterpretingCollecting itUsing itAccreditationLearningBecause we have toBecause we want to improve
8 Other key definitions needed Community EngagementExperiential LearningOthers?
9 What is Community Engagement? ISU defines Community Engagement as: the development of collaborative partnerships between education, business, social services, and government that contribute to the academic mission of the University and directly benefit the community. Community engagement includes activities in teaching, research, and service endeavors of faculty, students, and staff.
10 Community Engagement Examples Technical assistance and applied research to help increase understanding of a local or regional problem or test solutions for that problem.Lectures, seminars, and other public forum that provides a neutral place to explore community issues.Extension of learning beyond the University walls and into the community.Enriching the cultural life of the community.Service, including internships and service-learning, that directly benefits the public.Economic development initiatives, including technology transfer and support for small businesses.Involvement of community members in planning and decision making activities of the University.
11 Experiential Learning Definition ISU Defines Experiential Learning as, “Engaging students in learning through sequential exposure to challenging, compelling, and enriching activities conducted in appropriate settings. It integrates development of knowledge, skills, and dispositions, and fosters application of methods of critical inquiry. It engages students in personal reflection in order to organize, interpret, and bring meaning and coherence to their learning experience.”
12 ISU Strategic Goal for Experiential Learning Advance experiential learning to where all ISU student shave a significant experiential learning experience within their major.Initiatives to achieve Goal 2Infuse experiential learning as a core component in all academic programsApply the science of learning to the learning of scienceCoordinate and elevate leadership studies
13 ISU Experiential Learning (from ISU Goal 2) Current curricular and co-curricular offerings that can be categorized as experiential learning:Programs associated with the First-Year ExperienceInternships, practica, field experiencesCollaborative student-faculty researchA collaborative ISU student-faculty-staff service projectOrganized service-learning project, including reflection on knowledge gainedAn ISU business venture involving studentsLast-year capstone experiencesAn ISU fund-raising venture involving studentsWork experience opportunities for students in offices, labs, libraries, residence halls, etc.
14 Other sources of Experiential Learning information What do your professional organizations suggest?NCATEAACSBACCENASADAmerican Historical AssociationAAC&UAmerican Dietetic AssociationThe American Society for Cell BiologyOthers?
15 American Council for Construction Education (ACCE) 3.3.2Program Learning OutcomesThe development of professional skills and knowledge is a central requirement of an ACCE accredited master’s degree program. ACCE requires that all graduates of accredited master’s degree programs be able to demonstrate mastery of the following:Critical thinking and creativityProblem solving and decision makingEffective and professional oral and written communicationsUse of information and communication technologyPrinciples of leadership in business and managementCurrent issues in constructionComplex project decision making and associated risk managementProfessional ethics including application to situations and choicesAdvanced construction management practicesResearch methods
16 American Council for Construction Education (ACCE) For each category, programs seeking accreditation by ACCE must1. Define program learning outcomes for each category.2. Cross reference each program learning outcome to relevant course objectives and/or other evidence.3.Describe how each program learning outcome is assessed.Standards and Criteria for Accreditation of Master’s Degree Construction Education Programs, Document 103MD
17 National Association of Schools of Art and Design NASAD Standards/Handbook Competencies SummaryItem 3. (Ceramics) Essential Competencies, Experiences, and Opportunities (H.IX.A.3.)Understanding of basic design principles, particularly as related to ceramics. Advanced work in three-dimensional design. The development of solutions to design problems should continue throughout the degree program.Knowledge and skills in the use of basic tools, techniques, and processes sufficient to produce work from concept to finished object. This includes knowledge of raw materials and technical procedures such as clays, glazes, and firing.Understanding of the industrial applications of ceramics techniques.Understanding of the place of ceramics within the history of art, design, and culture.Functional knowledge of basic business practices.Preparation of clay bodies and glazes, kiln stacking procedures, and firing processes. Special firing methods such as salt glaze and raku are recommended.Easy and regular access to materials, equipment, and library resources related to the study of ceramics.Completion of a final project related to the exhibition of original work.
18 Blending Expectations How do Community Engagement and Experiential Learning come together in my discipline?What makes Experiential Learning, Experiential at ISU?Integrates development of knowledge, skills, & dispositionsFosters application of methods of critical inquiryEngage in reflection for organization, interpretation, and meaningHow do I operationalize/define these definitions in my program?
19 Writing Learning Outcomes Students should be able to <<action verb>> <<something>>Students will <<action verb>> <<something>>Students will be able to <<action verb>> <<something>>Examples:Ceramics students will evaluate works of art and design.Beginning Construction Management students should be able to frame a wall that adheres to local building codes.Nursing students should be able to handle hazardous and infections materials appropriately.
20 Outcomes in Experiential Learning InstitutionalProgramCourse
21 Outcomes in Experiential Learning Institutional LevelProvide technical assistance and applied research to help increase understanding of a local or regional problem or test solutions for that problem.Program LevelConduct collaborative research in the ecosystems in the local watershed to benefit the community and region.Course LevelAssist community members in planting gardens to attract bees to the area.
22 What do you want students to get out of Experiential Learning in your program? How can my English Majors apply what they have learned in an experiential learning opportunity?What can Political Science graduates do when they complete the program?How can students in your program use their skills to improve the community?Examples:Habitat for Humanity buildCosmetology program partiesCandy company going greenTax preparation
23 Action Verbs Lower level outcomes (typically at the course level) KnowledgeComprehensionApplicationCiteAssociateApplyCountClassifyCalculateDefineCompareDrawDifferentiateDramatizeIdentifyExplainIllustrateListPredictInterpretNameReportRestructureQuoteRestateSolveReciteReviewSketchStateTranslateWrite
24 Action VerbsHigher Level Outcomes (more often upper level courses or program outcomes)AnalysisSynthesisEvaluationAnalyzeAssembleAppraiseCategorizeComposeAssessCompare/ContrastCreateEvaluateDebateDesignGradeDistinguishFormulateJudgeExperimentPrescribeRankSeparateProposeScoreSummarizeSynthesizeValidate
25 Experiential Learning: Defining Outcomes at the Program Level Teacher Education Candidates will be able to modify lessons to relate instruction to students’ lives.MIS Students will design a data management system for a small business.Environmental Studies students will conduct research on commuting patterns of UWEC faculty and staff.At the direction of the City Council, Economics students will collect data on gas prices in Eau Claire during summer 2012.Social Work students will teach local seniors how to use and Facebook.
26 Write some outcomes Who are the intended students? What do you want them to learn?Write an outcome. Remember the format:Students will <<action verb>> <<something>>
27 Sequencing Experiential Learning Introductory ExperienceStudents learn the basics of the discipline in practice.Context ExperiencesStudents engage in a variety of experiences related to advanced contexts of the discipline.Culminating ExperienceStudents synthesize what has been learned in the previous experiences and put this learning into mentored practice.
28 What are you already doing in…? Teacher EducationSpeech-Language PathologyConstruction ManagementAthletic TrainingMusic PerformanceNursingTelevisionSocial WorkRadioCreative WritingTheaterFlightMISPilotCommunication DisordersOthers?
29 Where will the Experiential Learning Happen? Design opportunities for students to learn what you want them to learnInternshipsCase studiesStudent TeachingApprenticeshipsOthers?Make a list.
30 At what level will the experience be designed? Beginning/IntroductoryIntermediate/ContextCulminating/Capstone
31 Assessments neededOnce the Experiential Learning experience (curriculum) has been designed and aligned to the outcomes, how will you assess it?Examples (linked to outcomes)ObservationsPortfoliosProjectsOthers?
32 What are the givens? What are the expectations? Do you expect your students to dress properly?Do you expect your students to show up on time?Are these the intended learning outcomes?What are the “dispositions” you want students to learn?
33 Conduct an Assessment Inventory Have we established learning outcomes for experiential learning in our program?Have we provided opportunities for students to engage in learning through sequential exposure to challenging, compelling, and enriching activities in appropriate settings?What assessment data do we already have?How have we used the assessment results we currently possess?
34 Experiential Learning Challenges and Solutions RankPossible SolutionsLack of Faculty buy-inDifficult to assessDoesn’t fit my programUnsure of how to design an experiential learning sequenceIt’s a lot of workLack of resourcesOther (specify)
35 What has worked?List Experiential Learning examples you know of that have worked at ISU or elsewhere in the past?How can you adapt those examples to fit your discipline?What professional development would help you personally integrate Experiential Learning into your program/courses?
36 Assessing the Experiential Learning Experience AAC&U rubric exampleRubric DesignWhat are the measurable elements of the Experiential Learning Experience?
37 Getting Started Be willing to take risks Realize some things will not always be fully successfulStart smallAvoid rewards and threatsDevelop a solid foundation that can sustain a program over the long haul, realizing change happens
38 Ready, Set, GO!Develop learning outcomes for Experiential Learning in your programDesign opportunities for students to demonstrate the intended learning outcomesAssess the intended learning that occurs in these opportunitiesUse the results to improve the learning opportunitiesDo it again
39 Points to PonderLike other outcomes, make sure that the Experiential Learning outcomes for your program make sense to the learners.Be creative.Don’t feel the need to reinvent the wheel. Capitalize on what has already been done and make it your own.Celebrate the little victories—remember it’s about learning.Thank you!
40 Resources Consulted AACU.org Allen, M.J. (2004). Assessing academic programs in higher education. Bolton, MA: Anker.Banta, T.W., Jones, E.A. & Black, K.E. (2009). Designing effective assessment: Principles and profiles of good practice. San Francisco: Jossey-Bass.Banta, T.W. (2002). Building a scholarship of assessment. San Francisco: Jossey-Bass.Maurrasse, D.J. (2002). Higher education-community partnerships: Assessing progress in the field. Nonprofit and Voluntary Sector Quarterly, 31,Suskie, L. (2009). Assessing student learning: A common sense guide, 2nd ed. San Francisco: Jossey-Bass.