Effects of Reflective ePortfolio on Students Overseas Exchange Learning Experience + Kwok Chi Wai, Ron; Cheung Hok Ling, Hokling; Chen Yingjun, Josephine; Lau Tania, Yuenkei; Bandyopadhyay Rupa; Wong Man Chun, Anthony City University of Hong Kong
Table of Content Curriculum Design Reflective ePortfolio Research Model Examples of ePortfolio for Exchange Measurements Current Status Limitations Potential Implications
Curriculum Design Exchange Experience Assessment I (IS4935a) Exchange Experience Assessment II (IS4935b) Enable students to bridge their study overseas on the exchange programme with their learning experience in Hong Kong. It will challenge them in terms of what they have learned or not learned overseas, and how they learned it. Students should emerge from this short course with a heightened sense of appreciation for cultural differences, and the impact that these differences can have on interpersonal work relations, as well as intercultural relations at the organisational level.
Course Intended Learning Outcomes Describe the role of communication in culture and overcome communication barriers Recognize cultural variables and explain how they shape our social and work interactions Identify and critically evaluate communication norms, rituals, and taboos of students’ cultures and other cultures they have been exposed to during their study programme Develop successful strategies to overcome cultural barriers and demonstrate their usefulness Compare and contrast the use of IT in universities /organizations in Hong Kong with the counterparts overseas
The Use of Reflective ePortfolio In the course, students were required to document their exchange experiences with the use of the reflective ePortfolio Training on reflection & Technical training on ePortfolio were provided Design & provision of ePortfolio template http://sites.google.com/site/mylearningportf oliotemplate/
ProfileSummaryShowcasePerformance Monthly exchange experience Google Sites Student’s ePortfolio Teacher’s interactions Self-Assessment form Instructors Assessment Grade Online Peers review & comments Gather self-assessment on CILOs from students View students’ ePortfolios in Google Sites Student Instructor
ProfileSummaryShowcasePerformance Monthly exchange experience Wiki in Blackboard Student’s ePortfolio Teacher’s interactions Self-Assessment form Instructors Assessment Grade Offline Peers review & comments Gather self-assessment on CILOs from students View students’ ePortfolios in Google Sites Student Instructor Wiki Blackboard Test
Elements of Reflective ePortfolio Metaphors to aid reflection 1.Use the mirror to prompt reflection about yourself 2.Go deeper and analyse the details of an event, task or experience 3.What choices lie ahead? 4.Consider alternatives 5.Consider how you can best evidence your claims? 6.Look for connections and relationships Cheung & Dean 2009
Research Model: The Impact of Reflective ePortfolio on Students’ Overseas Exchange Learning Experience Individual Engagement Collaborative Engagement Satisfaction with the Exchange Experience Satisfaction with the Reflective ePortfolio Perceived Achievement of Learning Preparation for Future Exchange Engagement (Usage) Outcomes + + + + Actual Achievement of Learning +
Independent Variable: Reflective ePortfolio Engagement (Usage) Individual Engagement –Actual usage of the Reflective ePortfolio on: Constructing profile Goals setting and planning Identifying learning outcomes and requirements Recording achievements and experiences Selecting and use of evidences Reflecting on learning experiences Collaborative Engagement –Actual usage of the Reflective ePortfolio on: Receiving and Giving feedbacks Providing and Obtaining support Introduce friends Met in exchange studies
Outcomes Satisfaction with the Exchange Experience –Overall satisfaction level of students on their last exchange experience Preparation for Future Exchange –Perceptions of students on how Reflective ePortfolio could help them better plan and prepare for future overseas exchange programme Satisfaction with the Reflective ePortfolio –Overall satisfaction level of students on their use of the Reflective ePortfolio throughout their exchange programme Perceived Achievement of Learning –Perceptions of students on the achievement of their personal goal/development and learning outcomes in the exchange programme Actual Achievement of Learning –A performance indicator of students on the exchange assessment course. This is the actual achievement of the intended learning outcome of the course. Letter grade that students obtained from their course.
Operationalization Individual Engagement Collaborative Engagement Satisfaction with the Exchange Experience Satisfaction with the Reflective ePortfolio Perceived Achievement of Learning Preparation for Future Exchange Engagement (Usage) Outcomes + + + + Actual Achievement of Learning +
Questionnaire Items : Individual Engagement Please determine the extend to which you agree with the following sentences (1=strong disagree, 3=neutral, 5 = strongly agree) I used the ePortfolio frequently to: 1.construct my own profile (Self-Identity) 2.develop my own values and beliefs (Self-Identity) 3.describe my goals and aspiration clearly (Goal setting & Planning) 4.plans to achieve goals (Goal setting & Planning) 5.document my achievements (Record of achievements) 6.update my achievements from time to time (Record of achievements) 7.select appropriate materials to be recorded (selection and use of evidence) 8.select appropriate materials to be demonstrated (selection and use of evidence) 9.reflect on how the exchange experience has affected my values and beliefs (Reflection) 10.observe the differences in behaviors, attitudes and cultures (Reflection) 11.Recognize the requirements and standards to the exchange program (Identified outcome & requirements) 12.Aware of the course intended learning outcomes and expectations (identified outcomes and requirements)
Questionnaire Items : Collaborative Engagement Please determine the extend to which you agree with the following sentences (1=strong disagree, 3=neutral, 5 = strongly agree) I used the ePortfolio frequently to: 1.share my experiences with my classmates and/or teachers 2.provide feedbacks and comments on the experiences of my fellow classmates 3.read feedbacks and comments made from my fellow classmates 4.build better relationship with my fellow classmates 5.Introduce new friends met in the exchange studies
Questionnaire Items : Outcomes Satisfaction with the Exchange Experience 1.I enjoyed my exchange experience. 2.I was actively involved in my overseas/Mainland exchange programme. 3.My exchange experience was successful Preparation of Future Exchange 1.The ePortfolio helped me better prepare for the future exchange program. 2.The ePortfolio helped me better plan for the future exchange program. Satisfaction with the Reflective ePortfolio 1.The ePortfolio’s content structure: Profile-Summary-Showcase-Qualifications (PSSQ), was a good framework to structure my ePortfolio for the exchange program 2.The ePortfolio development experience added value to my exchange programme. 3.The ePortfolio helped me better prepared for the exchange programme. Perceived Achievement of Learning 1.I achieved the intended learning outcomes of the exchange programme. 2.I achieved my own goals of the exchange programme. 3.I realized the importance of life-long learning during the exchange study.
Actual Achievement of Learning Individual Assignment (90%) Build up profile; Create a theme of the ePortfolio; Document the expectations and goals of the exchange; the accomplishments and learning outcomes; Document the exchange experiences including at least THREE actual work/incidents with evidences; Self assess and reflect the performance according to the Course Intended Learning Outcomes (CILOs); Online Discussion (10%) give constructive comments to peers’ ePortfolios
Current Status Validation of Measurement Instrument Initial Results on the Achievement of ePortfolio Workshop
Validation of Measurement Instrument Card Sorting (Moore & Benbasat, 1991) Pilot Testing Construct (Predictor)AlphaConstruct (Outcome)Alpha Individual EngagementSatisfaction with the Exchange Experience Collaborative EngagementPreparation for Future Exchange Satisfaction with the Reflective ePortfolio Perceived Achievement of Learning Actual Achievement of LearningNA
Limitation: Technical problems encountered Google China Incident ePortfolio Workshop 19 Jan 20102011 Google China Incident 10 Mar Tried and discussed different kind of solutions 11 – 16 Mar Agreed to use Blackboard Wiki 16 Mar Released the Bb Wiki to students 30 Mar ePortfolio submission deadline 9 Apr, 30 Apr & 30May CityU VPN CityU GApps Paper Portfolio Bb Wiki CityU VPN CityU GApps Paper Portfolio Bb Wiki
Potential Implications for Educators From Student Externalization to Combination From Individual Peer-Reflective learning to Peer-Reflective Based Experiential Learning From Local Support Network to Distributed Support Network From Self-Monitoring Evaluative Learning to Peer-Assisted and Supportive learning
Potential Implications for Instructors Changing Role from Assessor to Facilitator Enhance intimacy relationship between instructors and students Closing the loop for continuous improvement of course quality by providing better advice to students going for exchange Provide timely feedback and meet urgent needs of students through interactive feedback Assess achievement of learning goals and expected learning progress
Potential Implications for Designers Facebook Approach –Incorporating Facebook design approach in the user interface to record the frequency of updates Show Status –Show Status of feedbacks that have been given and received by students Make Friends –Allow sharing the ePortfolios with friends in the exchange university