1. Speech pathology students’ responses to ePortfolios Abigail Lewis Speech Pathology Psychology and Social Science

2. Outline Background Project Results Application

3. Background Speech Pathology courses use portfolios for demonstration of clinical competency (?reflection) New course, new design = eP! SP students at ECU used MyExpo ePortfolio template since July 2010 launch Assessed each semester for 4 years - formative & summative

4. Design Template developed, information embedded, in BlackBoard (MyExpo) – Section A: Reflections on my learning – Section B: My development of competency – Section C: My records Introduced 1st Yr S2 Submit S1 & S2 2 nd yr 10% Submit S1 & S2 3 rd & 4 th yr substantial Ongoing tweaking based on feedback

5. Evaluate Investigate use of ePortfolios by SP students to inform a trial of the new ePortfolio platform Pebble+ in Semester 2 Project funded by ECU Teaching and Learning grant Ethics approval received

6. Methodology Questionnaires through Qualtrics to 2 nd, 3 rd and 4 th years July 2012 Focus groups 2 nd, 3 rd and 4 th yrs August to October 2012 Staff interviewed Nov 2012 Roll out Pebble+ to 1 st, 2 nd and 3 rd years August 2012 onwards (Questionnaires repeated November 2012)

7. Questionnaires Bio data – age, yrs at uni Technology – comfortable, confident 5 point Likert agreement scale for statements about: – Engagement with portfolio – Technology – Educational value – Reflections, evidence, records – The future Free text questions for NVivo

8. Focus group script How do you use technology in your everyday life? How did you find developing your Portfolio using technology? What do you understand the purpose of the ePortfolio to be? What additional features or improvements can you suggest to the ePortfolio system? Can see yourself using the ePortfolio after you graduate as part of your lifelong learning as a speech pathologist? Thematic analysis using NVivo

9. Results - Response rates Year2 nd years3 rd years4 th years Total number142415 Questionnaire response 6 = 43%11 = 46%8 = 53% Focus group response 2 = 14%12 = 50%8 = 53%

10. Technology in general When I use technology I am comfortable (mean response across all 3 years) When I have to use technology I feel confident I can work it out (mean response across all 3 years)

11. Engagement

12. +ve 37 references: – “The concept is a good idea, having somewhere to file important documents as to monitor my progress.” 3 rd year -ve 70 references: – “...I don’t feel like we’ve put as much time and effort into it we’ve slapped in what we’ve had to have so that it is there to be presented for marking but I don't think it’s a useful tool for us personally” 3 rd year

13. Technology

14. +ve 39 references – “... the ePortfolio’s given me the confidence to use it... somewhere else whereas I wouldn’t of even thought about using it before” 4th -ve 72 references – “it’s just frustrating when it doesn’t work properly” 3rd – “It was very difficult to work out” 3rd

15. Educational Value

16. Educational value +ve 20 references – “I think going back to the goals as well it’s sort of helps you to work out how to set goals for your clients as well” 3rd – “you are actually going to need this to apply for jobs it’s not something to be fluffy about” 4th -ve – 24 references – “we’ve already learnt everything we really are just uploading it” 3rd

17. My Reflections

18. Reflections +ve – 7 references – “It's also interesting to see how far you've come. I've already noticed a difference in my writing etc. in the two years” 4th -ve – 16 references – “I’ve never been one for journal writing or reflections or goals that’s just me not liking those sorts of things” 4th

19. My evidence of competency

20. Evidence +ve – 15 references – “Helped to see which competencies are necessary for graduation” 4th -ve –6 references – “There is no technology involved in the program to monitor and track for you what competencies you have achieved or what is still outstanding - apart from you physically going into it and looking at what you have uploaded” 3rd

21. Records

22. +ve – 7 references – “Keeping all my documents organised and up to date. It is also very helpful when it comes to refreshing my memory on previous pracs” 4th -ve – 1 reference

23. The future

24. Future +ve – 16 references – “they told us but I hadn’t really grasped that and fully understood the importance of that in getting a job until just then” 4th -ve – 20 references – “I don’t know what the end result of this is are we supposed to show it to prospective employees or I still don’t really get what’s the point of it” 2nd

25. Application Platform – user friendly, flexible, allow creativity, no glitches, easy to organise and format, exportable, share with employers Support and training (compulsory) – mini videos, tutes, handouts, tip sheets, FAQ, manual, clear, consise, repeated, at right time, keep explaining value & relevance Peer support/training

26. Application continued Graded complexity and workload across years, not one fixed template, relevant to current level and placements Link to future – peer reports, applying for jobs, lifelong learning, ongoing accreditation