Presentation is loading. Please wait.

Presentation is loading. Please wait.

April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills.

Published byAshlie Fisher Modified over 9 years ago

Similar presentations

Presentation on theme: "April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills."— Presentation transcript:

1 April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills

2 April 2004IADR Honolulu Nikos Mattheos Self assessment ability: Evaluate professional actions – process /outcomeEvaluate professional actions – process /outcome Compare to standards Compare to standards Identify weaknesses Identify weaknesses Define new learning objectives Define new learning objectives

3 April 2004IADR Honolulu Nikos Mattheos self assessment ability reflectionfeedback

4 April 2004IADR Honolulu Nikos Mattheos The Leo: A free Internet-based platform for assessing and training of self-assessment skills in oral health education (A. Nattestad – R. Attström) http://tmk.odont.ku.dk/leo/

5 April 2004IADR Honolulu Nikos Mattheos

6 April 2004IADR Honolulu Nikos Mattheos

7 April 2004IADR Honolulu Nikos Mattheos

8 April 2004IADR Honolulu Nikos Mattheos Student’s essay Primary feedback: Expert’s essay reflection improvement ?

9 April 2004IADR Honolulu Nikos Mattheos Leon=26 Staticn=26 BaselineBaselineBaselineBaseline week 1 week 2 week 3 week 4 week 5 AssessmentAssessmentAssessmentAssessment Case1 Case1 1 1 Case2Case3Case4 Case2Case3Case4 2 23 3 4 4

10 April 2004IADR Honolulu Nikos Mattheos BaselineBaselineBaselineBaseline background data, demographics background data, demographics competence with computers (score 1-50) competence with computers (score 1-50) Baseline measurements:

11 April 2004IADR Honolulu Nikos Mattheos Weekly evaluations: use of the softwareuse of the software attitudes, acceptance, expectations attitudes, acceptance, expectations (Visual Analogue Scale 1-16) (Visual Analogue Scale 1-16) 1 12 23 34 4

12 April 2004IADR Honolulu Nikos Mattheos AssessmentAssessmentAssessmentAssessment The Interactive Examination: self assessment as staring point (Internet) self assessment as staring point (Internet) oral + essay + written comparison with expert oral + essay + written comparison with expert Mattheos N, Nattestad A, Falk Nilsson E, Attström R. The Interactive Examination: Assessing students’ self-assessment ability. Med Educ 2004, in press.

13 April 2004IADR Honolulu Nikos Mattheos Results Improved performance in general Improved performance in general No significant difference between groups No significant difference between groups (moderate agreement between 2 assessors) (moderate agreement between 2 assessors) Time on task correlates to written performance Time on task correlates to written performance Computer competence correlates to written performance Computer competence correlates to written performance

14 April 2004IADR Honolulu Nikos Mattheos students judged 3 out of 4 cases as “easy” students judged 3 out of 4 cases as “easy” students were positive on Internet cases, but some complained about workload students were positive on Internet cases, but some complained about workload Attitude swifts Attitude swifts Results

15 April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0,0148 2. How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

16 April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0,0148 2. How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

17 April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0,0148 2. How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

18 April 2004IADR Honolulu Nikos Mattheos Reflections… Human feedback irreplaceable? Human feedback irreplaceable? Content and cases too easy? Content and cases too easy? Time not enough? Time not enough? Assessment procedure not sensitive enough ?Assessment procedure not sensitive enough ?

19 April 2004IADR Honolulu Nikos Mattheos nikolaos.mattheos@od.mah.se ” ”The Kiss”. Gunnar Lundh, Malmö, 1949

Download ppt "April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills."

Similar presentations

Knowledge Dietary Managers Association 1 PART II - DMA Certification Exam Blueprint and Exam Development-

Knowledge Dietary Managers Association 1 PART II - DMA Certification Exam Blueprint and Exam Development-
Random Case Analysis Ramesh Mehay. Aims: to remind you about RCA To help refine your skills To revisit JoHari.

Random Case Analysis Ramesh Mehay. Aims: to remind you about RCA To help refine your skills To revisit JoHari.
A Strategy to Enhance Assessment and Feedback Sheila Oliver Director of Assessment School of Dentistry.

A Strategy to Enhance Assessment and Feedback Sheila Oliver Director of Assessment School of Dentistry.
Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University Dynamic assessment and Interactive Examination.

Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University Dynamic assessment and Interactive Examination.
Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.

Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.
TAP-ET: TRANSLATION ADEQUACY AND PREFERENCE EVALUATION TOOL Mark Przybocki, Kay Peterson, Sébastien Bronsart May 29 2008 LREC 2008 Marrakech, Morocco.

TAP-ET: TRANSLATION ADEQUACY AND PREFERENCE EVALUATION TOOL Mark Przybocki, Kay Peterson, Sébastien Bronsart May LREC 2008 Marrakech, Morocco.
Antonis Lionarakis, Hellenic Open University Considerations for Distance Learning: ‘what students learn’, ‘how they learn’ and ‘what they are able to do.

Antonis Lionarakis, Hellenic Open University Considerations for Distance Learning: ‘what students learn’, ‘how they learn’ and ‘what they are able to do.
Assessment of Clinical Competence in Health Professionals Education

Assessment of Clinical Competence in Health Professionals Education
Correlation between EI and PE Introduction Method EI and age correlated positively, r(51) = +.41, p =.003. Students above age 33 had EI scores well above.

Correlation between EI and PE Introduction Method EI and age correlated positively, r(51) = +.41, p =.003. Students above age 33 had EI scores well above.
PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.

PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.
PORTFOLIO AS A LEARNING TOOL FOR MEDICAL STUDENTS Kirsti Lonka, Ph.D., Professor of Medical Education, Centre for Cognition, Understanding, and Learning.

PORTFOLIO AS A LEARNING TOOL FOR MEDICAL STUDENTS Kirsti Lonka, Ph.D., Professor of Medical Education, Centre for Cognition, Understanding, and Learning.
2001ADEE Bern - Nikos Mattheos Nikos Mattheos Centre for Oral Health Sciences Malmo, Sweden Flexible Learning in Dental Education.

2001ADEE Bern - Nikos Mattheos Nikos Mattheos Centre for Oral Health Sciences Malmo, Sweden Flexible Learning in Dental Education.
2003IADR Gothenburg Nikos Mattheos Nikos Mattheos Centre for Educational Research and Technology in Oral Health, University of Malmö, Sweden The Interactive.

2003IADR Gothenburg Nikos Mattheos Nikos Mattheos Centre for Educational Research and Technology in Oral Health, University of Malmö, Sweden The Interactive.
ASSESSING & DEVELOPING YOUR WORKPLACE COMMUNICATION SKILLS Professional Year Program - Unit 1: Workplace Communication.

ASSESSING & DEVELOPING YOUR WORKPLACE COMMUNICATION SKILLS Professional Year Program - Unit 1: Workplace Communication.
Information Technology and interaction in learning interaction in learning Nikos Mattheos Centre for Educational Technology and Research in Oral Health.

Information Technology and interaction in learning interaction in learning Nikos Mattheos Centre for Educational Technology and Research in Oral Health.
6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?

6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?
Conducting a Job Analysis to Establish the Examination Content Domain Patricia M. Muenzen Associate Director of Research Programs Professional Examination.

Conducting a Job Analysis to Establish the Examination Content Domain Patricia M. Muenzen Associate Director of Research Programs Professional Examination.
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.

Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
Assessing Teamwork in the Trauma Bay: Introduction of a Modified NOTECHS Scale for Trauma Supported by a grant from the American College of Surgeons and.

Assessing Teamwork in the Trauma Bay: Introduction of a Modified NOTECHS Scale for Trauma Supported by a grant from the American College of Surgeons and.
Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.

Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.

Similar presentations

Ads by Google