2003IADR Gothenburg Nikos Mattheos Nikos Mattheos Centre for Educational Research and Technology in Oral Health, University of Malmö, Sweden The Interactive.

Slides:



Advertisements
Similar presentations
Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University Dynamic assessment and Interactive Examination.
Advertisements

Using Computer-Simulated Case-Based Scenarios to Improve Learning Department of Health Professions College of Health & Public Affairs University of Central.
EXTENDED ESSAY, CONTINUED Assessment Criteria and Subject Areas.
2013 Predoctoral Educators Workshop The Art and Science of Educating to Competency Eros S. Chaves, DDS, MS, DMD, MBA Diplomate, American Board of Periodontology.
Retooling Health Assessment: It Takes More Than a Hammer Cheryl Wilson MSN, ARNP, ANP-BC.
What is a Community Rubric?. A community rubric Contains specified criteria that can be adapted based on teaching styles, expertise, disciplinary conventions,
Measuring Student Learning March 10, 2015 Cathy Sanders Director of Assessment.
The Merchant of Venice. In this unit, students will be working around themes such as “Self Interest versus Love”, the “Divine Quality of Mercy”, and “Hatred.
Objective vs. subjective in assessment Jaime Correia de Sousa, MD, MPH Horizonte Family Health Unit Matosinhos Health Centre - Portugal Health Sciences.
Assessment in the Middle Years Programme. How are students assessed? The MYP offers a criterion-related model of assessment. This means that students'
April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills.
UCD School of Medicine “Criterion Based” vs. “Norm-Based” Evaluation David L Gaspar MD October 18, 2008.
Principles of Teaching and Learning in Clinical Settings Professor Hossam Hamdy University of Sharjah.
PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.
TIPS for Writing Case Studies Provided by the Abstracts Committee.
Slide 1 1 Critical Thinking and Nursing Judgment NPN 105 Joyce Smith RN, BSN.
Critical Thinking in Nursing. Definition  Critical thinking is an active, organized, cognitive process used to carefully examine one’s thinking and the.
CRITICAL THINKING in Nursing Practice: chapter 14 “…active, organized, cognitive process used to carefully examine one’s thinking and the thinking of others.”
Assessment of clinical skills Joseph Cacciottolo Josanne Vassallo UNIVERSITY OF MALTA ANNUAL CONFERENCE - OSLO - MAY 2007.
Data on Student Learning Office of Assessment University of Kentucky.
Self-Assessment By Students Sharing by Cheryl Lee 16 January 2015.
If You Can Measure It, You Can Manage It Measuring Periodontal Status to Manage Periodontal Treatment Courtesy PreViser Corporation, all rights reserved.
Underagraduate Program in Dokuz Eylül University School of Nursing Problem-Based Learning Curriculum.
Case Study Presentation Team Number Team Member Names Date Template adapted from “Case Study/Treatment Planning” by Ann Wetmore and Mosby’s Dental Hygiene.
Grappling with Grading Assessment & Rubrics
Information Technology and interaction in learning interaction in learning Nikos Mattheos Centre for Educational Technology and Research in Oral Health.
Beena FEF college Bannu Township. Topic : Quran Class XI year College FEF Bannu Town ship Duration : 40 min.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
Fluency Assessment Ch. 9. What? Fluency should be assessed often! –Listen to students read aloud –Collect information about oral reading accuracy & rate.
ASSESSMENT IN EDUCATION ASSESSMENT IN EDUCATION. Copyright Keith Morrison, 2004 PERFORMANCE ASSESSMENT... Concerns direct reality rather than disconnected.
Writing Student Learning Outcomes Consider the course you teach.
Connections paper Route J – Religious Ethics with New Testament 2792 About the paper & exam questions.
Using Electronic Portfolios to Assess Learning at IUPUI. Trudy Banta, et. al. Indiana University-Purdue University Indianapolis 2007.
Judith Brenner, MD Associate Dean for Curricular Integration Samara Ginzburg, MD Associate Dean for Medical Education Keith Metzger, PhD Assistant Professor,
Using a 21st Century Classroom Grant to Transform Language Arts Classrooms Alice A. Christie, Ph.D. Jan Wolfgramm, M.Ed.
The program will start promptly at 2:15 PM For technical assistance please contact Tech Support at or at
Taking it to Another Level: Increasing Higher Order Thinking Session 3 BHCA PROFESSIONAL DEVELOPMENT SERIES.
Communication & Collaboration Communicate Clearly  Articulate thoughts and ideas effectively using oral, written and nonverbal communication skills in.
Raises, Merit Pay, Bonuses Personnel Decisions (e.g., promotion, transfer, dismissal) Identification of Training Needs Research Purposes (e.g., assessing.
Workshop: assessing writing Prepared by Olga Simonova, Maria Verbitskaya, Elena Solovova, Inna Chmykh Based on material by Anthony Green.
Patricia A. Mahoney, MSN, RN, CNE
Self-assessment Accuracy: the influence of gender and year in medical school self assessment Elhadi H. Aburawi, Sami Shaban, Margaret El Zubeir, Khalifa.
Source : The Problem Learning and innovation skills increasingly are being recognized as the skills that separate students who are.
Georgia will lead the nation in improving student achievement. 1 Georgia Performance Standards Day 3: Assessment FOR Learning.
CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.
DP, Language A Year 1. AIMS introduce students to a range of texts from different periods, styles, and genres. develop in students the ability to engage.
IB: Language and Literature
AP French Language and Culture Exam Information Lynn Gouacide.
Training the Trainers Assessing the Learner Progress By Dr Malik Zaben IMET
Computerised self/peer support, learning and assessment of final year undergraduates? Phil Davies University of Glamorgan.
Assessment. Summative assessment Summative assessment is the process of evaluating (and grading) the learning of students at a point in time. The University.
Neuroblend Curriculum and Learning Paths. Introduction Project Description Professional neuroscience nursing ECP Curriculum Description Pedagogical background.
Prior Learning Assessment (PLA) Pilot Project At VSU Prepared by the PLA Assessors Group.
Psychology A2. Objectives Give overview of topics to be covered at A2 examination structure Style of questions.
Introduction. The Purpose of the Class In this class, we will be writing. We will explore the writing process. We will learn what does it take to write.
00 Workshop 4 “Elaboration of educational programmes according to qualifications framework” 16. und 17. February 2011 Georgia, Bakuriani Margret Schermutzki.
APPROVED CLINICAL INSTRUCTOR WORKSHOP Evaluation.
Competencies and consequences … choices to make April
Advanced Dental Admission Test (ADAT)
Communication Skills Rumessa Naqvi
Introduction to Evaluation
Diagnosis and Remediation of Reading Difficulties
Chapter 7: Critical Thinking
Automated Essay Scoring Tools – New approaches in Editing Process
Focus Areas Business and Applied Business Fine Arts, Design, and Media
Grade 6 Outdoor School Program Curriculum Map
USI College of Business Faculty Evaluation System
teachers The English Language Centre EPORTFOLIOS!
AP World History Introduction.
Presentation transcript:

2003IADR Gothenburg Nikos Mattheos Nikos Mattheos Centre for Educational Research and Technology in Oral Health, University of Malmö, Sweden The Interactive Examination Assessing students’ self-assessment ability Assessing students’ self-assessment ability

2003IADR Gothenburg Nikos Mattheos Parallel learning goals: Biomedical knowledge Clinical skills Clinical skills Critical thinking Critical thinking Life-long learning Problem Solving Problem Solving

2003IADR Gothenburg Nikos Mattheos

2003IADR Gothenburg Nikos Mattheos The Interactive Examination: evaluate knowledge, skills and self assessment ability evaluate knowledge, skills and self assessment ability Evaluate process - outcomeEvaluate process - outcome Compare to standards - criteria Compare to standards - criteria Identify needs Identify needs Define new learning objectives Define new learning objectives

2003IADR Gothenburg Nikos Mattheos 1.Self assessment (through Internet: 11 ordinal scales 1-6, text) The Interactive Examination:

2003IADR Gothenburg Nikos Mattheos 2. Essay question (40 min) 3. Oral examination – discussion (70 min) 4. Evaluation (10 min) 1.Self assessment (through Internet: 11 ordinal scales 1-6, text) The Interactive Examination:

2003IADR Gothenburg Nikos Mattheos 5. Compare own essay with expert’s (1 week after) 6. Individual feedback ( ) (1 month after) 2. Essay question (40 min) 3. Oral examination – discussion (70 min) 4. Evaluation (10 min) 1.Self assessment (through Internet: 11 ordinal scales 1-6, text) The Interactive Examination:

2003IADR Gothenburg Nikos Mattheos Material and Method: One cohort of 2 nd year students in Periodontology (2001 n=54) - Essay and oral performance grades (1-6) - Self assessment vs instructors judgment - Self assessment and performance / gender - Qualitative Analysis of comparison documents: (differences, arguments, learning needs) - Attitudes towards examination (ordinal scales 1-9, free text)

2003IADR Gothenburg Nikos Mattheos Results: 0,5% 3% 15% 40% 35% 6% 0,5% 40 % of the self assessment scores were in agreement with those of the clinical Instructors. No gender differences % of the students had significant deviation from instructors ( 34% over – 9% under) (2 tailed Wilcoxon’s signed rank test) General: Individual:

2003IADR Gothenburg Nikos Mattheos Results: Nr. 3 (p=0.0002) “Overall diagnosis and treatment of periodontitis” Nr. 4 (p=0.02) “Competence in clinically differentiating healthy from pathological gingival” Nr. 5 (p=0.0006) “Measuring of pocket depth” Nr. 8 (p=0.003) “Competence in evaluating changes in the radiographic image of the periodontium”.

2003IADR Gothenburg Nikos Mattheos Results: 1. How effective do you think is Interactive Examination for learning? not effective very effective median 8 (n=52) 2. How do you think the Interactive examination would affect your learning style from now? no difference increase my motivation median 7 (n=52)

2003IADR Gothenburg Nikos Mattheos Results: Students underestimating their competence scored better in the oral part of the exam Female students performed significantly better in both oral and written parts of the exam Students appreciated the element of discussion, but not the written essay part.

2003IADR Gothenburg Nikos Mattheos Results: Results: What did the students compare 1. Form and structure: Length, text diagramme or flow chart, Use of images, language, style etc 2. Content : Additions, emissions, terms etc 3. Attitude: Prioritising, elaborating, depth of detail etc

2003IADR Gothenburg Nikos Mattheos differencesarguments needs

2003IADR Gothenburg Nikos Mattheos Conclusions: 2nd year students in general tended to overestimate their competence Students overestimated their competence in diagnostic rather than treatment skills The interaction element in examination was highly appreaciated Student’s comparison document reflected students’ understanding, prioritising and self-assessment skills through the sequence: differences  arguments  needs

2003IADR Gothenburg Nikos Mattheos