Presentation is loading. Please wait.

Presentation is loading. Please wait.

Validation of the UW Virtual Reality TURP Simulator Version 1.0 Presented By: Timothy Kowalewski Robert Sweet, MD Peter Oppenheimer Suzanne Weghorst Jeff.

Published by Modified over 8 years ago

Similar presentations

Presentation on theme: "Validation of the UW Virtual Reality TURP Simulator Version 1.0 Presented By: Timothy Kowalewski Robert Sweet, MD Peter Oppenheimer Suzanne Weghorst Jeff."— Presentation transcript:

1 Validation of the UW Virtual Reality TURP Simulator Version 1.0 Presented By: Timothy Kowalewski Robert Sweet, MD Peter Oppenheimer Suzanne Weghorst Jeff Berkley, Ph.D

2 What is TURP? Transuretheral Resection of the Prostate Transuretheral Resection of the Prostate Gold-standard for treating obstructive urinary symptoms Gold-standard for treating obstructive urinary symptoms Challenging to teach and learn Challenging to teach and learn

3 Goals of the Project Overall Project Goal: Overall Project Goal: To help streamline urological procedure education with the aid of simulation technologyTo help streamline urological procedure education with the aid of simulation technology Specific Goals of This Study: Specific Goals of This Study: Establish validation status of Version 1.0, UW Establish validation status of Version 1.0, UW TURP Simulator as a training and assessment tool. TURP Simulator as a training and assessment tool.

4 TURP: a good model for Simulation Objective assessment Objective assessment High risk to patients High risk to patients Apparent training gap Apparent training gap Common problem Common problem National Average Number of TURPS performed by residents Source: ACGME 199019921994 1996 19961998 Sweet, et al. Journal of Endourology. October, 2002.

5 Mainstay operation Mainstay operation Apparent demand Apparent demand Amenable to current technology Amenable to current technology 99%: Validated Simulator Useful in Training 75%: Validated Simulator Useful after Residency …YES 98%: TURP is the Gold Standard of care TURP: a good model for Simulation

6 Methods Simulator Construction Simulator Construction  Virtual anatomy and visual elements  Virtual anatomy and visual elements  Real-time force / tactile feedback  Real-time force / tactile feedback  O.R. instrumentation  O.R. instrumentation  External physical model  External physical model  Auditory cues  Auditory cues

7 Methods Simulator Construction Simulator Construction Training Video Training Video  Definition of task and errors  Definition of task and errors  Statement of goal:  Statement of goal: “Efficiently resect as much tissue as possible while avoiding errors “Efficiently resect as much tissue as possible while avoiding errors and minimizing blood loss, amount of irrigant used, coagulation and minimizing blood loss, amount of irrigant used, coagulation current and number of cuts…” current and number of cuts…” Special Thanks to Anthony Gallager, Ph.D

8 Methods Simulator Construction Simulator Construction Training Video Training Video Pre-Task Questionnaire Pre-Task Questionnaire  Demographics, gender, professional experience, education, ‘video  Demographics, gender, professional experience, education, ‘video game’ experience, TURP-related questions, etc… game’ experience, TURP-related questions, etc…  Stratification of database  Stratification of database

9 Methods Simulator Construction Simulator Construction Training Video Training Video Pre-Task Questionnaire Pre-Task Questionnaire Pre-Compiled, 5-minute Task Pre-Compiled, 5-minute Task  Three trained, non-medical technicians  Three trained, non-medical technicians  Consistent, pre-determined responses  Consistent, pre-determined responses  Privacy and Anonymity  Privacy and Anonymity

10 Methods Simulator Construction Simulator Construction Training Video Training Video Pre-Task Questionnaire Pre-Task Questionnaire Pre-Compiled, 5-minute Task Pre-Compiled, 5-minute Task Post-Task Questionnaire Post-Task Questionnaire  Critique of simulator according to its elements  Critique of simulator according to its elements  Open feedback  Open feedback

11 Methods Simulator Construction Simulator Construction Training Video Training Video Pre-Task Questionnaire Pre-Task Questionnaire Pre-Compiled, 5-minute Task Pre-Compiled, 5-minute Task Post-Task Questionnaire Post-Task Questionnaire AUA Annual Conference AUA Annual Conference  72 Experts  72 Experts  19 Trainees  19 Trainees  19 Novices  19 Novices

12 Metrics Grams of tissue resected Grams of tissue resected Amount of irrigant used Amount of irrigant used Quantity of ambient blood Quantity of ambient blood Number and severity of bleeding vessels Number and severity of bleeding vessels Instrument position and interaction Instrument position and interaction Number of cuts at tissue Number of cuts at tissue ~ 12 Hz resolution ~ 12 Hz resolution Combinations thereof … Combinations thereof …

13 Results: Face Validity  Do you feel the UW TURP Simulator would be useful as a training tool?

14 Results: Face Validity  Would you like to see it implemented into the curriculum of residency programs?

15 Results: Face Validity  Do you feel it would be useful as a tool for accreditation?

16 Results: Content Validity Categorical Standardized Likert scale of global acceptability Acceptability threshold Slightly acceptable Moderately acceptable Totally acceptable Slightly unacceptable Moderately unacceptable Totally unacceptable

17 Results: Novices vs. Experts ( p < ) 0.0001 - 0.0001+ 0.001+ 0.002+ 0.006+ 0.016+ 0.020 - 0.032 - 0.080+ 0.097 - Result of Levene-conditioned two-tailed T-test quantifies resolving potential of selected metrics to determine differences between novices and experts.

18 Results: Construct Validity Performance of Errors

19 Construct/Concurrent Validity (Cross-sectional) Metrics correlations mimicked the operating room. Experts and trainees were more efficient at cutting than novices. (P<.01) Experts were more efficient at coagulating bleeders than trainees who were more efficient than novices. (P<.05, P<.01) Performance among experts did not exhibit “decay” Video game experience influenced performance in novices and experts only.

20 Conclusions Established Face and Content Validity Established Face and Content Validity Established Construct Validity (X-sectional) Established Construct Validity (X-sectional) Addressed Concurrent Validity (incomplete) Addressed Concurrent Validity (incomplete) NO assessment predictive validity or longitudinal studies NO assessment predictive validity or longitudinal studies - - - For Version 1.0 - - - - - - For Version 1.0 - - -

21 Version 2.0 Predictive and Construct Validation Anatomy ID Module Coagulation Module Cutting Module Advanced Resection Module

Download ppt "Validation of the UW Virtual Reality TURP Simulator Version 1.0 Presented By: Timothy Kowalewski Robert Sweet, MD Peter Oppenheimer Suzanne Weghorst Jeff."

Similar presentations

Establishing the reliability and validity of a Virtual Reality Upper Gastrointestinal simulator using a novel video-endoscopic assessment technique. Moorthy.

Establishing the reliability and validity of a Virtual Reality Upper Gastrointestinal simulator using a novel video-endoscopic assessment technique. Moorthy.
Effective Supervision

Effective Supervision
No. 091 Bipolar Diathermy for Transurethral Resection of Prostate: 6 year Australian Single Regional Centre Experience Devang Desai (Urology Registrar),

No. 091 Bipolar Diathermy for Transurethral Resection of Prostate: 6 year Australian Single Regional Centre Experience Devang Desai (Urology Registrar),
Whole Slide Digital Images in Residency Education: Sliced Bread or Iced Dread? Lewis A. Hassell, MD University of Oklahoma Health Sciences Center Pathology.

Whole Slide Digital Images in Residency Education: Sliced Bread or Iced Dread? Lewis A. Hassell, MD University of Oklahoma Health Sciences Center Pathology.
How Accurate is the ACGME Resident Survey? Comparison Between ACGME and In-House GME Survey Bridget N. Fahy 1, S. Rob Todd 1, Judy L. Paukert 2, Melanie.

How Accurate is the ACGME Resident Survey? Comparison Between ACGME and In-House GME Survey Bridget N. Fahy 1, S. Rob Todd 1, Judy L. Paukert 2, Melanie.
5/5/14 Evaluation of Tube Thoracostomy Teaching Models: An Argument for Developing Low-Fidelity Simulators Azmath Mohammed, MD; Christina Jenkins, MD;

5/5/14 Evaluation of Tube Thoracostomy Teaching Models: An Argument for Developing Low-Fidelity Simulators Azmath Mohammed, MD; Christina Jenkins, MD;
Susan Malone Mercer University.  “The unit has taken effective steps to eliminate bias in assessments and is working to establish the fairness, accuracy,

Susan Malone Mercer University.  “The unit has taken effective steps to eliminate bias in assessments and is working to establish the fairness, accuracy,
Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington.

Human interface technology lab Medical Applications of VR Suzanne Weghorst Human Interface Technology Lab University of Washington.
Simulation based Assessment Training the Trainer Series October, 2014 Training the Trainer Series October, 2014.

Simulation based Assessment Training the Trainer Series October, 2014 Training the Trainer Series October, 2014.
Virtual Reality Simulators for Minimal Invasive Surgery Training

Virtual Reality Simulators for Minimal Invasive Surgery Training
Design Activities in Usability Engineering laura leventhal and julie barnes.

Design Activities in Usability Engineering laura leventhal and julie barnes.
The Xitact Platform for Laparoscopic Surgery Training Ivan Večerina, M.D. – Xitact S.A. MMVR11, 2003 LS 500 Trainer Platform.

The Xitact Platform for Laparoscopic Surgery Training Ivan Večerina, M.D. – Xitact S.A. MMVR11, 2003 LS 500 Trainer Platform.
Minimally Invasive Surgery Task Decomposition - Etymology of Endoscopic Suturing Jacob Rosen* Ph.D., Lily Chang** MD, Jeff Brown ***, Andy Isch** MD Blake.

Minimally Invasive Surgery Task Decomposition - Etymology of Endoscopic Suturing Jacob Rosen* Ph.D., Lily Chang** MD, Jeff Brown ***, Andy Isch** MD Blake.
Visual Spatial Ability – Are Surgeons Born or Made? Zackary Boom-Saad, Pamela Andreatta, EdD, Miranda L. Hillard, Anthony G. Gallagher, PhD †, Scott Langenecker,

Visual Spatial Ability – Are Surgeons Born or Made? Zackary Boom-Saad, Pamela Andreatta, EdD, Miranda L. Hillard, Anthony G. Gallagher, PhD †, Scott Langenecker,
Simulation for Training January 25 th, 2003 MMVR Simbionix Corp. 11000 Cedar Ave. Cleveland OH 44106.

Simulation for Training January 25 th, 2003 MMVR Simbionix Corp Cedar Ave. Cleveland OH
Virtual Reality Surgical Training at the University of Washington Presented By: Timothy Kowalewski Robert Sweet MD, Urology Suzanne Weghorst, Human Interface.

Virtual Reality Surgical Training at the University of Washington Presented By: Timothy Kowalewski Robert Sweet MD, Urology Suzanne Weghorst, Human Interface.
Purpose of the Standards

Purpose of the Standards
Perception between Regular and Sped teachers in Handling Children with Intellectual Disability: Basis for a Specialized Training Program for Teachers by.

Perception between Regular and Sped teachers in Handling Children with Intellectual Disability: Basis for a Specialized Training Program for Teachers by.
Improved Patient Safety By Comprehensive Simulation-Based Training in Cardiac Surgery AHRQ 2012 Annual Conference September 10, 2012 Richard H. Feins,

Improved Patient Safety By Comprehensive Simulation-Based Training in Cardiac Surgery AHRQ 2012 Annual Conference September 10, 2012 Richard H. Feins,
Emergency Ultrasound Proposal. Emergency Ultrasound In common use since early 1990’s In common use since early 1990’s First curriculum was published in.

Emergency Ultrasound Proposal. Emergency Ultrasound In common use since early 1990’s In common use since early 1990’s First curriculum was published in.

Similar presentations

Ads by Google