Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11,

Slides:

Advertisements

Similar presentations

Healthy Schools-Successful Students Coordinated School Health in Washington.

Advertisements

Orientation to EVALUATION PROCEDURES August, 2006.

One of the most important aspects of any CME activity is evaluation, or outcomes measurement. CME Compliance: Evaluation Measuring the educational outcomes.

Risk Management at Harvard – Panel Discussion Harvard IT Summit

Reed Exhibitions Driving Revenue Growth and Creating Operating Efficiencies for Association and Society Events.

Welcome to Game Lets start the Game. An electronic health record (EHR) is a digital version of a patient’s paper chart. EHRs are real-time, patient-centered.

Performance Management for Career-Banded Positions at NC State University Heather Boyce Employee Relations.

Getting Started Genevieve Hartman, PhD Director of Platform Operations.

Training Kirkpatrick’s Four Levels of Evaluation Kelly Arthur Richard Gage-Little Dale Munson Evaluation Strategies for Instructional Designers.

Information and planning that makes the difference.

Home Care Special Interest Group Chris Anderson- Chair.

FTA State Programs Meeting Accessing Resources from the National Center for Mobility Management A partnership of.

Slide Set I: PARS Overview

Using Smartphone and Open Source Web Technologies to Automate Academic Regularly Scheduled Series Presented at: 2011 Annual Medbiquitous Conference Presented.

Competency Portfolios Connecting Life, Learning and Work “CPCA”

1 What is Internal Audit’s Role in Management’s Assertion The Institute of Internal Auditors May 11, 2004 Xenia Ley Parker, CIA, CISA, CFSA Principal XLP.

Learning in Disaster Health February 13, 2014 Lois D. Banks, PHF TRAIN Director Erin Bougie, PHF TRAIN Program Assistant.

© American Bar Association Effective Strategic Planning Henry F. White, Jr. Executive Director & Chief Operating Officer American Bar Association 10 th.

LBC Online Survey Staff Training Session. Aim of the session To ensure library staff are: well informed about the Library Survey and their role in its.

Welcome to ElderCARE Technologies Customer Relationship Management Product Overview Thank you for visiting our site! For more information about ElderCARE.

1.Define marketing and describe its contributions. 2. Differentiate among the concepts of needs, wants, and demands. 3. Define the concept of exchange.

SATERN for Supervisors May Session Objectives At the end of the session, participants will be able to:  Describe the benefits of SATERN.  Log.

Track B: Sales, Marketing & Business Development Workshop B-2: Customer Service: It’s About More Than Just Answering the Phone.

University of Texas Clinical Safety and Effectiveness Program Third Year Evaluation October 27,2011 Sherry Martin, Chancellor’s Health Fellow in Clinical.

Standardizing Learner Surveys Across the Enterprise Francis Kwakwa, MA, Radiological Society of North America Valerie Smothers, MA, MedBiquitous.

Medical Education Metrics 2.0 (MEMS 2.0) Orientation.

TUSA06 Strengthening Participatory Approaches in HIV Prevention with Vulnerable Youth: Exchange of Good Practices, Improvement of Quality and Development.

Kirkpatrick model of evaluation to assess public health workforce preparedness training American Public Health Association November 5, 2013 Boston, MA.

Two Years of CME FastTrack: More Than One Hundred Thousand Credits Transferred Via the MedBiquitous Activity Report Standard Stephen Kenney Ben Greenberg.

“Integrating Standards in Practice” 10th Open Forum on Metadata Registries July 9-11, 2007 New York City, NY USA An international conference to share and.

NASPA Presentation Practical Tools for Building Division-wide Assessment Capacity Adrienne Dumpe, Graduate Assistant, VPSA Katie O’Dair, Director of Assessment.

- 1 - Roadmap to Re-aligning the Customer Master with Oracle's TCA Northern California OAUG March 7, 2005.

Evaluation Assists with allocating resources what is working how things can work better.

Pinellas Safe Start Evaluation Prepared by Sandra Ortega For the 2004 Cross-Site Meeting Baltimore, MD November 2004.

Slides prepared by Petra Bouvain University of Canberra.

WorkSourceWA.com Technology to enhance our important work with job seekers, employers and program participants.

Natacha Fernandez-Ureña, Database Manager Jose Hernandez, Supervising Case Manager Shannon Skinner, Coordinator for Testing & Linkage to Care Dustin Przybilla,

Best Practices: Enrollment Management Plan Lorie Hach Director of Student Success Lisa McLaughlin Institutional Data Coordinator.

KMS Products By Justin Saunders. Overview This presentation will discuss the following: –A list of KMS products selected for review –The typical components.

IPMA Executive Conference Value of IT September 22, 2005.

Christian Chace Patent Process Reengineering Team December 8, 2010 Patent Process Reengineering Team and Patent End-To-End Processing Team The Biotechnology.

Leveraging Handhelds for Sales and Support Force Automation Andrew Robertson Director of Technology ArcStream Solutions

Introduction and Overview U.S.A.. “We believe in the power of education and we believe that it should start out at an early age... when taught early,

IHE Marketing and Implementation Resources IHE Marketing and Implementation Resources Chris Carr Director of Informatics, Radiological Society of North.

Overview Module Preview

Linda A. Bailey, JD, MHS How Regional Networks Can Support Quitlines 11/11/2011.

Strategies for Knowledge Management Success SCP Best Practices Showcase March 18, 2004.

1 Learning and Knowledge Management Essential Tools for Implementing Strategy Valerie J. Whitcomb Director of Learning & Knowledge Management The Millennium.

Sara Lovell, CPCS Education Coordinator Providence Alaska Medical Center.

Holy Family University ADDIE Model and Benchmarking for choosing a Learning Management System Andrew Pron, Ed.D. andrew.virtualtown.biz/holyfamily “ A.

Content | Integration | Consulting |Training | Support Self-Assessment for Operational Management strategic learning and information solutions IAC Proprietary.

SRH Peer Review. 2 Project Overview Project goal and Aim : Project goal and Aim : The establishment of a centralized committee for improving physician.

Health Admin P & P. Overview This session is designed to review the student health tools, discuss utilization of particular functionality, and then begin.

Medicaid/SCHIP Technical Assistance for Health IT/HIE 2008 AHRQ Annual Conference Presented by: Linda Dimitropoulos, RTI International.

Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11,

Introduction to ITIL and ITIS. CONFIDENTIAL Agenda ITIL Introduction  What is ITIL?  ITIL History  ITIL Phases  ITIL Certification Introduction to.

Local HWTS Monitoring Eva Manzano, CAWST Technical Advisor Laos Vientiane, Lao PDR November 11, 2014.

Applying the Performance Framework Data Model: A Conceptual Overview January 9, 2014.

National Quality Policy in the Netherlands Cordula Wagner, PhD Emmy Sluijs, PhD Mirjan Geurts, MA.

Integrated EDI for Microsoft Dynamics® AX AXUG Partner Showcase.

KNOWLEDGE MANAGEMENT (KM) Session # 33. Corporate Intranet A Conceptual Model INTRANET Production Team— New Product Budget Director— New Product Knowledge.

Return on Investment of the Recruiting Process

Return on Investment of the Recruiting Process

Education Tools and How to Access Them

MedBiquitous Standards Implementation Workshop

A Training Design Tool for Stakeholders Tasked with Evaluating New and Innovative Treatment Technologies for Small Drinking Water Systems Be sure to type.

Data Standards Provide a Focus for CME Initiatives

Ken Grimm National Environmental Partnership Summit May 10, 2006

Knowledge Connections

Slide Set I: PARS Overview

Presentation transcript:

Formative Evaluation of the Implementation of the Medical Education Metrics Standard for Continuing Education MedBiquitous Annual Conference 2011 May 11, 2011 Baltimore, Maryland

Presenters and Disclosures Francis Kwakwa, MA Assistant Director, Data Management, Radiological Society of North America Does not have an interest in selling anything to CME professionals Andrew Rabin, BS Chief Technology Officer, CECity Does have an interest in selling a program or service to CME professionals Sean Hayes, PsyD Vice President of AXDEV Group Does have an interest in selling a program or service to CME professionals Valerie Smothers, MA Deputy Director, MedBiquitous Does not have an interest in selling anything to CME professionals 2

Assessment of the Participants 3 Who is in the room? (V – we only have 15 minutes, so I think we should be a little more targeted)

Objectives of Today’s Session Increase knowledge about use of Medical Education Metrics Standard (MEMS) in CME Share experience of using MEMS as part of Program and Activity Reporting System Present formative findings collected regarding the experience of those who have implemented MEMS Offer case study findings as to how to assess implementation of new systems 4

Agenda for Today’s Session Overview of MedBiquitous Metrics working group What are Medical Education Metrics Standards (MEMS)? How are MEMS and Program and Activity Reporting System (PARS) related? Experiences using MEMS Lessons learned Moving Forward 5

MedBiquitous Metrics Working Group Mission To develop XML standards & Web services requirements and descriptions for the exchange of aggregate evaluation data and other key metrics for health professions education. 6

MEMS: Medical Education Metrics Technology standard for core evaluation data Users –Educators want best practices, ability to compare –Funders want to measure reach and efficacy –Accreditors want to measure success of activity and provider

MEMS Data Activity Description –What’s being evaluated Participant Activity Evaluation –What did participants think Participation Metrics –How many people participated Learner Demographics

Program and Activity Reporting System (PARS) 9 Manual data entry Comma delimited upload XML upload

Focus Group MEMS implementers using XML in association with PARS 4 organizations represented Measured –Success and satisfaction –Resources for implementation –Characteristics of implementers –Decision factors 10

Results Implementers felt satisfied, but limited (not many customers implementing) Limited effort and resources required; change management important Implementers all fluent in XML ACCME adoption key; implementers seeking to better support customers, show competitive advantage, make links between different types of data

Case Study Implemented MEMS for PARS upload Experience implementing MedBiquitous standards Integrated new data into interface and workflow Provided user training

Lessons Learned 13 Standards implementation can bring about efficiencies when integrated into workflow and properly supported Validation tools needed Web services needed to realize full benefits, one click data transfer

Moving Forward

Contact Us 15 Valerie will forward questions to the working group