1. Curriculum Inventory Webinar July 11, 2018
Angela D. Blood
Walter Fitzwilliam
Michael Cameron
Whitney Staiger

2. Agenda Ongoing needs assessment and future plans
Preparation for the CI upload
Data updates
Verification Report improvements
Learn Serve Lead
CI in Context
Next meeting: Wednesday, August 8, 1 pm ET

3. Where should the Curriculum Inventory go next?
Formal needs assessment
What is the purpose of the CI? Why do people participate?
How should the CI be used? What are or could be the member benefits?
What resources and support do schools have?
What methods are used to collect and evolve data?
Two priorities:
Fortify the existing product
Envision and create an evolved product
Proposed 3 year plan
Talking with constituents, vendors, looking at resources at the AAMC. Now a formal needs assessment through a structured survey is being worked on. We haven’t done a formal needs assessment yet. I’m an education researcher and would like decisions about the future to be as data informed as needed. Although I’m not waiting on data to move forward.
AAMC has a pretty formal process, fairly new, for proposing new projects. Evolving the CI is the equivalent of proposing about 50 projects so we’re adjusting the mold of how ideas are vetted a bit. The idea vetting is meant to make ourselves ask why are we doing this, what are the intended outcomes, is this a priority compared to other priorities, is it feasible. The CI represents a significant investment of time and resources from you and from AAMC; we need to make sure our future plans are making the most of that investment. Once this has been vetted, then we can move into how we will accomplish our goals and execute plans.
I want to prioritize informed decisions, but also need some thing in mind in terms of short term and long term goals so we’re not endlessly waiting for data. It doesn’t seem we can afford to wait on some things, and some improvements are straight forward and should obviously be done. All this is to say that Phases 1 and 2 are items that focus mostly on priority 1, shoring up the existing product, and we go into this knowing that likely some of the projects and priorities will change, whether because of impact of early projects as they are completed, new data we collect, etc.
Phases 1 and 2 are an extremely aggressive timeline. We may need to adjust.

4. Preparation for 2017-18 upload
Portal open August 1 – September 30, 2018
Staging site:
Contact for gaining access to your institution’s staging account information
CI submission portal:
Check your institution’s roles (Primary CI Admin, Dean, etc.)
Check your assigned vendor
CI Portal User Guide:
MANY more resources on the CI website:
In the last webinar, it was asked that we make the staging site easier to find.

5. Data in upload
Documentation of EPAs not required but accepted if submitted
Resources not required by strongly encouraged
If you submit resources, must use ID codes just as you would for instructional or assessment methods
Spellcheck your submissions

6. Quality assurance of submissions
Medbiquitous Specifications, AAMC Business Rules
After a successful submission, each school’s data is processed through additional validations; examples of what we look for:
4000 character expectations/learning objectives
Duplication of expectations/learning objectives across sequence blocks/courses
Mapping majority of PCRS to a single program expectation
Lengthy Academic Levels (>600 days)
Events with high duration serve a purpose, but are there options

7. System changes for
Competency object titles must contain letters/words, not just numbers
Sequence Blocks start and end within 8 years of the Reporting Start and End Dates.
Start and End dates for Sequence Block Events are within 8 years of Reporting Start and End Dates.
Resources are referenced by <ResourceType> and will be in the same style as Instructional and Assessment methods
RE0##, e.g. RE004, RE013
Other text will result in a business rule violation

8. System changes for
New security/password process for CI Staging environment
Narrative Assessment is particularly recognized in Verification Report Table 5
Enhanced security measures to be met with increased support
Website restructuring and file updates (business rules, vocabulary, and LCME crosswalk) strongly recommend reexamination by participants.

9. Verification Report improvements for 2017-18
Readability: we changed the font, increased the size slightly, and tried to make better use of white space
Explanations: we added guide information for every section of the report, explaining what data is and is not included in given tables, how amounts are calculated, etc. 
Wording: we added clarity in the glossary, retitled tables, retitled columns, and added columns within tables to more accurately represent which data is provided
OLD
NEW
I know a guide was discussed and promised last year. We will have it ready for this summer’s upload. I began with a write up of what I thought were all the pressure points of the Verification Report. We asked for feedback in one of our monthly webinars a couple of months ago. I presented the list of challenges to the AAMC development team, and presented the planned changes with opportunity for feedback to the CI Advisory Board and CICA groups in June 2018.
Some of the challenges with the Verification Report will take more time to execute than is possible to do well in just a couple of months, so the improvements you see here are the ones that were able to be accomplished with a very aggressive timeline. If you have more changes you’d like to see please tell us; we are actively working on improvements for 2019, and given the timeline, we can think more radically for 2019.
As an example, for some schools the report can be very long. If you wanted to distribute this to your various faculty, we recognize that it would be easier for you if the data weren’t collated into one giant table (e.g., the Session Event Details table at the end of the report). This was a change that we could consider for 2019.

10. OLD NEW All tables are now numbered
Underlines within tables will be clickable links so you can jump to other parts of the PDF.
Trying to include links which go back to our website, but this way you won’t have to dig to find connecting documents.
We may not be able to make all web links within the document single word clickable hyperlinks, because not everyone will have PDF readers which can do that. We may have to leave the full web addresses in the PDF so that everyone can click on them.
Trying to be explicit about which tables most align with LCME DCI. Table formats may not match exactly, e.g., “typical” hours per week
Relabeling tables. It might have said “all” but it really was primary. We’re investigating how to move beyond primary in reporting for 2019.
Notice the “included in grade” where it spans, added narrative assessment to align with recent DCI changes.
Formative is missing here but it wasn’t dropped, this is part of the ongoing adjustments, this isn’t the finished version.
Trying to be explicit about how formulas are calculated, what data makes it into the data.

11. Learn Serve Lead
As a participating school, you have access to FREE customized reports. If you have Learn Serve Lead presentations for which you’d like to include CI data, please send your request by September 15: Search existing reports here:

12. Learn Serve Lead
11/2 AM: Curriculum Inventory - Open Business Meeting
(Open) Plans for future CI initiatives
11/2 PM: Curriculum Inventory – Closed Business Meeting and Reception
(Closed) CI Advisory Board, CI Research Group, CICA, and Standardized Vocabulary groups
11/4 PM: AAMC Curriculum Inventory: Knowledge Sharing
(Open) Preliminary results of

13. July CI in Context
Use of Self-Directed Learning in US and Canadian Medical Schools
Author: Samara Ginzburg, MD, Zucker School of Medicine at Hofstra/Northwell
Latest issue
Author instructions?
To view past CI in Contexts, visit and click “View all CI in Context Issues”
Want to be a CI in Context Author?

14. Next meeting: Wednesday, August 8, 1 pm ET
(Second Wednesday of each month, 1 pm ET)
Registration Links posted in Training and Resources section of
Please send agenda items to
WHITNEY CAN YOU UPDATE?