1. CITI 2 Software Update Features, Modifications, and Planned Upgrades October 2007 Mike Fallon; michael.fallon@va.gov

2. What Does the CITI Software include? Tools to Create and modify coursework. Create and modify quizzes. Design custom curricula for learners in each institution, depending on their research activities. Design and administer surveys. Help each learner track progress through their coursework. Provide institutional administrators with pertinent reports- who has completed the required training? Monitor site usage (for site administrators).

3. CITI "2" Features as of January 2007 A single user account can be affiliated with multiple institutions. Learner can have multiple grade books (human subjects, RCR, animal research, etc) in each institution. Enrollment questions are used to determine custom curriculum for each learner, per institutional wishes. When learners earn a completion report, email can be sent to one or all institutional administrators.

4. One Learner Account, Multiple Institutions on the Main Menu Affiliate with another institution

5. Multiple Grade Books within an Institution

6. Other Significant Enhancements Code continually rewritten to be more efficient and to support more concurrent users.

7. CITI 2 Features as of August 2007 In addition to training record set downloads available to institutional administrators, record sets can be downloaded automatically to local personnel management databases. Learners can be placed directly into the CITI Main Menu after learners login to the institution's host network, bypassing the usual CITI login process. Optionally, reminder emails sent to learners as completion reports expire. Multiple learner accounts can be merged into one account (still undergoing beta testing). Pre- and post-course completion surveys can be set up to collect feedback from learners.

8. Automatic Downloads for Institutional Administrators- Record Set Formats Available (comma or tab-delimited files) All completion reports earned at the institution since ~January 2006 (+/- module names and quiz scores). Completion reports earned since the last dataset download (+/- module names and quiz scores). Most recent completion report earned by each learner (+/- module names and quiz scores). Completion reports that will expire within 30, 60, 90, 120, or 180 days from today's date. Data fields in reports can be added or removed and sequenced as needed for each institution.

9. Same person ?? Direct Placement into the CITI Main Menu and Automatic Dataset Transfers to Institutions To 1) allow learners to use their institutional network username and password to enter the CITI main menu directly and 2) automate learner completion dataset transfers into local personnel management software the learner's institutional records and the learner's CITI records must share a unique identifier to ensure a perfect match. CITI Website -John Doe's records Local institutional training database -John Doe's records

10. Direct Learner Placement into the CITI Main Menu Reduced burden on learners and administrators

11. Learner goes to CITI website and creates a username and password Learner chooses one or more institutions and provides contact and profile information Learner answers enrollment questions to create course grade books At Main Menu Learner completes coursework, earns completion report(s) Learner prints completion report(s), sends to admin office Admin office downloads records (email or dataset download) and enters data into local database Learner logs into local institutional network using their existing username and password Learner visits a local network page that collects profile and coursework information A unique learner ID is added, then data is encrypted and sent to CITI server to create a learner "session" CITI server automatically sends encrypted dataset to institution's server, unique ID used to merge dataset with local training database

12. Learner goes to CITI website and creates a username and password Learner chooses one or more institutions and provides contact and profile information Learner answers enrollment questions to create course grade books At Main Menu Learner completes coursework, earns completion report(s) Learner prints completion report(s), sends to admin office Admin office downloads records (email or dataset download) and enters data into local database Learner logs into local institutional network using their existing username and password Learner visits a local network page that collects profile and coursework information A unique learner ID is added, then data is encrypted and sent to CITI server to create a learner "session" CITI server automatically sends encrypted dataset to institution's server, unique ID used to merge dataset with local training database

13. University of Wisconsin Beta Test of Local Authentication and Direct Placement into CITI Main Menu Calvin Chang at UW providing coding and development support in collaboration with Stephanie Manuel and Chris Simmons (CITI programmers) Preliminary testing in September successful- proof of concept verified Final coding and testing in late October Template will be available to all CITI institutions

14. University of Wisconsin Sample Screens

15. These links take a non- UW learner to the CITI home page

16. xxxxxxxxxxx

17. Once submitted, a unique ID and other profile info is sent to the CITI server and a learner "session" is set up.

18. In this case, the learner groups were not sent to the CITI server, so the learner must click to go to the enrollment questions to receive a curriculum.

19. The UW Learner now can be... Absolutely identified in dataset transfers from the CITI server to a UW server, because of the learner unique ID number shared by CITI and UW. A script can be written to automatically process the dataset received from CITI so that UW administrators do not have to spend time matching CITI and UW learner records. and...

20. Automatic Downloads for Institutional Administrators- Record Set Formats Available (comma or tab-delimited files) All completion reports earned at the institution since ~January 2006 (+/- module names and quiz scores). Completion reports earned since the last dataset download (+/- module names and quiz scores). Most recent completion report earned by each learner (+/- module names and quiz scores). Completion reports that will expire within 30, 60, 90, 120, or 180 days from today's date. Data fields in reports can be added or removed and sequenced as needed for each institution.

21. User Interface and Site Usability Although overall ease of site navigation and registration process receive high survey satisfaction scores, about 15% of learners are dissatisfied with one or both. Two focus areas for improvement –Choosing affiliated institutions –Course enrollment process

22. Problems in Choosing Affiliated Institutions Some learners are confused by the multiple drop-down selection boxes, and believe they are supposed to choose one institution from each category. A redesigned process is needed.

23. Difficulty in Navigating the Enrollment Questions Some learners have a difficult time navigating through the enrollment questions. Some specific challenges: –Currently, all learners have to see all enrollment questions. –Some institutions have 10 or more enrollment questions that all appear on one page. –It can be difficult for learners to understand which questions they should answer.

24. Solution- One Enrollment Question per Page Q1 (ID#233). Which of the following apply to your research activities? Human subjects research. [if chosen, turns on Q#234; no groups associated] Animal research. [if chosen, turns on Q#245; no groups associated] Use of hazardous agents in research. [if chosen, turns on Q#250; no groups associated] Q4 (ID#245).Do you serve on the IACUC? Yes. [Essentials for IACUC Members; stage 1] No. Q2 (ID#234). Which of the following apply to your human research activities? Biomedical studies. [if chosen, turns on Q#235; no groups associated] Social or Behavioral studies. [CITI Social and Behavioral Course; stage 1] GCP. [CITI GCP Course; stage 1]\ Q3 (ID#235).Do you need to take the Basic or Refresher Biomed Course? Basic (stage 1). [CITI Biomedical Course; stage 1] Refresher (stage 2). [CITI Biomed Course; stage 2] Q5 (ID#250).Do you work with select agents? Yes. [Select Agent Training; stage 1 and Basic Biosafety; stage 1] No. [Basic Biosafety; stage 1] (Skipped) DONE

25. Q1 (ID#233). Which of the following apply to your research activities? Human subjects research. [if chosen, turns on Q#234; no groups associated] Animal research. [if chosen, turns on Q#245; no groups associated] Use of hazardous agents in research. [if chosen, turns on Q#250; no groups associated] Q4 (ID#245).Do you serve on the IACUC? Yes. [Essentials for IACUC Members; stage 1] No. Q2 (ID#234). Which of the following apply to your human research activities? Biomedical studies. [if chosen, turns on Q#235; no groups associated] Social or Behavioral studies. [CITI Social and Behavioral Course; stage 1] GCP. [CITI GCP Course; stage 1]\ Q3 (ID#235).Do you need to take the Basic or Refresher Biomed Course? Basic (stage 1). [CITI Biomedical Course; stage 1] Refresher (stage 2). [CITI Biomed Course; stage 2] Q5 (ID#250).Do you work with select agents? Yes. [Select Agent Training; stage 1 and Basic Biosafety; stage 1] No. [Basic Biosafety; stage 1] (Skipped) DONE

26. Q1 (ID#233). Which of the following apply to your research activities? Human subjects research. [if chosen, turns on Q#234; no groups associated] Animal research. [if chosen, turns on Q#245; no groups associated] Use of hazardous agents in research. [if chosen, turns on Q#250; no groups associated] Q4 (ID#245).Do you serve on the IACUC? Yes. [Essentials for IACUC Members; stage 1] No. Q2 (ID#234). Which of the following apply to your human research activities? Biomedical studies. [if chosen, turns on Q#235; no groups associated] Social or Behavioral studies. [CITI Social and Behavioral Course; stage 1] GCP. [CITI GCP Course; stage 1]\ Q3 (ID#235).Do you need to take the Basic or Refresher Biomed Course? Basic (stage 1). [CITI Biomedical Course; stage 1] Refresher (stage 2). [CITI Biomed Course; stage 2] Q5 (ID#250).Do you work with select agents? Yes. [Select Agent Training; stage 1 and Basic Biosafety; stage 1] No. [Basic Biosafety; stage 1] (Skipped) DONE (Skipped)

27. Ongoing Feature Enhancements Conversion of entire website to support "on the fly" foreign language translation of web pages (testing nearly complete) Conversion of entire website from ASP pages to ASP.Net pages. Sophisticated code to check and alert a learner when a learner's previous coursework suggests that they should be in a different course or course stage than what their enrollment question choices would suggest. The ability to allow an institution to create equivalencies such that non-matching modules taken at other institutions can be accepted in place of their own.