1 Internet Assisted Review Focus Group March 14, 2002

2 Agenda Reviewer Conflicts - Self Identified Documents available in IAR Peer Review IAR Control Center User Registration Log on to IAR Account Management and Account Info Look Up Post and Edit Phase Read Only Phase

3 Reviewer Conflicts - Self Identified How should system allow Reviewer to identify conflicts? Only once when they log in to IAR for the first time? Anytime?

4 Documents in IAR Items currently mailed to Reviewer: Reviewer Guidelines Cover Letter Grant Application Prior Summary Statements Program Announcements Meeting Roster Blank Conflict of Interest Form Questions: Are the documents above needed in IAR? Who provides electronic copies of these documents? What should be the process for getting these documents into IAR?

5 Peer Review IAR Control Center (Release Meeting to IAR) Refer to Scope Document Excerpt, Product Features 5.2

6 Pre-Registration System Process and User Registration Refer to Scope Document Excerpt, Product Features 5.3, 5.4

7 Registration - Enter PIN Sample Screen

8 Registration – Invalid PIN Sample Screen

9 Registration - Account Creation Sample Screen

10 PIN Mismatch Sample Screen

11 Registration Success Sample Screen

12 Log on to IAR Refer to Scope Document Excerpt, Product Features 5.5

13 IAR Log on Sample Screen

14 Account Information Look Up Refer to Scope Document Excerpt, Product Features 5.6

15 Account Information Look Up Sample Screen

16 User Name/Password Sent Sample Screen

17 Account Access and Expiration Refer to Scope Document Excerpt, Product Features 5.7

18 Post and Edit Phase Refer to Scope Document Excerpt, Product Features 5.8

19 Reviewer’s List of Meetings This is the first screen that appears for Reviewers after login (Commons Account). The screen lists all meetings that include applications assigned to the logged in Reviewer. Screen will show: Meeting Identifier, SRA Name, Critique Due Date, Meeting Dates, Post-Mtg Edit End Date. Reviewer clicks Meeting Identifier for list of their assigned applications. Could this same screen work for SRAs?

20 Reviewer’s List of Meetings Sample Screen

21 Application List (during Post-Edit Phase) Reviewer will see their assigned applications for the meeting they selected. (Reviewers with Non-Commons accounts will automatically see their applications list when they log in.) Screen will show Meeting Identifier and critique submission due date and the following for each application: application number, project title, PI name (*new PI indicator), Assignment Role (Primary, Secondary, etc.), Score, Critique Submitted Date and Action (View or Post)

22 Application List (during Post-Edit Phase) continued Reviewer clicks on Action choices to View or Post critique. Reviewer can only post and view critiques for applications assigned to them. User will be able to sort list by any of the column headings (Score, Application Number, etc.) Will this same screen work for SRAs (show all applications for their meeting)?

23 Application List Sample Screen

24 Upload Critique & Preliminary Score Reviewer clicks on “Post” hyperlink. Screen shows Application Number, Title, PI Name, Reviewer Type and Preliminary Score (if available) Screen allows critique and/or score to be submitted. Button is provided for browsing their computer to locate and upload the file containing the critique. Score can be entered.

25 Upload Critique & Preliminary Score Sample Screen

26 Read Only Phase Refer to Scope Document Excerpt, Product Features 5.8

27 Read-Only Phase After the Critique Submission deadline, Reviewers may read all critiques for the meeting (except COI and where blocked by SRA). Reviewer names are not displayed on screen or in critique, only type (Primary, Secondary, etc.) is displayed User clicks “View” hyperlink to view a critique Questions: Where should Reviewer name be displayed with critique? Will Reviewers or SRA/GTA need to view multiple critiques? If so, how? All critiques for one application merged into one document? All critiques for entire meeting merged into one document?

28 Read-Only Phase Sample Screen

29 During Post and Edit Phase: What are the differences between what the SRA/GTA should see and the Reviewer should see? What are the differences during the Read Only Phase?

30 Minutes and meeting related documents will be posted at Next Focus Group Meeting: Monday, March 18, 2002, 1:30 – 4 pm NGIT/Logicon Large Conference Room (1700 Research Blvd) Agenda will include Demonstrations of the NIAID Electronic Review (ER) system and the NCI Clinical Trials Evaluation Program(CTEP)

31 Thanks for your participation!