1. 1 Internet Assisted Review Review User Group April 22, 2002

2. 2 Overview Internet Assisted Review will allow Reviewers to: electronically submit critiques and preliminary scores prior to the meeting review the critiques submitted by others online permit more efficient and effective use of reviewers’ time at meetings modify their critiques after the meeting

3. 3 Overall Process Flow How does Internet Assisted Review fit into the existing Peer Review process?

4. 4 1. SRA Prepares Meeting/ Reviewers for IAR: SRA finalizes meeting assignments, selects meeting for IAR and specifies critique submission and other deadlines. 2. Reviewer Registers for IAR: Reviewer account creation and registration via email. 3. Submit Phase: Reviewers log in and submit critiques and preliminary priority scores for their applications. 4. Read-Only Phase: After submission deadline, Reviewers “may” read other Reviewer’s critiques. If a reviewer has not submitted, the SRA “may” block the Reviewer from reading. 5. Optional Edit Phase: After the meeting, Reviewers “may” modify their critiques. 6. Generate Summary Statements: draft bodies are built from critiques.

5. 5 IAR Focus Group Members Chair, Eileen Bradley (CSR) Roberta Binder (NIAID) Tracey David (CSR) Cynthia Lassnoff (NIAID) Neal Musto (NIDDK) Ev Sinnett (CSR) Roy White (NHLBI) Brian Wojcik (NCI) OER Staff: Tracy Soto, Scarlett Gibb, Sherry Zucker, Mark Siegert, Sandy Seppala NGIT Staff: Daniel Fox, Adam Levy, Andy Greenleaf

6. 6 What have we done? Architecture decision made: J2EE and Commons database Security evaluation of User Registration and Account Management Held seven focus group meetings: Group approved overall business flow Reviewed two systems: NIAID Electronic Review NCI Clinical Trials Evaluation Program (used for both internal and external reviewer evaluation of proposed clinical protocols)

7. 7 What have we done? Documented and validated requirements for: SRA/GTA Control Center Registration and Account Management Post phase Reviewer view SRA view

8. 8 What do we still need to do? Requirements gathering and validation for: Read-only phase Streamlining Edit Phase Summary Statement generation Meeting data purge Define scope of versions to be delivered

9. 9 Deployment Version 1 Pilot tentatively scheduled for Fall 2002 Schedule will be finalized after Focus Group finishes requirements gathering and validation and defines scope of first version (June 2002)

10. 10 This presentation and materials from the IAR Focus Group Meetings (minutes, Scope document and Presentations) are posted on the eRA site at http://era.nih.gov/areas/rev/index.cfm http://era.nih.gov/areas/rev/index.cfm

11. 11 Any questions?