1. Pre-Review Orientation Conference Call Bureau of Health Workforce HRSA-15-042 Health Careers Opportunity Program June 29 – July 1, 2015 9am Review Administrator Vicky Johnson June 1, 2015

2. HRSA Support Staff Program Staff: Tia-Nicole Leak, Bureau of Health Workforce, Division of Health Careers and Financial Support Grants Management Staff: Ardena Githara, Department of Grants Management Operations Contractor: o Lauren Tuite, Humanitas, Inc.

3. Roles of Participants DIR RA To coordinate and oversee the review process and to ensure a fair, equitable and objective review is preformed for each eligible application. Reviewers To fairly, equitably and objectively review and evaluate each application. Chairs As Chair, your role is to preside over the ORC panel to ensure that each application is accorded a fair, equitable and objective review.

4. Roles of Participants Grants To provide grant policy and budget development input applicable to assist in the budget review process. Program To ensure that program’s policies and guidance requirements are effectively conveyed and evaluated in accordance with the evaluation criteria and provide specific program policies & procedures and any legislative requirements today. Program will also be available to answer any questions or concerns you may have during the review. DIR Contractor To provide logistical support to DIR.

5. Conflict of Interest & Confidentiality The HRSA objective review process must meet the highest ethical standards A conflict of interest or the appearance of Conflict of Interest (COI) is prohibited! An individual is considered to have a conflict of interest in an application if that person, or a close relative or professional associate of that person, actually has or has the appearance of having: 1.Received or expects to receive a direct financial benefit from any source. 2.Any other interest or relationship in the application or proposal that is likely to bias the individual’s evaluation of that application or proposal. Confidentiality: Safeguarding the Applications & Process  Conduct review in a private non- public location. o No Airports o Social venues  Minimize any potential distractions. o Star 6  Secured computer system.  Shhh… No talking or gossiping.  No copying please.  Delete everything!

6. How To Review Applications First - please read the Funding Opportunity Announcement before reading your assigned applications. - Learn the criteria Second - Review the Sample formats of Strength and Weakness of Summary Statements provide on your Review webpage. - this will assist you on how to compose your comments. – (HRSA Talk ) Third - Complete the Reviewer Worksheet for each assigned application. o Evaluate based on information set forth in the funding opportunity announcement only. o Please provide clear, accurate, useful and informative feedback that is supported by information provided within the application(s). o Strengths should be strengths and Weaknesses should be Weaknesses o Do not compare applications. o No outside information should be included in your review of applications.

7. How To Review Applications o Consider and separately score each criterion. The total score for an application is the sum of all the criteria scores. o All criterion scores must be justified with written strengths or weaknesses. o It is recommended that Reviewers read the entire application before entering their scores and comments in ARM. – Confirm Weaknesses o Reviewers also enter budget recommendations, if applicable

8. Summary Statement Development Please Please! - Your comments need to be complete sentences. – refer to sample statements provided When applicable, sentences should start with “The application or the applicant organization”. Weaknesses should start with “The application”. Please do not cut and paste words or information from the FOA. No language from application or FOA needs to be added to your comments. – its not needed No bullets points, discussion points, or incomplete sentences. - Your comments should be in final format.

9. Summary Statement Development Lastly – your sentences and statements should be entered into ARM separately. Only one sentence per box please! The applicant clearly describes prior practical experience related to assisting rural and frontier hospitals implement new services expansions.

10. Important Reminder It is imperative that Reviewers follow the DIR Reviewer Instruction Guide and the FOA and complete assigned tasks in accordance with established deadlines. The potential integrity of the review process may be compromised if a Reviewer does not complete the assigned work or does not deliver the work on schedule. Reviewers must make all necessary arrangements to be available to complete review assignments, attend and participate in the entire objective review. If for some reason a Reviewer believes that they are unable to fulfill these duties, or if unforeseen circumstances prevent the Reviewer from completing their duties, they must immediately contact me or the Humanitas contractor.

11. Critical Information Essential Points of Contract are : o Lead Review Administrator – Vicky Johnson, RA o Humanitas, Contractor – Lauren Tuite Critical Dates: o All COI forms need to be in by June 2, 2015. o Original Signature Only. o Scores and evaluations: First 3-4 Assigned Applications Due Wednesday, June 17, 2015 Last 1-2 Assigned Applications Due Monday, June 22, 2015.

12. Replay of Pre-Review Orientation Conference Call o Recording of this pre-review call will be accessible up until the day before the scheduled ORC. o Please use the number provided on your assigned Website. Program Support Site URL o The assigned contractor will e-mail you the link at the end of this call. o The Application Review Module (ARM) link is also accessible on the site. Critical Information

13. Review Materials Review Materials Reviewer Support Materials Instructional Materials o FOA - PDF format o Application Guide o Reviewer Instruction Guide o Chairperson Orientation Guide o Scoring Rubric o Steps in Conduction ORC o Reviewer Evaluation Form o Example of Sample Strength and Weaknesses.

14. ARM Manuals o Instruction Guide Manual o Reviewer and Chair ARM Manuals Forms o COI o Reviewer Feedback Form o Chair Evaluation Form ARM Site Login o The Humanitas Contractor will provide you with your user name and password after this call to your assigned website. Review Materials Review Materials

15. Following this call, please review the contents and familiarize yourself with the website. It will serve as a resource tool for the reminder of the review process. Review Materials Review Materials

16. Prior To and Day of Review Merged Summary Statements What to have on hand o Each Reviewer is expected to review the merged summary statements prior to the ORC for duplicative and contradictory comments, statements of fact, and/or personal opinions/biases. o Advanced review of the merged summary statements and identifying inconsistencies will help expedite the editing of the summary statements. The Order of Review The Participant list Tele-Conference Instructions Merged Summary Statements