1. Cedric L. Williams, Ph. D. Professor Dept. of Psychology and Graduate Program in Neuroscience University of Virginia Charlottesville, VA Council on Undergraduate Research Dialogues Conference 2011 Understanding the Procedures Underlying Grant Writing and the Proposal Review Process

2. “READ THIS” Before You Begin“READ THIS” Before You Begin Getting Started with Proposal Development:Getting Started with Proposal Development: a) Successful Methods of addressing Merit Criteria b) Tips for Organizing Proposals & Avoiding Pitfalls b) Tips for Organizing Proposals & Avoiding Pitfalls The Review/Evaluation ProcessThe Review/Evaluation Process Factors Influencing Funding DecisionsFactors Influencing Funding Decisions Overview

3. http://www.nsf.gov/publications/pub_summ.jsp?ods_key=gpg “READ THIS” Before you begin:

4. NSF 11-1 January 2011

5. Getting Started with Proposal Development: ( Conceptual & Empirical )

6. Intellectual Merit Broader Impacts Merit Merit Review Criteria Merit Review Criteria Impacts

7. Intellectual Merit How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? ( The Project; IMPACT )How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? ( The Project; IMPACT ) Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.)Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.) To what extent does the proposed activity suggest and explore creative and original concepts?To what extent does the proposed activity suggest and explore creative and original concepts? How well conceived and organized is the proposed activity?How well conceived and organized is the proposed activity?

8. Intellectual Merit How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? 1. Are the studies developed to specifically resolve some theoretical debate within a your field? 2.Will they provide new evidence to link existing findings? 3. Can the findings be applied to understand other disciplines, model systems, etc. 4.Are your questions addressing compelling “unknowns” in the field or simply validating existing findings (“we already know this”) ?

9. Intellectual Merit How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields?How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? Is the proposer (individual or team) well qualified to conduct the project? ( Reviewer will comment on the quality of prior work. ) ( The PI: INVESTIGATOR )Is the proposer (individual or team) well qualified to conduct the project? ( Reviewer will comment on the quality of prior work. ) ( The PI: INVESTIGATOR ) To what extent does the proposed activity suggest and explore creative and original concepts?To what extent does the proposed activity suggest and explore creative and original concepts? How well conceived and organized is the proposed activity?How well conceived and organized is the proposed activity?

10. Intellectual Merit Is the proposer (individual or team) well qualified to conduct the project? ( Reviewer will comment on the quality of prior work.) 1. Current competitive proposals are Multidisciplinary 2.Assess mechanisms at several levels of analysis, from behavior to molecules 3.If you are not an expert in an area, have you assembled a competent team of collaborators? 4.Can you document evidence of functional interactions between your lab and collaborators (papers, diss., lab rotations, etc.) ?

11. Intellectual Merit How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields?How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.)Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.) To what extent does the proposed activity suggest and explore creative and original concepts? ( Potential for being Transformative; INNOVATIVE )To what extent does the proposed activity suggest and explore creative and original concepts? ( Potential for being Transformative; INNOVATIVE ) How well conceived and organized is the proposed activity?How well conceived and organized is the proposed activity?

12. Intellectual Merit To what extent does the proposed activity suggest and explore creative and original concepts? 1.Is this “BAND WAGON” research? 2. How does your experimental approach to the question at hand differ from current or traditional approaches & techniques? 3.Will your studies only CONFIRM rather than EXTEND current knowledge? 4.Will your project address the compelling “UNKNOWNS” in the field?

13. Intellectual Merit How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields?How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.)Is the proposer (individual or team) well qualified to conduct the project? (Reviewer will comment on the quality of prior work.) To what extent does the proposed activity suggest and explore creative and original concepts?To what extent does the proposed activity suggest and explore creative and original concepts? How well conceived and organized is the proposed activity?How well conceived and organized is the proposed activity? (PROJECT PLAN/FEASIBILITY)

14. Intellectual Merit How well conceived and organized is the proposed activity?How well conceived and organized is the proposed activity? 1.Are the SPECIFIC AIMS independent of each other ? 2.Are the AIMS supported by strong Pilot findings or preliminary data? 3.Have you demonstrated that you and your team have expertise in all experimental approaches associated with the project? 4.Have you clearly articulated the advantages of your approach over currently used techniques or protocols?

15. Merit Review Criteria Merit Review Criteria Intellectual MeritBroader Impacts Advancing knowledge qualified PI ? creative and original concepts well conceived and organized ?

16. How well does the activity advance discovery & understanding while promoting teaching, training and learning?How well does the activity advance discovery & understanding while promoting teaching, training and learning? How well does the activity broaden the participation of underrepresented groups ( e.g., gender, ethnicity, disability, geographic, etc. )?How well does the activity broaden the participation of underrepresented groups ( e.g., gender, ethnicity, disability, geographic, etc. )? Will the results be disseminated broadly to enhance scientific and technological understanding? ( Data Sharing/Management Plans )Will the results be disseminated broadly to enhance scientific and technological understanding? ( Data Sharing/Management Plans ) What are the benefits of the proposed activity to society?What are the benefits of the proposed activity to society? Examples of BROADENING PARTICIPATION activities:Examples of BROADENING PARTICIPATION activities: Broader Impacts http://www.nsf.gov/pubs/gpg/broaderimpacts.pdf

17. Merit Review Criteria Merit Review Criteria Broader Impacts Advancing knowledge qualified PI ? creative and original concepts well conceived and organized advance discovery & promote learning increase participation of UR groups broad dissemination of results benefits to society

18. First page that program directors and reviewers read What: Clearly state the research objectives first Why: Is this research needed? Justification! How: Describe the major research tasks and how objectives will be met Who: Provide information on why you are the one to do this research The Project Summary/Specific Aims An Important Introduction to “Your Ideas”

19. Know your audience Hone your specific aims/research objectives Address all review criteria fully Address all special requirements Choose one or more trusted colleagues to critique your proposal (devil’s advocate) Check for compliance issues A Few More Tips

20. The Evaluation Process Types of Reviews Types of Reviews Source of Reviewers Source of Reviewers Role of the Reviewer Role of the Reviewer

21. Proposal Review and Processing Types of ReviewsTypes of Reviews

22. Types of Reviews Ad hoc: proposals sent out for review — –Ad hoc reviewers usually have specific expertise in a field related to the proposal. –Some proposals may undergo ad hoc review only (at least three). –Some proposals may undergo supplemental ad hoc reviews after a panel review. Panel review conducted at government agency by peers –Panel reviewers usually have a broader scientific knowledge. –Some proposals may undergo reviews by multiple panels (especially for those proposals with cross-cutting themes).

23. Sources of Reviewers Sources of Reviewers: –Program Officer’s knowledge of the research area –References listed in proposal –Conferences, professional society programs, S&E journal articles related to the proposal –Former reviewers’ recommendations –List of reviewers provided by PI About ten external panel reviewers per award are contacted.

24. Role of the Review Panel Discuss the merits of the proposal with the other panelists. Write a summary proposal review based on that discussion. Provide some indication of the relative merits of different proposals considered (Ratings= E, VG, G, F, P or HP, MP, LP, NC)

25. Factors Influencing the Final Decision of Program Officers

26. Proposal Review and Processing Factors Influencing Funding Decisions

27. Is it compelling, high impact science: (launching vs maintaining) Does it fit the Program’s scientific portfolio? Does it fit the Program’s special missions? ( CAREER; RUI; RIG; EPSCoR ) Does it impact the institution/state? Are there diversity strengths? Is there educational impact? Factors Considered in Developing Award Recommendations

28. Is it compelling, high impact science: (launching vs maintaining) Does it fit the Program’s scientific portfolio? Does it fit the Program’s special missions? ( CAREER; RUI; RIG; EPSCoR ) Does it impact the institution/state? Are there diversity strengths? Is there educational impact? Factors Considered in Developing Award Recommendations

29. Reasons for Declines The proposal was not considered to be competitive based on the merit review criteria and the program office concurred. The proposal had flaws or issues identified by the program office. The program funds were not adequate to fund all competitive proposals. The proposal was not a good fit for the program’s portfolio

30. Revisions and Resubmissions Points to consider: As always, if you have questions, contact the cognizant Program Officer. –Do the reviewers and the NSF Program Officer identify significant strengths in your proposal? –Can you address the weaknesses that reviewers and the Program Officer identified? –Are there other ways you or your colleagues think you can strengthen a resubmission?