1. Organizational Funding Portfolios and Beyond: Assessing the Full Research Landscape Panel Session 731 American Evaluation Association EVALUATION 2012 October 27, 2012

2. Session Presenters Elizabeth Hsu Session Chair Duane Williams Assessing the Alignment of Current Research Landscape with a Strategic Plan for Advancing Autism Research Samantha Finstad Informing Initiative Development through Portfolio Analysis: Assessment of the Provocative Questions Elizabeth Hsu Assessment of Proposed Research: National Cancer Institute Provocative Questions Initiatives Case Study

3. National Cancer Institute National Eye Institute National Heart, Lung and Blood Institute National Human Genome Research Institute National Institute on Aging National Institute on Alcohol Abuse And Alcoholism National Institute of Diabetes & Digestive & Kidney Diseases National Institute on Deafness and Other Communication Disorders Eunice Kennedy Shriver National Institute of Child Health and Human Development National Institute of Biomedical Imaging and Bioengineering National Institute of Arthritis & Musculoskeletal & Skin Diseases National Institute of Allergy and Infectious Diseases National Institute of Dental and Craniofacial Research National Institute on Drug Abuse National Institute of Environmental Health Sciences National Institute of General Medical Sciences National Institute of Mental Health National Institute on Minority Health & Health Disparities National Institute of Neurological Disorders and Stroke National Institute of Nursing Research National Library of Medicine John E. Fogarty International Center for Advanced Study in The Health Sciences National Center for Advancing Translational Science National Center for Complementary & Alternative Medicine Clinical Center Center for Information Technology Center for Scientific Review Office of the Director National Institutes of Health

4. About the National Institutes of Health (NIH) Primary US agency for supporting and conducting biomedical research Invests > $30B in biomedical research >80% funding awarded through nearly 50,000 competitive grants to >325,000 researchers at >2,500 research institutions About 10% funding supports nearly 6,000 intramural researchers

5. Common Uses of Portfolio Analysis Program planning Progress monitoring Evaluation Impact assessment

6. Portfolio Analysis Challenges Obtaining a reasonably accurate high-level overview of the entire research field or portfolio supported by an organization Determining how a portfolio fits into the larger research community Identifying key gaps that represent opportunities to stimulate scientific progress

7. Questions Addressed What does the research landscape look like as a whole? Are there portfolio gaps in need of a new initiative? Are proposed projects addressing identified gaps?