The Influence of Domain-Specific Metric Development on Evaluation and Design: An Example from National Institutes of Health Technology Development Programs.

Slides:

Advertisements

Similar presentations

NIH T-32 Application Ruth L. Kirschstein National Research Service Award Institutional Research Training Grants

Advertisements

What’s NIH? National Cancer Institute National Eye Institute National Heart, Lung, and Blood Inst. National Human Genome Research Inst National Institute.

NIH Academic Research Enhancement Award (AREA) R15 AASCU November 5, 2009 Mary Ann Guadagno, PhD Office of Extramural Research National Institutes of Health.

Office of Research Support.  Departmental Grant Manager – Enters information into SPS.  Sponsored Projects System (SPS) is where Grant Managers can.

1 Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

NIH F-31 Application Ruth L. Kirschstein National Research Service Awards for Individual Predoctoral Fellowships to Promote Diversity in Health-Related.

1 NIH Supports Biomedical and Behavioral Research Around the Globe Including Scientists at Institutions in over 90 Countries! ARGENTINA AUSTRALIA BELGIUM.

National Institutes of Health K awards Margie Lee Dept Population Health BHSI Fellowship Writing Workshop Phase 1 – Feb 5, 2011.

American Evaluation Association EVALUATION 2011 November 3, 2011 Approaches to Biomedical Research and Development Portfolio Analysis: Examples From the.

ACADEMIC RESEARCH ENHANCEMENT AWARD AREA (R15) Paula Flicker.

How to get funded from the National Institutes of Health Minda R. Lynch, Ph.D., Chief Behavioral and Cognitive Science Research NIDA.

1 Jo Anne Goodnight SBIR/STTR Program Coordinator Office of Extramural Research, NIH AdvaMed2008 Entering the North American.

OPERA Fundamentals of the NIH Grants Process George Gardner Office of Policy for Extramural Research Administration October 28, 2008.

Weathering the Storm: How to Establish and Sustain an Independent Research Career in an Era of Limited Funds Lawrence J. Prograis, Jr., M.D Senior Scientist,

NIH Regional Seminars 2014 Sally A. Amero, Ph.D.Dana Plude, Ph.D. NIH Review Policy OfficerBiobehavioral and Behavioral Processes IRG National Institutes.

U.S. Department of Health and Human Services National Institutes of Health National Heart, Lung, and Blood Institute James P. Kiley, Ph.D. National Heart,

GRANTS FOR GRADUATE STUDENTS WHAT YOU NEED TO KNOW ABOUT GRANTS, PROPOSALS, AND SPONSORED RESEARCH.

NIH OBSSR Summer Institute July 2012 National Institutes of Health U.S. Department of Health and Human Services Overview of the NIH Peer Review Process.

NIH Regional Seminars 2015 Sally A. Amero, Ph.D.Dana Plude, Ph.D. NIH Review Policy OfficerBiobehavioral and Behavioral Processes IRG National Institutes.

1 NIH Summer Training Institute Funding Opportunities at NICHD Valerie Maholmes, Ph.D., CAS Eunice Kennedy Shriver National Institute of Child Health &

NIH K-08 Application Mentored Clinical Scientist Research Career Development Award

Gene Ontology Project

Short Overview of the NIH SBIR/STTR Program “Lab to Life”

Bethesda, MD. NCI National Cancer Institute NCCAM National Center for Complementary and Alternative Medicine NCMHD National Center for Minority Health.

“The Grant Proposal Pathway” Hypothesis: Understanding what happens to a proposal between the time it is submitted and a funding decision is made will.

It’s Groovy to be a Newbie! Sally Rockey, Ph.D. NIH Deputy Director for Extramural Research.

Working with NIH Program Officials: Pre-Award & Post-Award Shawn Gaillard, NIGMS and Francisco Sy, NIMHD 2013 NIH Regional Seminar, Baltimore, MD.

Peer Review of NIH Research Grant Applications Center for Scientific Review National Institutes of Health.

Mouse; NOTC1; Q01705 Function: protein binding Process: Notch signaling pathway Process: positive regulation of transcription from RNA polymerase II promoter.

NIAID Commitment to Influenza Research and Preparedness F. Gray Handley Associate Director for International Research Affairs National Institute of Allergy.

Office of the Director National Institute on Alcohol Abuse and Alcoholism National Institute on Alcohol Abuse and Alcoholism National Institute of Arthritis.

Avrom Caplan, PhD Associate University Dean for Research

Computational Sciences within NIGMS Protein Ontology Meeting, Georgetown, June 18, 2014 Veerasamy “Ravi” Ravichandran, Ph.D. Program Director Biomedical.

NIH International Programs

The Review of Your NIH Grant Application Begins Here Richard Nakamura, Ph.D. Director NIH Center for Scientific Review.

NIH K-01 Application Mentored Research Scientist Development Award

American Evaluation Association EVALUATION 2009 November 14, 2009 Building Data Systems to Support Evaluation in a Biomedical Research and Development.

Innovation Corps (I-Corps) at NIH: Hypothesis-Driven Customer Discovery for SBIR/STTR Grantees Bench 2 Business (B2B) – University of Kentucky May 19,

The Grant Renewal Review Process Nywana Sizemore, PhD Scientific Review Officer Molecular Oncogenesis - MONC Oncology I - Basic Translational - OBT Integrated.

National Institutes of Health. Much of the biomedical research in the United States is supported by the Federal Government, primarily the National Institutes.

Jo Anne Goodnight NIH SBIR/STTR Program Coordinator NIH Mission Improve human health through biomedical and behavioral research, research training and.

NIH Grant Renewal Review Process (and Beyond)

NIH Peer Review Process – Grant Renewal

Center for Scientific Review (CSR). Office of the Director National Institute on Alcohol Abuse and Alcoholism National Institute on Alcohol Abuse and.

An Overview of Peer Review at CSR – Critical Do’s and Don’ts Joy Gibson, D.Sc. Director, Division of Translational and Clinical Sciences American Association.

BME 301 Lecture Twenty-Three. How are health care technologies managed? Examples: MRI Laparoscopic cholecystectomy Vitamin C treatment for scurvy Research.

NIH F-32 Application Ruth L. Kirschstein National Research Service Awards for Individual Postdoctoral Fellowships

The Search for a “Better Way:” Reauthorization of the National Institutes of Health Elias A. Zerhouni, M.D., Director, NIH July 19, 2005 House Energy and.

The NIH Funding Process Peggy McCardle, PhD, MPH Child Development & Behavior Branch National Institute of Child Health & Human Development We wish to.

NIH Peer Review Process – Grant Renewal Angela Y Ng, MBA, PhD Scientific Review and Referral Officer Center for Scientific Review NCI DCB New Grantee Workshop.

Gene Ontology Project

NIH Grant Writing Tips Kelli A. Komro, MPH, PhD Associate Professor, Department of Epidemiology and Health Policy Research, COM Associate Director, Institute.

“The Grant Proposal Pathway” Hypothesis: Understanding what happens to a proposal between the time it is submitted and a funding decision is made will.

Office of Research Support.  Departmental Grant Manager – Enters information into SPS.  Sponsored Projects System (SPS) is where Grant Managers can.

NIH Regional Seminars 2015 Sally A. Amero, Ph.D.Weijia Ni, Ph.D. NIH Review Policy OfficerChief, RPHB, Center for Scientific Review National Institutes.

Organizational Funding Portfolios and Beyond: Assessing the Full Research Landscape Panel Session 731 American Evaluation Association EVALUATION 2012 October.

Science for Global Health: Fostering International Research Collaboration James Herrington, PhD, MPH Director Division of International Relations Fogarty.

How to get funded from the National Institutes of Health Minda R. Lynch, Ph.D., Chief Behavioral and Cognitive Science Research NIDA.

Jeanne McDermott, PhD,MPH,CNM Program Officer Division of International Training and Research Fogarty International Center National Institutes of Health.

NIH HIV/AIDS Research Priorities

HIV/AIDS Implementation Science Research Across NIH: Recent Highlights, Current Priorities, and Partners Christopher Gordon, PhD Branch Chief, Division.

Funding Opportunities at the NIH-funded Centers for AIDS Research

NIH HIV/AIDS Research Priorities

Understanding NIH Peer Review

American Evaluation Association

NIH Study Section Review Process

“How Can Providers Address the Lack of R01 Studies. ” Robert H

The NIH Peer Review Process

Peer Review of NIH Research Grant Applications

Overview of the Health & Human Services SBIR/STTR Programs

Presentation transcript:

The Influence of Domain-Specific Metric Development on Evaluation and Design: An Example from National Institutes of Health Technology Development Programs Panel session 1539 American Evaluation association Evaluation 2016 October 27, 2016

Development of Measures to Assess NIH Technology Development Programs Presenters Brian Zuckerman Development of Measures to Assess NIH Technology Development Programs Jennifer Pohlhaus Process and Outcome Evaluation of the NCI Innovative Molecular Analysis Technologies (IMAT) Program Michelle Berny-Lang Technology Program Office Perspective on Identifying Appropriate Metrics Elizabeth Hsu How Does Technology Development Metric Development Influence Evaluation Design?

National Institutes of Health National Cancer Institute National Eye National Heart, Lung and Blood National Human Genome Research National Institute on Aging National Institute on Alcohol Abuse And Alcoholism of Diabetes & Digestive & Kidney Diseases on Deafness and Other Communication Disorders Eunice Kennedy Shriver of Child Health and Human Development of Biomedical Imaging and Bioengineering of Arthritis & Musculoskeletal & Skin Diseases of Allergy and Infectious Diseases National Institute of Dental and Craniofacial Research on Drug Abuse Environmental Health Sciences of General Medical Sciences of Mental Health National Institute on Minority Health & Health Disparities of Neurological Disorders and Stroke of Nursing Research National Library of Medicine John E. Fogarty International Center for Advanced Study in The Health Sciences National Center for Advancing Translational Science Complementary & Alternative Medicine Clinical Center Center for Information Technology Center for Scientific Review Office of the Director Office of Intramural Research Extramural Research

About the National Institutes of Health (NIH) Primary US agency for supporting and conducting biomedical research Invests nearly $32.3B in biomedical research >80% funding awarded through nearly 50,000 competitive grants to >300,000 researchers at >2,500 research institutions ~10% supports nearly 6,000 intramural investigators NIH does not publicly report estimates of funding supporting technology development

Motivation Explore domain-specificity with the field of research, technology, and development evaluation in the context of assessing NIH-funded projects with the primary purpose of technology development Metrics are often developed on an evaluation-by-evaluation and program-by- program basis Recognition of need for metrics to objectively assess a set of differing programs with similar objectives Provide guidance on best practices/strategies for future program and evaluation design Provide perspectives across all stakeholders in the evaluation design Program manager Evaluation professional developing domain-specific metrics Evaluation professional who must implement evaluation based on proposed metrics