Moving Toward Quantitative Evidence-based Science Policy: Science of Science Policy Developmental Efforts In Theory, Evaluation Methods, and Data Infrastructure.

Slides:

Advertisements

Similar presentations

Manatt manatt | phelps | phillips New York State Health Information Technology Summit Initiative Overview and Update Rachel Block, Project Director United.

Advertisements

Federal Guidance on Statistical Use of Administrative Data Shelly Wilkie Martinez, Statistical and Science Policy, OIRA U. S. Office of Management and.

1 Performance Assessment An NSF Perspective MJ Suiter Budget, Finance and Awards NSF.

The Federal Budget Outlook and NSF Presented by Beth Blue National Science Foundation Office of Budget, Finance, and Award Management Budget Division/Program.

THE NSF BUDGET Overview of Agency Funding Processes Presented by Beth Blue National Science Foundation Office of Budget, Finance, and Award Management.

Stimulating Research on Science of Science & Innovation Julia Lane, NSF.

Promoting Convergence Toward Better Institutions William E. Kovacic George Washington University Law School March 30, 2005.

Business & Operations Advisory Committee -- March 31, Performance Assessment.

N84 UNCLASSIFIED Rear Admiral Dave Titley, Ph.D. Oceanographer of the Navy / Director Task Force Climate Change October 15, 2009 This Presentation is Unclassified.

Cost Sharing Update Facilities, Equipment & Other Resources – New format will assist proposers in complying with NSF cost sharing policy and is a required.

Science of Science and Innovation Policy (SciSIP) Presentation to: SBE Advisory Committee By: Dr. Kaye Husbands Fealing National Science Foundation November.

NOAA Science Advisory Board The U.S. Climate Change Science Program Strategic Plan James R. Mahoney, Ph.D. Assistant Secretary of Commerce for Oceans and.

Testing a Strategic Evaluation Framework for Incrementally Building Evaluation Capacity in a Federal R&D Program 27 th Annual Conference of the American.

The "Earth Cube” Towards a National Data Infrastructure for Earth System Science Presentation at WebEx Meeting July 11, 2011.

Roadmap Name Strategic Roadmap #n Interim Report April 15, 2005.

Framework for Improving Critical Infrastructure Cybersecurity Overview and Status Executive Order “Improving Critical Infrastructure Cybersecurity”

BRAIN: Brain Research through Advancing Innovative Neurotechnologies Announced by President Obama in February 2013 as part of FY 2014 Budget Request to.

Short- and Long-term Economic Impacts of S&T Investments: Data Issues Science of Science Policy Interagency Group.

Geospatial Platform Update Migration of GOS to Data.gov Rob Dollison GOS Project Manager FGDC Metadata Summit 10/26/11.

Office of the Federal Coordinator for Meteorology OFCM Opening Remarks and WG/WIST Activities Update Paul Pisano Mike Campbell WG/WIST Cochairs June 6,

ADD Perspectives on Accountability Where are We Now and What does the Future Hold? Jennifer G. Johnson, Ed.D.

AST Portfolio Review Tom Statler, NSF/AST AAAC Telecon, 11 May 2012.

Using Evidence to Guide Social Policy and Spending Ron Haskins March 1, 2012.

National Science Foundation 1 Evaluating the EHR Portfolio Judith A. Ramaley Assistant Director Education and Human Resources.

Theme 2: Investing in Science and Innovation Summary December 4, 2008.

1 Investing in America’s Future The National Science Foundation Strategic Plan for FY Advisory Committee for Cyberinfrastructure 10/31/06 Craig.

FY13 Accomplishments 1 Update to the Board of Research Data on Information CENDI INCREASING THE IMPACT OF FEDERALLY FUNDED SCIENCE September 23, 2013 Jerry.

Award Monitoring Update National Science Foundation Advisory Committee for Business and Operations October 22, 2003 Mary Santonastasso, Director, Division.

BFA Update National Science Foundation Advisory Committee for Business and Operations March 31, 2004 Tom Cooley NSF Chief Financial Officer Director, Office.

Introduction & NSF Overview NSF Tribal College Workshop November 14, 2008.

Integrating Administrative Records into the Federal Statistical System 2.0 Shelly Wilkie Martinez Statistical and Science Policy U. S. Office of Management.

ADBC: Background, Broader Impacts and Opportunity Anne Maglia Program Director, Division of Biological Infrastructure National Science Foundation

Theme 1: Understanding Science and Innovation Summary December 4, 2008.

How many sizes are needed to fit all research data? Todd Vision Associate Director for Informatics National Evolutionary Synthesis Center Associate Professor.

STEPHANIE SHIPP SCIENCE & TECHNOLOGY POLICY INSTITUTE AMERICAN EVALUATION ASSOCIATION NOVEMBER 12,2009 Science of Science Policy: Making.

AAU Undergraduate STEM Education Initiative Tobin Smith AAU Vice President for Policy ISSUES Workshop January 30, 2014.

Climate Adaptation M&E in the US An Overview of the Practice SEA Change CoP Meeting Bangkok – November 2011 Steve Adams Senior Advisor - Adaptation.

Interagency Collaborations Sharing Facilities and Testbeds Jointly Supporting Facilities and Testbeds Renting Other Agency Facilities and Testbeds Rapid.

Finding Partners, Creating Impact Rusty Low Poles Together Workshop NOAA Boulder, CO July 20-22, 2005.

Draft Modernization Roadmap for the Geospatial Platform Karen Siderelis NGAC Meeting March 25,2010.

1 U.S. Census Bureau Census Bureau’s FY 2010 Priority Setting Process Thomas L. Mesenbourg June 16, 2010.

Federal Science and Water Gene Whitney Office of Science and Technology Policy Executive Office of the President NIWR February 28, 2006.

Materials Innovation Platforms (MIP): A New NSF Mid-scale Instrumentation and User Program to Accelerate The Discovery of New Materials MRSEC Director’s.

Geospatial LoB: Lifecycle WG Update November 3, 2009.

What Might a Theory-Based Roadmap for Prospective Evaluation and Developing Innovation Policy Look Like? Presented at American Evaluation Association Conference.

Federal Software Asset Management Initiative Concept of Operations Report to the Executive Steering Committee March 8, 2004 Implementing the President’s.

1 Investing in America’s Future The National Science Foundation Strategic Plan for FY OPP Advisory Committee 10/26/06.

CENDI Update to the Board of Research Data and Information Bonnie C. Carroll Executive Director CENDI Secretariat.

1 Strategic Plan Review. 2 Process Planning and Evaluation Committee will be discussing 2 directions per meeting. October meeting- Finance and Governance.

OMB Circular A-16 Supplemental Guidance (Endorsed) Ivan DeLoatch, Staff Director Lew Sanford Jr. & Wendy Blake-Coleman NGAC Meeting, February 4, 2009.

Federal Networking and Information Technology R&D Program National Coordination Office.

1Office of the Federal Coordinator for Meteorology OFCM OFCM Special Session: Uncertainty in Atmospheric Transport and Diffusion (ATD) Models Setting the.

BIO AC November 18, 2004 Broadening the Participation of Underrepresented Groups in Science.

New Framework for Strategic Goal Assessment NSF Advisory Committee for Business and Operations November 8-9, 2006 Tom Cooley, Director, BFA.

NITRD Networking and ITRD IT R&D CIC computing, info and comm HPCC and communication HPC high-performance computing George O. Strawn NITRD co-chair and.

© Copyright IBM Corporation 2009 Advanced Learning Institute December 2009 Obama Administration: A Status Update on Its Open Government Initiative John.

OSAE sets the PACE: Premier Auditing Consulting and Evaluations! American Recovery and Reinvestment Act (ARRA) Readiness Review.

Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.

U.S. National Space Weather Strategy Coordination Group for Meteorological Satellites 5 June 2016 Bill Murtagh Assistant Director for Space Weather Office.

BUILDING DATA INFRASTRUCTURES LESSONS LEARNED Julia Lane New York University American Institutes for Research University of Strasbourg University of Melbourne.

David M. Murray, Ph.D. Associate Director for Prevention Director, Office of Disease Prevention Multilevel Intervention Research Methodology September.

Evaluation in the Obama Administration Presented By George F. Grob Center for Public Program Evaluation November 2010.

Using Administrative Data for Federal Program Evaluation

NSF INCLUDES – DESIGN AND DEVELOPMENT LAUNCH PILOTS

Lab-to-Market USDA Outcomes 2015

Office of Secretary of Defense

Unidata Policy Committee Meeting

Warning Signs: Effects of Proposed Federal Funding Cuts to Environmental and Climate Research and Development Programs novim.org/budget Kei Koizumi.

The Curry School of Education October 3, 2018

Presentation transcript:

Moving Toward Quantitative Evidence-based Science Policy: Science of Science Policy Developmental Efforts In Theory, Evaluation Methods, and Data Infrastructure Kei Koizumi November 12, 2009 for the American Evaluation Association

An interagency collaboration (16 agencies or offices) with three guiding themes and ten key questions

3 The SOSP Roadmap Science Questions 1.What Are The Behavioral Foundations Of Innovation? 2.What Explains Technology Development, Adoption And Diffusion? 3.How And Why Do Communities Of Science And Innovation Form And Evolve? 4.What Is The Value Of The Nation’s Public Investment In Science? 5.Is It Possible To “Predict Discovery”? 6.Is It Possible To Describe The Impact Of Discovery On Innovation? 7.What Are The Determinants Of Investment Effectiveness? 8.What Impact Does Science Have On Innovation And Competitiveness? 9.How Competitive Is The U.S. Scientific Workforce? 10.What Is The Relative Importance Of Different Policy Instruments In Science Policy? The National Imperative Theme 3: Using the Science of Science Policy to Address National Priorities Theme 2: Investing in Science and Innovation Theme 1: Understanding Science and Innovation Recommendations Findings Themes

Science of Science Policy in the Obama Administration There is a new charter for the Interagency Task Group to carry through the SoSP roadmap. There is a new charter for the Interagency Task Group to carry through the SoSP roadmap. Science and technology are high priorities in the ARRA, the 2010 Budget, and in planning for the 2011 budget. Science and technology are high priorities in the ARRA, the 2010 Budget, and in planning for the 2011 budget. Openness and transparency are high priorities: data.gov, open.gov and recovery.gov are examples. Openness and transparency are high priorities: data.gov, open.gov and recovery.gov are examples. Evidence-based policy and evaluation are also priorities: OMB Director Orszag has issued numerous statements, including an October 7 Evaluation memo. Evidence-based policy and evaluation are also priorities: OMB Director Orszag has issued numerous statements, including an October 7 Evaluation memo. Agencies are collaborating to build a new data infrastructure to be able to evaluate R&D investments (STAR pilot). Agencies are collaborating to build a new data infrastructure to be able to evaluate R&D investments (STAR pilot).

See scienceofsciencepolicy.net A Science of Science Policy Community website, with a new version coming soon

OMB / OSTP “R&D Priorities Memo” for FY 2011 Budget (see

OMB / OSTP “R&D Priorities Memo” for FY 2011 Budget “Agencies should describe the expected outcomes from their research in relation to… practical challenges and cross-cutting areas, providing quantitative metrics where possible.” “Agencies should describe the expected outcomes from their research in relation to… practical challenges and cross-cutting areas, providing quantitative metrics where possible.” “Federal agencies… should develop datasets to better document Federal science and technology investments and to make these data open to the public in accessible, useful formats.” “Federal agencies… should develop datasets to better document Federal science and technology investments and to make these data open to the public in accessible, useful formats.” “Agencies should develop outcome-oriented goals for their science and technology activities, establish procedures and timelines for evaluating the performance of these activities…” “Agencies should develop outcome-oriented goals for their science and technology activities, establish procedures and timelines for evaluating the performance of these activities…” “Agencies should develop ‘science of science policy’ tools that can improve management of their [R&D] portfolios and better assess the impact of their [S&T] investments.” “Agencies should develop ‘science of science policy’ tools that can improve management of their [R&D] portfolios and better assess the impact of their [S&T] investments.”

Next Steps Feedback from the December 2008 Workshop shaped a set of interagency research priorities addressing the scientific challenges confronting the unique science policy analysis needs of Federal agencies: Developing a Data Infrastructure for Science and Innovation Policy; Modeling; Creating an Innovation Framework; Informing and Assessing R&D Investments (workshop in October 2009); and Conducting Outreach to Underrepresented Populations. The next workshop in 2010 will be for NSF Science of Science & Innovation Policy (SciSIP) Grantees: Presentations and Findings from the current Pis; Keynotes and discussions from practitioner community