1. EUROPEAN INFRASTRUCTURE FOR SCIENCE GOVERNANCE: MANAGEMENT, ACCOUNTABILITY AND ADVOCACY Julia Lane American Institutes for Research University of Strasbourg Observatoire des Sciences et des Techniques University of Melbourne

2. Overview Charge Approach Examples

3. Overview Charge Approach Examples

4. Charge in Europe Expert Group Develop a shared information infrastructure for relevant data to be collected, maintained, analysed, and disseminated across the European Union. OECD 2010 Innovation Strategy go beyond targets and aggregates in order to understand the dynamics of innovation in firms

5. How much should a nation spend on science? What kind of science? How much from private versus public sectors? Does demand for funding by potential science performers imply a shortage of funding or a surfeit of performers?......A new “science of science policy” is emerging, and it may offer more compelling guidance for policy decisions and for more credible advocacy Charge in the US

6. Another way of stating charge Ideas: Understand their Creation Transmission Adoption

7. Key Idea: Science of Science Policy Need feasible, low cost and flexible approach, so use science to describe and to manage the scientific ecosystem: Management; accountability; advocacy. Conceptual framework: Science is done by scientists (not documents) so focus on scientists and networks of scientists Empirical framework: New ways of collecting data so use new cybertools to capture information automatically Pragmatic Approach: New ways of presenting information to visualize information so public can see results of research

8. Bo-Christer Björk, 2007

10. Overview Charge Approach: Use Science Examples

11. Funding (what) Outputs (what results) People (who) Organization (where) Support Pay for Train; coauthor Produce; use Employ; provide infrastructure Scientific Ecosystem: Links Matter

12. Scientific Framework Goal of project/firm: create and transmit scientific ideas push for their adoption (by other scientists, policy-makers or businesses) Behavioral Framework; Principal Investigator has research agenda, funded by multiple sources Ideas are transmitted by workers (postdocs, grad students, staff scientists) in a variety of potentially measurable ways, including publications and patents, but also presentations, blogs, internal project workspaces, and emails (altmetrics) Behavioral Framework: Social networks/collaboration are a major vehicle whereby ideas are transmitted

13. Scientific Framework: Theory of the firm Repurposing the theory of the firm (1)Y it (1) = Y it (2) α + X it (1) λ + ε it (2)Y it (2) = Z it β +X it (2) μ + η it where the subscripts i and t denote project teams and quarters ε and η stand for unobserved factors and errors of measurement and specification (and can possibly include individual unobserved project teams’ characteristics). The output variables are measured by Y (1) and research collaboration variables by Y (2). Both are determined by a set of control variables X (1) and X (2) that can overlap and be truly exogenous or predetermined variables of key interest Z.

14. Scientific Framework: Data Observational Science Scientist gathers data by direct observation Scientist analyzes data Analytical Science Scientist builds analytical model Makes predictions. Computational Science Simulate analytical model Validate model and makes predictions Data Exploration Science Data-driven science Data captured by instrumentsror from the web, or data generated by simulation Information extraction Processed by software Placed in a database / files Scientist(s)/scholar(s) analyze(s) database / files Access crucial Jim Gray’s paradigm

15. Funding (what) Outputs (what results) People (who) Organization (where) Support Pay for Train; coauthor Produce; use Employ; provide infrastructure Scientific Ecosystem: Links Matter

16. Overview Charge Approach Examples

17. Accountability: Show results to stakeholders … To help find researchers and research by geography, organization, class and topic Examples: White House R&D Dashboard; ASTRA

18. Advocacy: Show public/private partnerships To document collaborations in the invention process Examples: HELIOS project in France

19. Management: Describe networks NIH-supported milestone discovery event

20. Management: STAR METRICS: Private university, Med LIGO, Astrophysics, Dark Matter, Simulation, Quantum Information Liquid Crystal Ocean Science, Plate Tectonics, Seismology Inorganic Chemistry Plants, DNA Molecular Dynamics, Numerical Methods, Turbulence, Seismology Control Theory, Sensor Networks, Optimization, Seismology Source: Jason Owen Smith, U Michigan

21. Management: Comparison of Social Networks Private (no Med)Public (no Med)Public (Med) 2000 people paid by 450 science agency grants 4000 people paid by 900 science agency grants 5000 people paid by 3500 science agency grants 26.8% Isolated31.3% isolated13.6% isolated 53.8% Reachable10.6% Reachable28.4% Reachable Density =.038, CC =.896, Constraint =.321 Density =.007, CC =.877, Constraint =.425 Density =.007, CC =.878, Constraint =.483 Research Staff (shared instrumentation?) & faculty are powerful bridges Faculty are more often powerful bridges, but very little reachability and diversity Faculty and Research staff bridge projects Potential topic gaps in component Topic gaps less clearSignificant connections and overlaps between topics in component

22. Advocacy: Describe patent portfolios To describe patent activities to inventors and the public Example: NSF Portfolio Explorer

23. Another way of stating charge Ideas: Understand their Creation Transmission Adoption

24. Key Idea: Science of Science Policy Need feasible, low cost and flexible approach, so use science to describe and to manage the scientific ecosystem. Conceptual framework: Science is done by scientists (not documents) so focus on scientists and networks of scientists Empirical framework: New ways of collecting data so use new cybertools to capture information automatically Pragmatic Approach: New ways of presenting information to visualize information so public can see results of research

25. Thank you Julia Lane jlane@air.org