Republic of Slovenia Slovenian Research Agency Tivolska 30 Ljubljana, Slovenia Dr. Franci Demšar Directorhttp:// Maribor, 5. June 2008

Young country with rich scientific culture! The begining of science and technology to the late Middle Ages –First book in Slovenian language –University of Ljubljana –Slovenian Academy of Science and Arts –modern research institutes - after 2. world war –parallel and complementary concept of S&T policy from 60’s –autonomous institutional construction of S&T policy from 1991

Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

Institutional design and position of the SRA Operational level Science & technology council Government of the RS Strategic level MHEST Other ministries Policy level Ministry of Defence SRA Executive level Scientific Community

SRA main areas of operation Promotion of excellent and applicative research Monitoring and analysing Funding of research Objective evaluation

A brief description of the SRA logo A graphic image of the manuscript of the Logarithm Tables by Slovenian mathematician, physicist and artillery officer Jurij Vega.

Establishing: November 2004, Government of the Republic of Slovenia Status: a legal person of public law; indirect user of the budget of the Republic of Slovenia Mission: performing professional tasks relating to implementation of the adopted National Research and Development Programme Budget: 150 million € per year (2006)

Total ARRS research funding by budget category (2007)  150 Mio €

Slovenian budget for S&T, (public sources) MHESTSRA SAZU ME MIS MD

Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

Institutional research landscape 4 Universities: –University of Ljubljana (26 faculties) –University of Maribor (12 faculties) –University of Primorska (7 faculties) –University of Nova Gorica (6 faculties) National Research Institutes (15) Private (non-profit) Research Institutes (ca. 100) Research unites in business (ca. 300)

Evolution of research organizations in Slovenia

Number of Researchers in FTE Change in % Business sector Public sector Higher-education sector Private non-for profit sector Sum

Share of changes of researchers in last ten years

Number of female researchers in FTE by sector of performance

Government funding of R&D in 90’s:

R&D expenditure as a proportion of GDP (%) in Slovenia and in selected countries

Expenditures (in €) for R&D per inhabitant

Comparative structure of the sources of financing R&D expenditure

Funding from different sources as a % share of RD expenditure by sector of performance Fi

Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

Comparison of the structure of publishing

Intensity of changes for publications and citations

Number of EU patent applications per million population, 2004

Annual growth of EU patent applications

Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

Research evaluation system in Slovenia CRITERIAMETHODSINDICATORS Scientific quality “Quality of proposals” Peer reviewExperts ranking (contents, 5-top outputs…) Scientific outputs “Quality of research teams” BibliometricsCOBISS, citations Socio-economic relevance Technometrics Transfer of knowledge (cooperation with non-academics, contracts - money)

Bodies, participating in the evaluation process SRA scientific council of the discipline Temporary body for projects evaluation Nomination of the body Peers Scientific merit Socio-economic sign. Selected by the body Panel of experts

Evaluation system Evaluation made by the panel on the basis of peer review (international) – 2 per project Final priority list of projects Panel: scientific body & international peers Scientific Council of the Agency Short project applications - outline Projects selected on the basis of A1 + A2 + A3 & B1 + B2 + B3 100 % of available quota Projects selected on the basis of expert panel assessment 100 % of available quota Call for submission of full proposals Assessments are send to applicants I. phase II. phase Just selected projects are invited

Main principles of the evaluation - 1 Quantitative criteria Quality of scientific records –Mark A 1 – publications in last 5 years SICRIS (cobiss) –Mark A 2 – standardized number of citations (WoS) Scientific and socio-economic relevance –Mark A 3 – money from sources other that SRA

Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

The role of transparency in research policy Enables accountability of public servants and reduces potentials of corruption Enhance the identification with solutions Resolves the (potential) conflict of interests Increased effectiveness because of the “invisible hands of public” Transparency = corruption 1

Milestones in developing transparency 1958 – first report on work of Boris Kidrič Fund 1994 – creation of centralised bibliographic system (COBISS) 1997 – first “White book on financing” published in the Internet 1997 – obligatory inclusion of bibliographies into COBISS 1998 – Development of Slovenian Current Information System (SICRIS) 1998 – timetable for all national calls published in internet a year in advance 2006 – online “White book on financing” where all transactions are presented in a real time

Key element of the system – legitimacy of procedures Inclusion of researchers in different points of the procedure e.g. Evaluation methodology – unique for each field of science SRA Scientific Council Scientific Council of the Discipline Researchers

ARRS and Transparency

Elements of transparency 1.Transparency of instruments 2.Transparency of Procedures 3.Financial Transparency 4.Transparency of results of the research

Elements of transparency 1.Transparency of instruments –Annual plan of public calls –Timetable of evaluation process –Guidelines prepared by the Ministry of higher education science and technology; –Published names peers and members of decision-making bodies

Annual plan of public calls

Timetable of evaluation process

Guidelines prepared by the Ministry

Elements of transparency 2.Transparency of procedures –Evaluation methodology – unique for each field of science –Transparent membership in expert bodies (published on SRA home page) –Procedure of peers selection is known in advance –Evaluation criteria (questions for peers) are prepared, adopted and published in advance –Publicly available results of selection process

Evaluation methodology

Results of evaluation

Elements of transparency 3.Financial Transparency –Annual financial reports (White book on financing) –Up-to date overview of distribution of budget (online white book)

Annual report on financing

Up-to date financing overview

Elements of transparency 4.Transparency of research results –Use of COBISS bibliographic system –Use of SICRIS system and its abstracts of research work The most important scientific results Socio-economic significance of research –Use of international citation indexes (ISI, CSA and other bibliographic databases –In the future implementation of full text database

COBISS bibliographic system

2. SPLICHAL, Slavko. The principle of publicity, public use of reason and social control. Media cult. soc., 2002, let. 24, št. 1, str [COBISS.SI-ID ], [WoS, št. citatov do : 0, brez avtocitatov: 0] JCR IF: 0.236, x: 0.611; sociology; 74/93 kategorija: 1B2 (Z1); tipologijo je verificiral OSICD točke: 40, št. avtorjev: WoS 3. SPLICHAL, Slavko. Bentham, Kant and the right to communicate. Crit. rev. (N.Y. N.Y.), Summer/Fall 2003, let. 15, no. 3/4, str [COBISS.SI-ID ], [WoS, št. citatov do : 1, brez avtocitatov: 0] JCR IF:, x: 0.468; social sciences, interdisciplinary; 55/55 kategorija: 1B2 (Z1); tipologijo je verificiral OSICD točke: 40, št. avtorjev: WoS

SICRIS information system

International citation indexes

Publications in scientific journals with ISI index

Thank you for your attention!