1. Republic of Slovenia Slovenian Research Agency Tivolska 30 Ljubljana, Slovenia Dr. Franci Demšar Directorhttp://www.arrs.gov.si/sl/ Maribor, 5. June 2008

2. Young country with rich scientific culture! The begining of science and technology to the late Middle Ages –First book in Slovenian language - 1550 –University of Ljubljana - 1919 –Slovenian Academy of Science and Arts - 1938 –modern research institutes - after 2. world war –parallel and complementary concept of S&T policy from 60’s –autonomous institutional construction of S&T policy from 1991

3. Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

4. Institutional design and position of the SRA Operational level Science & technology council Government of the RS Strategic level MHEST Other ministries Policy level Ministry of Defence SRA Executive level Scientific Community

5. SRA main areas of operation Promotion of excellent and applicative research Monitoring and analysing Funding of research Objective evaluation

6. A brief description of the SRA logo A graphic image of the manuscript of the Logarithm Tables by Slovenian mathematician, physicist and artillery officer Jurij Vega.

7. Establishing: November 2004, Government of the Republic of Slovenia Status: a legal person of public law; indirect user of the budget of the Republic of Slovenia Mission: performing professional tasks relating to implementation of the adopted National Research and Development Programme Budget: 150 million € per year (2006)

8. Total ARRS research funding by budget category (2007)  150 Mio €

9. Slovenian budget for S&T, 2005-2009 (public sources) MHESTSRA SAZU ME MIS MD

10. Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

11. Institutional research landscape 4 Universities: –University of Ljubljana (26 faculties) –University of Maribor (12 faculties) –University of Primorska (7 faculties) –University of Nova Gorica (6 faculties) National Research Institutes (15) Private (non-profit) Research Institutes (ca. 100) Research unites in business (ca. 300)

12. Evolution of research organizations in Slovenia

13. Number of Researchers in FTE 199520002006 Change in % 1995-2006 Business sector 1.3991.3802.26262 Public sector 1.6071.4951.80412 Higher-education sector 1.7571.3401.740 Private non-for profit sector 13412128- 80 Sum 4.8974.3365.83419

14. Share of changes of researchers in last ten years

15. Number of female researchers in FTE by sector of performance

16. Government funding of R&D in 90’s:

17. R&D expenditure as a proportion of GDP (%) in Slovenia and in selected countries

18. Expenditures (in €) for R&D per inhabitant

19. Comparative structure of the sources of financing R&D expenditure

20. Funding from different sources as a % share of RD expenditure by sector of performance Fi

21. Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

22. Comparison of the structure of publishing

23. Intensity of changes for publications and citations

25. Number of EU patent applications per million population, 2004

26. Annual growth of EU patent applications

28. Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

29. Research evaluation system in Slovenia CRITERIAMETHODSINDICATORS Scientific quality “Quality of proposals” Peer reviewExperts ranking (contents, 5-top outputs…) Scientific outputs “Quality of research teams” BibliometricsCOBISS, citations Socio-economic relevance Technometrics Transfer of knowledge (cooperation with non-academics, contracts - money)

30. Bodies, participating in the evaluation process SRA scientific council of the discipline Temporary body for projects evaluation Nomination of the body Peers Scientific merit Socio-economic sign. Selected by the body Panel of experts

31. Evaluation system Evaluation made by the panel on the basis of peer review (international) – 2 per project Final priority list of projects Panel: scientific body & international peers Scientific Council of the Agency Short project applications - outline Projects selected on the basis of A1 + A2 + A3 & B1 + B2 + B3 100 % of available quota Projects selected on the basis of expert panel assessment 100 % of available quota Call for submission of full proposals Assessments are send to applicants I. phase II. phase Just selected projects are invited

32. Main principles of the evaluation - 1 Quantitative criteria Quality of scientific records –Mark A 1 – publications in last 5 years SICRIS (cobiss) –Mark A 2 – standardized number of citations (WoS) Scientific and socio-economic relevance –Mark A 3 – money from sources other that SRA

33. Contents: About Slovenian Research Agency Some facts about the research system in Slovenia Trends of outputs of research activities in Slovenia Research evaluation system of SRA Transparency of the SRA work

34. The role of transparency in research policy Enables accountability of public servants and reduces potentials of corruption Enhance the identification with solutions Resolves the (potential) conflict of interests Increased effectiveness because of the “invisible hands of public” Transparency = corruption 1

35. Milestones in developing transparency 1958 – first report on work of Boris Kidrič Fund 1994 – creation of centralised bibliographic system (COBISS) 1997 – first “White book on financing” published in the Internet 1997 – obligatory inclusion of bibliographies into COBISS 1998 – Development of Slovenian Current Information System (SICRIS) 1998 – timetable for all national calls published in internet a year in advance 2006 – online “White book on financing” where all transactions are presented in a real time

36. Key element of the system – legitimacy of procedures Inclusion of researchers in different points of the procedure e.g. Evaluation methodology – unique for each field of science SRA Scientific Council Scientific Council of the Discipline Researchers

37. ARRS and Transparency

38. Elements of transparency 1.Transparency of instruments 2.Transparency of Procedures 3.Financial Transparency 4.Transparency of results of the research

39. Elements of transparency 1.Transparency of instruments –Annual plan of public calls –Timetable of evaluation process –Guidelines prepared by the Ministry of higher education science and technology; –Published names peers and members of decision-making bodies

40. Annual plan of public calls

41. Timetable of evaluation process

42. Guidelines prepared by the Ministry

43. Elements of transparency 2.Transparency of procedures –Evaluation methodology – unique for each field of science –Transparent membership in expert bodies (published on SRA home page) –Procedure of peers selection is known in advance –Evaluation criteria (questions for peers) are prepared, adopted and published in advance –Publicly available results of selection process

44. Evaluation methodology

45. Results of evaluation

46. Elements of transparency 3.Financial Transparency –Annual financial reports (White book on financing) –Up-to date overview of distribution of budget (online white book)

47. Annual report on financing

48. Up-to date financing overview

49. Elements of transparency 4.Transparency of research results –Use of COBISS bibliographic system –Use of SICRIS system and its abstracts of research work The most important scientific results Socio-economic significance of research –Use of international citation indexes (ISI, CSA and other bibliographic databases –In the future implementation of full text database

50. COBISS bibliographic system

51. 2. SPLICHAL, Slavko. The principle of publicity, public use of reason and social control. Media cult. soc., 2002, let. 24, št. 1, str. 5-26. [COBISS.SI-ID 21076573], [WoS, št. citatov do 3.10.06: 0, brez avtocitatov: 0] JCR IF: 0.236, x: 0.611; sociology; 74/93 kategorija: 1B2 (Z1); tipologijo je verificiral OSICD točke: 40, št. avtorjev: 121076573WoS 3. SPLICHAL, Slavko. Bentham, Kant and the right to communicate. Crit. rev. (N.Y. N.Y.), Summer/Fall 2003, let. 15, no. 3/4, str. 285-305. [COBISS.SI-ID 22641245], [WoS, št. citatov do 7.2.07: 1, brez avtocitatov: 0] JCR IF:, x: 0.468; social sciences, interdisciplinary; 55/55 kategorija: 1B2 (Z1); tipologijo je verificiral OSICD točke: 40, št. avtorjev: 122641245WoS

52. SICRIS information system

53. International citation indexes

54. Publications in scientific journals with ISI index

55. Thank you for your attention!