7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Timeliness and quality Information products based on process-produced.

Slides:

Advertisements

Similar presentations

CRISs as a Management Tool: Experiences and Perspectives at the German Research Foundation (DFG) Presented at the 8th international Conference on Current.

Advertisements

7 th Framework Programme (FP7) - Malta’s participation th January 2013 Anthea Fabri FP7 National Coordinator Malta Council for Science and.

CYPRUS UNIVERSITY OF TECHNOLOGY Internal Evaluation Procedures at CUT Quality Assurance Seminar Organised by the Ministry of Education and Culture and.

DR MACIEJ JUNKIERT PRACOWNIA BADAŃ NAD TRADYCJĄ EUROPEJSKĄ Guide for Applicants.

Public knowledge: some findings of a survey on open access publishing Juergen Guedler, German Research Foundation (DFG), Department of Information Management.

The DFG - who we are and what we do

The Quality of Teaching Pact of the Federal Government and the Länder Governments of Germany.

Melbourne Research Research Funding Schemes Collaboration with Germany Alice Boland, Senior Research Grants Officer (International)

University of Vienna Rectorate – Office of the Rectorate May 30, 2008 Claudia Kögler University of Vienna, Office of the Rectorate.

Ekkehard Nuissl von Rein Quality Assurance by External Evaluation of Leibniz Institutes Strasbourg, 15th November 2005.

Ankara, 11 October 2005 Research and Research funding in Germany: An overview Sebastian Stetter KoWi

New DFG Information Infrastructure Projects Dr. Stefan Winkler-Nees; Birmingham, 28. March 2011 New DFG Information Infrastructure Projects.

1 7th Framework Programme Specific Programme “Ideas” European Commission Directorate B November 2005.

Austrian Exchange Service Agency for International Cooperation in Education and Research Presentation ÖAD1 Austrian Exchange Service Largest non profit.

Education and Culture LESSONS LEARNED FROM THE FORMER GENERATION OF HIGHER EDUCATION PROGRAMMES IN RUSSIAN FEDERATION José Gutierrez Erasmus+ : Higher.

Standardisation of Classification Schemes for Evaluative and Monitoring Purposes – Services of the DFG Christian Fischer, Jürgen Güdler, Holger Hahnen.

European Monitoring Centre for Drugs and Drug Addiction Margareta Nilson ISAJE, Helsinki, 1 September 2006.

1 NATIONAL TECHNICAL UNIVERSITY OF ATHENS (NTUA) School of Chemical Engineering Unit of Environmental Science and Technology (UEST) Katherine Haralambous.

National Science Centre An Important Component of Research Funding in Poland RECFA visit to Poland, Krakow 2012 Andrzej Jajszczyk.

The evaluation of research units at HCERES

1 Science and Society: EU Strategy and actions Dr. Rainer GEROLD Director Science and Society Research DG European Commission.

Quality Assurance at the University St. Kliment Ohridski Elizabeta Bahtovska National Bologna promoter TEMPUS SCM C-032B06 West Balkan Bologna Promoters.

Sapienza University of Rome a short presentation ERASMUS STAFF MOBILITY WEEK 2011 Sapienza University of Rome EU Research Programmes and visiting Professors.

TEMPUS IV- SIXTH CALL FOR PROPOSALS 1 TEMPUS Modernising Higher Education TEMPUS INFORMATION DAY.

CRISs as a tool for evaluative purposes – Activities and future plans at the German Research Foundation (DFG) Presented at EuroCRIS Members Meeting Tartu,

Security, Democracy & Cities Security, Democracy & Cities Democracy,

Project:“Support to the Internationalization of Kosova Higher Education System through establishment of the Kosova Students’ Union” Status Quo on Student.

Quality Assurance in the European Higher Education Area Tibor Szanto ENQA Rogaska Slatina, 30 November 2007.

Joint CAAT-Europe / ecopa workshop, Berlin, – Implementation of the new EU Directive 2010/63/EU on the protection of animals used for.

UHH 1 AARHUS UNIVERSITY RESEARCH MANAGEMENT AND RESEARCH SUPPORT.

The Concept of the European Platform of Women Scientists An instrument of support and a way to become active in the policy debate Isabel Beuter, M.A. Center.

ESPON Seminar 15 November 2006 in Espoo, Finland Review of the ESPON 2006 and lessons learned for the ESPON 2013 Programme Thiemo W. Eser, ESPON Managing.

Recognition: the national centre and the ENIC Network Seminar on the recognition of qualifications Baku, 22 April 2005 Gunnar Vaht Head of the Estonian.

The Knowledge Exchange Presentation to CNI April 2005 Bas Cordewener, SURF Sigrun Eckelmann, DFG Norman Wiseman, JISC.

Towards an Pan-European Research Information System The ESF Perspective and Approach Dr. Alexis-Michel Mugabushaka Science Officer in CEO Unit, ESF EuroCRIS.

European Platform of Women Scientists The European Platform of Women Scientists - The Voice of Women Scientists in EU Research Policy Raising the Voice.

(Funding for) Research In Germany Nico Schüler, School of Music.

European Commission Introduction to the Community Programme for Employment and Social Solidarity PROGRESS

DFG, Dr. Christian Schaich Sofia, December 5, 2013 The DFG and its Funding Schemes with particular Attention to the Excellence Initiative.

CRIS 2008 Conference Maribor, June 4th – 7th 2008 Quality is the Product is the Quality Information Management as a Closed-loop Process DFG Jürgen Güdler.

Research and Innovation in Germany - Promotion Measures of BMBF in the Cooperation with Central and Eastern European Countries Erika Rost, BMBF,

International Cooperation in Science, Research and Technology in Germany Erika Rost Head of Division "Cooperation with Eastern European Countries" Federal.

Participation in 7FP Anna Pikalova National Research University “Higher School of Economics” National Contact Points “Mobility” & “INCO”

EU Projects – FP7 Workshop 6: EU Funding –What’s Next? Carolina Fernandes Innovation & Funding Manager GLE Group.

Deutsche Forschungsgemeinschaft DFG The Use of Research Funding Databases for Research Assessment Information Systems Presented at the 8th international.

Federal Ministry of Education and Research. 1 Prof. Dr. Annette Schavan, MdB Federal Minister of Education and Research Dr. Helge Braun Parliamentary.

1 EuroCRIS Seminar Brussels, 13 September 2010 Dr. Peter Fisch European Commission Evaluation of the Framework Programme Tools and Challenges.

EuroCRIS Strategic Seminar, Katharina Fuß Brussels, Activities of the ESF Member Organisation Forum on Research Evaluation.

SWAFS NCP Info Day Brussels, 2 February 2016 RTD B7 - Science with and for Society RTD-7.1 Gender Sector HORIZON 2020.

PISA – an option to learn from other countries‘ educational systems On PISA and German educational reforms within the past decade Seminar in Tallinn, 19.

RWTH Aachen University 2015 The Big Picture in Figures.

Pentti Pulkkinen Programme Manager Academy of Finland Research funding and administration in Finland

Ministry Of Education and Higher Education National Tempus Office Palestine TEMPUS PROGRAM PREPARED BY National Tempus Office – Palestine 2010 European.

PORTFOLIO COMMITTEE MEETING PRESENTATION ON THE APP AND BUDGET ALLOCATION FOR THE YEAR 2016/ th APRIL 2016.

The European Science Foundation is a non-governmental organisation based in Strasbourg, France.

University of Piraeus Research Centre (UPRC) Assistant Professor Nineta Polemi “PREVENTION, PREPAREDENESS AND CONSEQUENCE MANAGEMENT OF.

The search for new ways of Quality Assurance The project “European Quality Audit” of the Universities of Bremen and Siegen Dr. Anke Rigbers.

Deutsche Forschungsgemeinschaft German Research Foundation DFG, Dr. Christian Schaich Tbilisi, September 19, 2016.

Higher Education and Training Awards Council

LESSONS LEARNED FROM THE PRESENT GENERATION OF HIGHER EDUCATION PROGRAMMES IN EASTERN PARTNERSHIP COUNTRIES Klaus Haupt, Head of Tempus Unit Education,

Priorities and coordination of capacity building in Azerbaijan

Strengthening the foundations of ERA

German Research Foundation DFG

Current developments in Germany

Introduction to the training

SOCIAL DIALOGUE WITHIN EUPAN

European Public Sector Award (EPSA) Innovations for Europe: Increasing Public Value IPSG-Meeting Oliver Haubner, Program Manager Helsinki – October 27th,

The role of the international department of TurkStat

Panel “Key performance indicators for Serbian higher education“

Presentation transcript:

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Timeliness and quality Information products based on process-produced data – requirements on the quality assurance process Presentation at the 7 th euroCRIS Strategic Seminar Brussels, September, th 2009

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Agenda 1. DFG at a glance 2. DFG‘s main source of information 3. Timeliness and Quality 4. Scope of DFG information products

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Third-party funding income of German higher education institutions (HEI) by source (2006)

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 DFG Awards by scientific discipline (2007) Mechanical and Industrial Engineering 6% Geosciences 6% Mathematics 3% Physics 10% Chemistry 7%Agriculture and Veterinary Medicine 2% Medicine 21% Biology 13% Social and Behavioural Sciences 6% Humanities 10% Construction Engineering and Architecture 1% Computer Science, Electrical and System Engineering 8% Material Science 3% Thermal and Process Engineering 4% Life Sciences Engineering Sciences Soc.Sc. & Humanities Natural Science Research fields: ► Soc.Sci.+Humanities 16% ► Engineering Sciences 22% ► Natural Sciences 26% ► Life Sciences 36%

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 DFG programme portfolio and budget (2007) 29.3%: Individual Grants Programme 54.6%: Coordinated Programmes 06.3%: Promoting Young Researchers 01.2%: Scientific Prizes 07.2%: Scientific Instrumentation and Infrastructure 01.4%: Encouraging Scientific Contacts (and other)  Programme portfolio and budget: ~2 Billion €, more than programmes and projects funded

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Department I Central Administration Strategic Planning Committees Executive Office Quality Assurance and Programme Development International Affairs Press and Public Relations Internal Auditing Berlin Office Internal Advisory Committee Extended Executive Board Heads of Divisions and Executive-Level Offices Executive Board President Secretary General Deputy Members: Heads of Departments I - III Forum Heads of Divisions  Budget and Accounting  Human Resources and Legal Affairs  Information Technology and Infrastructure  Information Management Department II Scientific Affairs Department III Coordinated Programmes and Infrastructure  Research Centres  Research Careers  Scientific Library Services and Information Systems  Scientific Instrumentation and Information Technology  Humanities and Social Sciences  Life Sciences 1  Life Sciences 2  Physics, Mathematics, Geosciences  Chemistry and Process Engineering  Engineering Sciences Dept. directly involved in the funding process The DFG´s Head Office: An overview

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 The funding-process-chain Whole chain is represented in the DFG-internal databases and document management systems Advice Submission Formal examination Reviewer Statutatory bodies Report Proposal Peer Review / Assessment Performance Evaluation Funding Decision

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Agenda 1. DFG at a glance 2. DFG‘s main source of information 3. Timeliness and Quality 4. Scope of DFG information products

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Facts and figures ► DFG internal electronic proposal processing system ► in use since 2005 (data coverage from 1982) ► used for all funding programmes ► used by about 400 out of 750 staff members directly involved in funding processes ► data source for all information products published by the DFG ElektrA – the data source

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Agenda 1. DFG at a glance 2. DFG‘s main source of information 3. Timeliness and Quality 4. Scope of DFG information products

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Timeliness and quality ► Data in ElektrA are very actual („day before“) ► Because of the use of data for funding-process related products (e.g. letters to applicants and reviewers) most information are of high quality ► But: less use in funding related products results in lower quality

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Organisational model for quality assurance (QA) ► Quality responsibility is decentralised ●staff members are trained to produce good quality data ●software helps to avoid mistakes ► Nevertheless there is a need for a central quality assurance unit: ●development of complex quality assurance routines ●occasionally very high demand for timeliness (e.g. ad hoc statistics or „the day after“ information products like reports on decisions of DFG boards) ●most important: Training of data producing staff on how to avoid mistakes and – very helpful! – elucidation on the importance and use of infomation products based on these data

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Arguments for investing high effort in quality Only one: ► Quality of data ist quality of information products is acceptance and practical use for planning purposes of these products

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Agenda 1. DFG at a glance 2. DFG‘s main source of information 3. Timeliness and Quality 4. Scope of DFG information products

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Statistical reporting based on the DFG internal database Example: Quarterly statistics for the statutory bodies ► Statistical reporting for the statutory bodies of the DFG: ●e.g. success rates by programme ●e.g. number of programmes funded/rejected ●e.g. development of success rate over time

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 DFG internal data as a source for evaluative studies Evaluative Study: „Women in the DFG“ (2008) ► Topic: Gender equality has been one of the aims of the foundation since 2002 (Article 1 of its statutes) ► Objective: Transparency, planning criteria (e.g. development for the modification of funding instruments) ► The project team: Prof. Thomas Hinz, Ina Findeisen, Kathrin Auspurg, University of Konstanz ► Target group: Statutory bodies, interested members of the public ► Data: Mainly based on process-produced data; many other sources of data included ► Study (german) and results in brief (engl.):

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Characteristics ► information system on DFG-funded projects ► different search functions ► shows all funded projects at a university, department, or institute since 1999 (~ projects) Contribution to QA-process ► three quality checks – ●first during proposal processing ●second by applicant before publishing ●constant -feedback by users and applicants GEPRIS – German Project Information System

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Research Explorer (REx): Characteristics ► bilingual database (german / english) on research institutes at German HEIs and other institutions ► detailed information on nearly 20,000 institutes at these institutions ► links to GEPRIS Contribution ► daily by proposal processing within DFG ► periodically by QA-team for each university ► occasionally by user-feedback

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 The DFG Funding Ranking Planning tool for universities and other actors engaged in research planning and strategy. Helps to identify research profiles by means of: ► Institutional Profiles: Information about research profiles and main research fields covered by German HEIs ► Regional Profiles: Unveils regional profiles and clusters of excellence ► Structural Profiles: Informs about networks in science ► Disciplinary Profiles: Detailed analysis on research activities in different disciplines and fields of research (e.g. biotechnology)

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 iele, Objectives, approach and databases of the DFG Funding Ranking Deutsche Forschungsgemeinschaft German government European Union European Research Council German Federation of Industrial Reserach Organizations Alexander von Humboldt Foundation German Academic Exchange Service iele, Analyses by source Analyses by recipients dimensions of differentiation: countries, states, regions, institutions. Indicators cover approximately 90 percent of the third-party funding income of scientific and higher education institutions in Germany. Huge set of additional non-monetary indicators (intern. attractivity, scientific expertise...) No costly and laborious data collection from the research institutions but direct processing of data concerning funding activities of central sources Subject-related Analyses Classification according to four scientific disciplines Specifics: DFG: 48 research fields German government: 12 funding fields EU: 8 funding fields AvH / DAAD a.o: 14 research areas

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 DFG Funding Ranking Influence of programmes (e.g. ExIn) Gender equality International appeal Networks and cooperation structures Funding rankings and profiles Participants in peer review processes Aspects of statistical reporting within the DFG Funding Ranking

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Disciplinary profiles of universities ► Example: DFG-funding in the humanities ► range of information: ●Volume of funding ●spectrum of disciplines of each HEI ●participation of HEI in „Excellence Initative“ ► FU Berlin – LMU Munich: Similar vol of funding und similar disciplinary profile – different participation in ExIn

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Networks and cooperation structures within DFG funded programmes: humanities ► Very dense coll. cluster in Berlin ► = Berlin capitalizes its ressources best

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Recipients in Germany Ranking of countries LandMio. €kum. % Deutschland Großbritannien Deutschland Italien Niederlande Spanien Belgien Frankreich Insgesamt 3.024, , , , ,4 943,8 707, ,3 1,8 3,2 4,5 5,4 6,1 6,6 7,1 100,0 Art der Einrichtung Hochschulen Außeruniversitäre Einrichtungen Max-Planck-Gesellschaft (MPG) Fraunhofer-Gesellschaft (FhG) Helmholtz-Gemeinschaft (HGF) Leibniz-Gemeinschaft (WGL) Bundeseinrichtungen Weitere Einrichtungen Industrie und Wirtschaft Nicht-institutionelle Mittelempfänger Ingesamt Mio. € 947, ,5 154,3 216,4 316,9 94,5 128,1 263,2 900,9 1, ,0 % 31,3 38,8 5,1 7,2 10,5 3,1 4,2 8,7 29,8 0,1 100,0 6th Framework Programme of the European Union

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 ElektrA management reports individual Letters funding ranking GEPRIS Research Explorer applicants, reviewers report users Ranking recipients GEPRIS users REx users Quality assurance team Feedback quality assurance different productsdifferent usersone data source one qa-team The quality assurance chain

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Conclusions ► Good quality of data is costly and need personnel ► Decentralization and direct use of data for business related products is the best guarantor for a good data base ► Besides this it is necessary to centralize QA processes ► The more products with certain specifications and certain target groups are based on the same data, the more feedback is possible to improve quality ► every data problem causes trouble to a broad set of information products – so high data quality is a good reason for investing in well defined QA processes

7th euroCRIS Strategic Seminar, Juergen Guedler Brussels, September, 14-15th, 2009 Thank you for your attention ! more information: ► DFG: ► DFG-Funding-Ranking: ► DFG- funded projects: ► research institutes at German HEI: