Presentation is loading. Please wait.

Presentation is loading. Please wait.

October 24, 2005ISPM academic staff meeting1 Research Assessment Exercise Medical Faculty, University of Bern Matthias Egger.

Similar presentations


Presentation on theme: "October 24, 2005ISPM academic staff meeting1 Research Assessment Exercise Medical Faculty, University of Bern Matthias Egger."— Presentation transcript:

1 October 24, 2005ISPM academic staff meeting1 Research Assessment Exercise Medical Faculty, University of Bern Matthias Egger

2 October 24, 2005ISPM academic staff meeting2 Menu Research Assessment Exercises (RAE) Important bibliometric indices –The Impact Factor (IF) –The Maximum Rank (MR) Methodology of Bern RAE ISPM publications Results of 2003 RAE Conclusions

3 October 24, 2005ISPM academic staff meeting3 Rationale for RAE Improve quality of research Foster accountability and transparency Promote strategic thinking and focus Guide resource allocation –UK and other countries –Basel –Bern?

4 October 24, 2005ISPM academic staff meeting4 Bibliometric indices

5 October 24, 2005ISPM academic staff meeting5 Journal impact factor The number of citations in one year (for example 2002) to items published in a specific journal in the two preceding years (2000 and 2001) divided by the total number of citable articles (original articles and reviews, but not other items) published in this two-year period. Journal specific measure

6 October 24, 2005ISPM academic staff meeting6 Journal citation reports (JCR) There are two editions –Science JCR –Social Science JCR Journals are grouped in subject categories –Typical impact factors vary between categories The same journal may appear in more than one subject category Updated every year

7 October 24, 2005ISPM academic staff meeting7 Subject categories: examples Social Science –PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH –HEALTH POLICY & SERVICES –SOCIAL SCIENCES, BIOMEDICAL –PSYCHOLOGY, APPLIED –PSYCHOLOGY, SOCIAL –SOCIOLOGY –WOMEN'S STUDIES

8 October 24, 2005ISPM academic staff meeting8 Maximum Rank (MR) Measure of the standing of a journal within a given field (subject category) Controls for differences in impact factors across subject categories Defined as: IF-Rank of Journal -1 Rank in Subject Category = Number of Journals MR = Maximum of all ranks, if the journal is listed in several subject cateogories

9 October 24, 2005ISPM academic staff meeting9 Top Journals (MR=1) New England Journal of Medicine (IF=38.57) Value in Health (IF=3.66) Womens Health Issues (IF=1.352)

10 October 24, 2005ISPM academic staff meeting10 MR: Examples British Medical Journal Social Science & Medicine Statistics in Medicine J Adolescent Health Sex Transm Inf

11 October 24, 2005ISPM academic staff meeting11 Social Science & Medicine IF=2.088 (2004) PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH (Social Science Edition) 5/60 MR=0.933 SOCIAL SCIENCES, BIOMEDICAL 2/26 MR=0.961

12 October 24, 2005ISPM academic staff meeting12 Statistics in Medicine IF=1.389 (2004) PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH 46/93 MR=0.516 MEDICAL INFORMATICS 6/18 MR=0.720 STATISTICS & PROBABILITY 13/77 MR=0.844

13 October 24, 2005ISPM academic staff meeting13 J Adolescent Health IF=1.571 (2004) PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH (Science Edition) 46/93 MR=0.580 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH (Social Science Edition) 12/60 MR=0.817

14 October 24, 2005ISPM academic staff meeting14 Sex Transm Inf IF=1.181 (2002) IF=2.204 (2004) 2002 DERMATOLOGY & VENEREAL DISEASES 7/40 MR= INFECTIOUS DISEASES 19/41 MR=0.561

15 October 24, 2005ISPM academic staff meeting15 RAE 2003: Methods

16 October 24, 2005ISPM academic staff meeting16 Bern RAE 2003 Separate evaluation of two groups –Clinics –Institutes (n=21) Three ranks based on –Number of all original articles / Stellenpunkt –Average MR of in-house original articles –Competitive grant income spent / Stellenpunkt Global ranking based on sum of three ranks

17 October 24, 2005ISPM academic staff meeting17 Definitions Original articles –Pubmed-indexed original articles –www.pubmed.orgwww.pubmed.org Original articles in-house –first and/or last author from ISPM Original articles collaborations Other publications

18 October 24, 2005ISPM academic staff meeting18 Institut für Infektionskrankheiten Institut für Pathologie Institut für Klinische Pharmakologie Institut für Rechtsmedizin Institut für Sozial- und Präventivmedizin Fakultäre Instanz für Hausarztmedizin Universitätsspital-Bibliothek Institut für Medizinische Lehre Kollegiale Instanz für Komplementärmedizin Departement Klinische Forschung Institut für Anatomie Institut für Physiologie Institut für Biochemie und Molekularbiologie Theodor-Kocher-Institut Institut für Medizingeschichte Institut für Pathophysiologie Institut für Pharmakologie Institut für chirurgische Technologien und Biomechanik Institut für Evaluative Forschung in orthopädischer Chirurgie Institut für Dental- und Skelettbiologie Zahnmedizinische Kliniken 21 Institutes

19 October 24, 2005ISPM academic staff meeting19 ISPM publications publications listed on website 100 original articles indexed in Pubmed 92 articles with impact factor 57 in-house articles, 52 with impact factor 56 journals 28 subject categories

20 October 24, 2005ISPM academic staff meeting20 Sex Transm Inf 7 Lancet 6 Soz Praeventivmed 6 BMJ 5 Int J Epidemiol 5 Clin Oral Implants Res 3 Eur J Public Health 3 Eur Respir J 3 Int J STD & AIDS 3 JAMA 3 Swiss Med Wkly 3 AIDS 2 Eur J Clin Nutr 2 Eur Spine J 2 Gesundheitswesen 2 J Clin Epidemiol 2 J Infect Dis 2 Rheumatology 2 Stat Med 2 AIDS Res Human Retrovir 1 Acta Paediatr 1 Age Ageinig 1 Aids Care 1 Alcohol 1 Am J Epidemiol 1 Am J Public Health 1 Am J Respir Crit Care Med 1 Anesthesiology 1 Arch Int Med 1 BMC Med Res Methodol 1 Clin Chim Acta 1 Clin Sci 1 Clin Ther 1 Contr Clin Trials 1 Diagnostica 1 Epidemiology 1 Journals

21 October 24, 2005ISPM academic staff meeting21 Eur J Cancer 1 Eur J Epidemiol 1 Familial Cancer 1 HIV Med 1 Health Psychol 1 Health Technol Assess 1 Heart 1 Hepatology 1 Human and Ecol Risk Assess 1 Int J Hyg Environ Health 1 Int J Techno Assess Health Care 1 J Clin Endocrin Metabol 1 J Epidemiol Community Health 1 J Occup Environm Med 1 J Public Health 1 P Natl Acad Sci USA 1 Pest Manag Sci 1 Resp Res 1 Scan J Work Environ Health 1 Schweiz Monatsschr Zahnmed 1 Journals

22 October 24, 2005ISPM academic staff meeting22 In-house publications in journals indexed in Social Science Edition Eur J Public Health (AGF 2, EpStat 1) Gesundheitswesen (Epstat 1)

23 October 24, 2005ISPM academic staff meeting23 PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH 25 MEDICINE, GENERAL & INTERNAL 18 INFECTIOUS DISEASES 10 RESPIRATORY SYSTEM 4 DENTISTRY, ORAL SURGERY & MEDICINE 3 DERMATOLOGY & VENEREAL DISEASES 3 NUTRITION & DIETETICS 2 ORTHOPEDICS 2 PHARMACOLOGY & PHARMACY 2 PSYCHOLOGY, CLINICAL 2 RHEUMATOLOGY 2 STATISTICS & PROBABILITY 2 VIROLOGY 2 AGRONOMY 1 ANESTHESIOLOGY 1 CARDIAC & CARDIOVASCULAR SYSTEMS 1 CRITICAL CARE MEDICINE 1 ENDOCRINOLOGY & METABOLISM 1 Subject categories

24 October 24, 2005ISPM academic staff meeting24 ENVIRONMENTAL SCIENCES 1 GASTROENTEROLOGY & HEPATOLOGY 1 GERIATRICS & GERONTOLOGY 1 HEALTH CARE SCIENCES & SERVICES 1 MEDICAL LABORATORY TECHNOLOGY 1 MEDICINE, RESEARCH & EXPERIMENTAL 1 MULTIDISCIPLINARY SCIENCES 1 ONCOLOGY 1 PEDIATRICS 1 PSYCHOLOGY, CLINICAL 1 TOXICOLOGY 1 Subject categories

25 October 24, 2005ISPM academic staff meeting25

26 October 24, 2005ISPM academic staff meeting26

27 October 24, 2005ISPM academic staff meeting AGF48517 EpStat ISPM Number of original articles

28 October 24, 2005ISPM academic staff meeting AGF0.147 (n=1) (n=5) (n=1) (n=7) EpStat0.842 (n=11) (n=13) (n=21) (n=45) ISPM0.784 (n=12) (n=18) (n=22) (n=52) Average MR in-house original articles

29 October 24, 2005ISPM academic staff meeting29 RAE 2003: Results

30 October 24, 2005ISPM academic staff meeting30 RAE 2003ISPMAll 21 units Staff points (Stellenpunkte, SP) No of original publications Number / SP MR of inhouse publications Competitive grant income / year / SP

31 October 24, 2005ISPM academic staff meeting31 Core funding of ISPM 1694 staff points, corresponding to ~2.1 Mio SFr/year 125,000 SFr / year for running costs Rent of offices, maintenance

32 October 24, 2005ISPM academic staff meeting32 Current distribution of staff points By administrative unit Director’s office 250 (15%) Central services271 (16%) AGF559 (33%) EpStat 614 (36%) By research unit AGF559 (41%) Epstat+ME806 (59%)

33 October 24, 2005ISPM academic staff meeting33 Conclusions We are doing very well in terms of the number of original articles We are doing less well in terms of the Maximum Rank of our in-house publications Our output is very heterogeneous –Lack of focus? –Reflection of consultancies with University Hospital and others?

34 October 24, 2005ISPM academic staff meeting34 Conclusions EpStat contributes substantially more RAE- relevant output than AGF There are very few in-house publications in journals indexed in Social Science Edition There are many journals that rank highly in the Social Science Edition and that may be of interest to us We need to make sure that the faculty appropriately considers Social Science journals

35 October 24, 2005ISPM academic staff meeting35 High ranking journals indexed in Social Science Edition Addiction (1.0) Soc Health Illness (0.922) Aids Care (0.846)Social Sci Med (0.961) Am J Health Prom (0.900) Sociol Health Ill (0.922) Archives Sex Behav (0.892) Women Health Issues (1.0) Demography (0.941) Health Psychology (0.928) Health Services Research (0.842) J Adolescent Health (0.817) J Health Soc Behav (0.782) J Soc Policy (0.928) Medical Care (0.921) Perspect Sex Repro Health (1.0) Psychosom Med (0.930)

36 October 24, 2005ISPM academic staff meeting36 Conclusions We should generally try to publish our work in journals that rank high in relevant subject categories (MR>0.7) Everyone at ISPM should know these journals for her/his field We may want to exclude original publications with very low MRs from the list we submit to the faculty We should use our core funding (staff points) wisely, taking into account the RAE (every staff point counts)


Download ppt "October 24, 2005ISPM academic staff meeting1 Research Assessment Exercise Medical Faculty, University of Bern Matthias Egger."

Similar presentations


Ads by Google