1. Information Retrieval to Informed Action with Research Metrics Thomson Scientific Research Services Group 2007

2. Science is very dynamic and growing exponentially Research is happening in a global and multidisciplinary context Emerging fields make it difficult to determine relevancy Selectivity becomes more challenging, e.g. how to find the right journals Challenge of Managing and Evaluating Research Keep up to date on new and developing science Nurture new research through direction and funding Measure the impact of scientific efforts Access timely, objective and informed information to make policy and budget decisions Responsibilities of leaders in research

3. Metrics – How to measure science? Scientists communicate through the literature in academic journals Citations are considered the “coin of the realm” in science Bibliometrics uses statistical analysis to draw a landscape of scientific communication and productivity. Citation analysis: examines the elements of bibliographic records (citations) studies relationships between citations measures the amount of scientific activity in a subject category, journal, country, topic or other areas of interest.

4. Why Metrics? Uses readily available data Employs transparent and reproducible methodology Provides quantitative information that policy makers can apply to their decision process “If you can measure that of which you speak, and can express it by a number, you know something of your subject; but if you cannot measure it, your knowledge is meager and unsatisfactory” - Lord Kelvin (William Thomson) “If you can measure that of which you speak, and can express it by a number, you know something of your subject; but if you cannot measure it, your knowledge is meager and unsatisfactory” - Lord Kelvin (William Thomson)

5. Elements of Evaluation using Bibliometric Methods Theory of citation: –Citations are a form of peer recognition Basic measures: –Papers, citations, citations per paper (impact) Relative measures: –impact relative to baselines; –expected citation rates for articles; –percentiles Units of analysis: –papers, authors, institutions, countries, journals Measures of interaction: –research fronts, interdisciplinarity, collaboration

6. A National view of Turkish Research

7. Economics informs but citation analysis provides more detail Turkish research motivation is seen in the OECD records on percentage of GDP dedicated to Research & Development. Turkey is surging and soon to exceed Portugal. Source: OECD Factbook 2008 Science and technology - Research and Development (R&D) - Expenditure on R&D Turkey

8. Research Growth and Impact in Turkey, 1981- 2007 Turkish research has grown steadily over the last 27 years. On average, Turkey produced over 14,000 scientific papers per year from 2003-2007, with large movement in aggregate citations between 2003 and 2007. Source: National Science Indicators, 1981-2007 – WOS version

9. Annual Research Growth in Turkey, 1981- 2007 In 2003, Turkey broke through to go above 10,000 research papers produced in a single year. Source: National Science Indicators, 1981-2007 – WOS version Total Papers

10. Research Growth in Turkey, 1981-2007, compared to Greece Among the countries in the region, Greece is the closest in publications but continues to lag behind Turkey’s strong growth trend. Source: National Science Indicators, 1981-2007 – WOS version Total Papers

11. Percentage of papers in the world, 1981-2007 Source: National Science Indicators, 1981-2007 – WOS version Turkey also exceeds Greece in overall contribution to research in the world. % Papers In World

12. Research in Turkey – Citation Impact Citation impact is the average citation rate: total cites/total papers. Turkey’s average citation rate has risen consistently since the mid-1990’s and is trending to continue its steep movement into the world scientific community. Source: National Science Indicators, 1981-2007 – WOS version Baseline=1 Avg. Cite Per Paper

13. Research in Turkey – Percentage Cited While publication growth is strong, Turkey is still working to exceed Greece in percentage of papers cited. Source: National Science Indicators, 1981-2007 – WOS version % of Papers Cited

14. Turkey: Field Specialization The following 10 fields make up over 85% of Turkish scientific research Source: National Citation Report on the nation of Turkey (ESI), 1981-2007

15. Turkey: Field Specialization Generally Turkey contributes 1.48% of all world papers in 2003-2007. The following fields exceed that level and indicate a national strength for Turkey in world contribution Field % papers in field in the world Agricultural Sciences 2.76 Clinical Medicine 2.62 Engineering 1.94 Plant & Animal Science 1.89 Field % papers in field in the world Ecology/Environment 1.59 Pharmacology1.54 Materials Science1.50 Source: National Science Indicators, 1981-2007, ESI version

16. Turkey: International Collaboration Turkish research is written more often within the country. Here are the top 20 countries represented in Turkish collaborations since 2000. Source: National Citation Report on the nation of Turkey, 1981-2007

17. Key Universities in Turkish Research

18. University Publications Source: National Science Indicators customized for Turkish Institutions, 1981-2006 These 17 universities published 1000 or more papers over the period 2002-2006. This illustrates academic contribution to the national performance

19. Growth of Publications in Specific Universities Source: National Science Indicators customized for Turkish Institutions, 1981-2006 In the 2002-2006 period, these 5 leading Turkish universities fit into the mid-range of publication counts for the US, UK, Australia, and Canada university indicators. Ankara University Hacettepe University Instanbul University Ege University Gazi University

20. Relation of University Strengths to National Strengths Source: National Science Indicators customized for Turkish Institutions, 1981-2006 Most active fields for top 5 schools # of papersTurkey overall% of country contribution Agricultural Sciences472226621% Biology & Biochemistry806251932% Chemistry2086675431% Clinical Medicine78072290934% Ecology/Environment16317719% Engineering819580714% Geosciences256135819% Materials Science394223418% Neurosciences & Behavior312124725% Pharmacology560140140% Physics586383315%

21. Field Specialization, 2002-2006 Source: National Science Indicators customized for Turkish Institutions, 1981-2006 Other fields of Turkish strength like Engineering are represented by a unique set of universities.

22. Growth of Publications in Leading Technical Universities, 1981-2007 Source: National Science Indicators customized for Turkish Institutions, 1981-2006 Highlight comparisons between Middle East Technical University and Instanbul Tecknick

23. Engineering subfields at METU Source: National Science Indicators customized for Turkish Institutions, 1981-2006 CitesFieldPapersAvg. Cites/Paper 2,845ENGINEERING, CHEMICAL6404.45 1,426ENGINEERING, BIOMEDICAL13910.26 1,168ENGINEERING, ELECTRICAL & ELECTRONIC 3283.56 920MATERIALS SCIENCE, BIOMATERIALS6514.15 706ENGINEERING, MECHANICAL1943.64

24. Engineering at METU: ChemE journals Source: National Science Indicators customized for Turkish Institutions, 1981-2006 JournalCitesPapersAvg. Cites/Paper 2006 Journal Impact factor ENERGY SOURCE55541.020.43 TURKISH JOURNAL OF CHEMISTRY90541.670.65 CHEMICAL ENGINEERING COMMUNICATIONS 61381.610.35 FUEL151295.211.36 INDUSTRIAL & ENGINEERING CHEMISTRY REESARCH 173266.651.52 CHEMICAL ENGINEERING SCIENCE119254.761.63 ENERGY & FUEL105254.21.52 JOURNAL OF FOOD ENGINEERING109254.361.7 AIChE JOURNAL2562211.642.15 MINERALS ENGINEERING37221.680.94

25. Engineering at METU: Authors in ChemE Source: National Science Indicators customized for Turkish Institutions, 1981-2006 CitesAuthorPapersAvg. Cites/Paper Cites2H index C indexAverage Percentile 548DOGU, T668.33,747140.8643.41 318DOGU, G368.831,864110.9137.66 258YILMAZ, L279.562,929101.4354.13 139KOK, MV492.8450060.6562.87 69TOSUN, I282.4657230.3458.74 52HICYILMAZ C252.088240.5871.52 18BAGCI, S230.781810.271.68 18TURKER, L200.911520.1478.11

26. Engineering at METU: A well cited ChemE paper from Dr. T. Dogu Source: National Science Indicators customized for Turkish Institutions, 1981-2006

27. Comments Because science is such a dynamic enterprise, no one metric is adequate for evaluation. Evaluation is the culmination of quantitative and qualitative considerations, within a particular environment. Citation analysis can help highlight researchers and the work that impacts the overall impact of an organization, group, or nation. –Examines the elements of publıcatıon records –Studies relationships between citations –Allows for the measurement of the amount of scientific activity in varıous areas, e.g. Organızatıons, nıdıvıduals, journals, subject areas

28. Thank you!