1. INFORMATION SOLUTIONS Bibliometrics Mary L. Van Allen Thomson Scientific Research Services Group January 2006

2. Copyright 2006Thomson 2 INFORMATION SOLUTIONS Metrics – how many ways can we count? Cybermetrics Scientometrics Informetrics Webometrics Bibliometrics: the statistical analysis of bibliographic data, mainly in scientific and technical literatures. It measures the amount of scientific activity in a subject category, journal, country, topic or other area of interest. (Henry Small) “…Bibliometrics is the application of mathematics and statistical methods to analyze the course of the written communication and the course of a discipline.” (Ernesto Spinak) It displays a landscape of scientific communication and productivity by examining the elements of bibliographic records (citations) and the relationships between citations.

3. Copyright 2006Thomson 3 INFORMATION SOLUTIONS Approaches to Evaluation using Bibliometric Methods Theory of citation: –Citations are a form of peer recognition Basic measures: –Papers, citations, citations per paper (impact) Relative measures: –impact relative to baselines; –expected citation rates for articles; –percentiles Units of analysis: –papers, authors, institutions, countries, journals Measures of interaction: –research fronts, interdisciplinarity, collaboration

4. Copyright 2006Thomson 4 INFORMATION SOLUTIONS Basic and Relative Measures Citations : count of incoming citations to a paper or a group of papers, or a citations per paper measure (citation impact) –Look at trends over time. –Refinement sometimes applied for subtraction of self-citations. Influenced by the field. Expected citation rates: A measure of how often a specific item can be expected to be cited over time based on: the year the item was published, the journal it was published in and the type of item it was (note, letter, review, regular article, etc.). –create a ratio of the sum of actual citations received divided by the sum of expected citation rates, to obtain a ratio of actual to expected citations. Field Baselines: an average citation rate for a group of items, e.g, all regular articles, notes and reviews in all journals assigned to a specific field or discipline. –Baselines are computed for specific time periods that define both the citing and cited window used for counting. –Example: a baseline for the category of physics can be computed for cited items in all physics journals published 1991 to 1995 and cited by items, 1993 to 2005. The citation average for a selected group of papers in physics covering the same time period can then be compared with this baseline, and a relative measure created by dividing the group’s average by the baseline.

5. Copyright 2006Thomson 5 INFORMATION SOLUTIONS Who uses and benefits from Bibliometrics? Policymakers, Research Directors and administrators in Universities and Goverment: –Is our funding or focus in specific areas resulting in good research? –How is my nation or institution faring against other comparable nations and institutes? –Where is our research being used? Researchers: –Distill the most relevant papers from a group of search results. –Identify most influential researchers in a field: Who are the thought leaders? Information specialists: –these are the information brokers - the liaison between the producers of knowledge and the consumers of knowledge. It is important that they be aware of all the tools and data available for their patrons.

6. Copyright 2006Thomson 6 INFORMATION SOLUTIONS Chilean Publication output Up 100% Up 16% Overall outputRelative to world growth 67% increase, 1981-2004 Avg inc @ 6% per period Chilean growth: 45% World growth: 40% Source: National Science Indicators, 1981-2004 – standard version

7. Copyright 2006Thomson 7 INFORMATION SOLUTIONS Chile: Citation impact Up 60% Up 35% Overall impact Impact relative to the world average World baseline impact, 1981: 2.86 World baseline Impact, 2004: 4.42 Up 50% Chile impact in 1981: 1.81 Chile impact in 2004: 3.62 In 1981, there was a 37% difference between Chilean and world impact levels. By 2004, the difference had declined to 18%. Chile is raising the bar.

8. Copyright 2006Thomson 8 INFORMATION SOLUTIONS South America Ranking by Output and Impact (2000-2004) By using cites/paper (impact), we consider the size of the country. Impact normalizes by size of country. For example, Switzerland is one of the most highly cited nations in the world though it is also one of the smallest. But Chile ranks the first relative to the other South American countries in cites/paper. Source: National Science Indicators, 1981-2004 – standard version In the most recent 5 years, Chile is third in publication output.

9. Copyright 2006Thomson 9 INFORMATION SOLUTIONS Growth of output in South American countries Source: National Science Indicators, 1981-2004 – standard version

10. Copyright 2006Thomson 10 INFORMATION SOLUTIONS Growth in impact of South American countries Source: National Science Indicators, 1981-2004 – standard version

11. Copyright 2006Thomson 11 INFORMATION SOLUTIONS Chile: Field specialization Relative Specialization: Chile contributes 0.3% of all world papers Space Science:2.7 Ecology0.6 Mathematics0.5 Plant & Animal Science0.5 Agricultural Science0.4 Percent papers in country: What fields produce the most papers? Clinical Medicine 17.6% Chemistry14.7% Space Science12.2% Plant & Animal10.2% Physics 7.9% Source: National Science Indicators, 1981-2004 – standard version

12. Copyright 2006Thomson 12 INFORMATION SOLUTIONS Chile: Relative impact FieldImpactWorld Avg Relative for field impact Space Science8.87.11.25 Mathematics1.31.251.04 Physics3.43.60.94 Geosciences3.13.40.91 Agricultural Sciences 2.02.40.85 Chile is above the world average in 2 of 24 fields, i.e. Space Science and Mathematics and is closing in on 3 others Source: National Science Indicators, 1981-2004 – standard version

13. Copyright 2006Thomson 13 INFORMATION SOLUTIONS Most-cited paper in Biochemistry/Biophysics Source: National Citation Report: 1981-2004 source, citing and cited papers Authors Organiza tions Reprint Author Citation information Citation Metrics

14. Copyright 2006Thomson 14 INFORMATION SOLUTIONS A most-cited paper in Aquatic Sciences Source: National Citation Report: 1981-2004 source, citing and cited papers

15. Copyright 2006Thomson 15 INFORMATION SOLUTIONS Collaborating countries Country Papers Chile 43,237 USA 6,227 Spain 1,986 France 1,942 Germany 1,776 England 1,249 Brazil 1,106 Argentina 986 Italy 839 Canada 790 Mexico 518 This shows the countries that Chile collaborated with 1981- 2004 and illustrates the global expression of research. Source: National Citation Report: 1981-2004 source, citing and cited papers

16. Copyright 2006Thomson 16 INFORMATION SOLUTIONS Most-cited Chilean-authored papers, 2000-2004

17. Copyright 2006Thomson 17 INFORMATION SOLUTIONS Most prolific author: Bernabe Luis Rivas Universidad de Concepción 228 papers overall, 1981-2004. 97 papers, 2000-2005 Example from the 2000-2005 group

18. Copyright 2006Thomson 18 INFORMATION SOLUTIONS Most cited author outside of Space Science: Ramon Latorre, Universidad de Chile – Biology Department Prof. Latorre’s most cited article, 1981-2004. He has 3574 citations to 159 papers

19. Copyright 2006Thomson 19 INFORMATION SOLUTIONS Most prolific institutions CitesInstitution PapersImpact 98,013Universidad de Chile 16,2726.0 63,887Pontificia Universidad Católica de Chile 8,8217.2 17,156Universidad de Concepción 4,1954.1 10,719Universidad Austral de Chile 2,6224.1 11,780Universidad de Santiago de Chile 1,9526.0 33,356EUROPEAN SO OBSERV 1,49822.3 4,088Pontificia Universidad Católica de Valparaiso 1,0743.8 4,418Universidad Técnica Federico Santa Maria 7735.7 2,432Universidad de La Frontera 7023.5 1,943Universidad Católica del Norte 5673.4 17,551Cerro Tololo Inter Amer Observ 55731.5 1,525Universidad de Antofagasta 4053.8 1,284Universidad de Valparaiso 3823.4 1,066Universidad de Talca 3143.4 8,067Natl Opt Astron Observ 30126.8 Source: National Citation Report: 1981-2004 source, citing and cited papers

20. Copyright 2006Thomson 20 INFORMATION SOLUTIONS Most cited papers from top Chilean Universities Universidad de Chile Source: National Citation Report: 1981-2004 source, citing and cited papers

21. Copyright 2006Thomson 21 INFORMATION SOLUTIONS Pontificia Universidad Católica de Chile Most cited papers from top Chilean Universities Source: National Citation Report: 1981-2004 source, citing and cited papers

22. Copyright 2006Thomson 22 INFORMATION SOLUTIONS Universidad de Concepción Most cited papers from top Chilean Universities Source: National Citation Report: 1981-2004 source, citing and cited papers

23. Copyright 2006Thomson 23 INFORMATION SOLUTIONS Universidad Austral de Chile Most cited papers from top Chilean Universities Source: National Citation Report: 1981-2004 source, citing and cited papers

24. Copyright 2006Thomson 24 INFORMATION SOLUTIONS Measures of interaction: Citing Institutions # Chile cited papersInstitution 8020Universidad de Chile 4491Pontificia Universidad Católica de Chile 2666University of Texas 2620California Institute of Technology 2281Universidad de Concepción 2179European Southern Observatory 1899University of Arizona 1889University of California at Berkeley 1874Harvard University 1857University of Cambridge 1777Harvard Smithsonian Ctr Astrophysics 1771Johns Hopkins Univ 1768Space Telescope Sci Inst 1757CSIC 1754NASA 1549University of Washington 1453University of Tokyo 1432Universidad de Sao Paulo 1422University of Maryland 1395University of California at Los Angles (UCLA) These are the top 20 institutions citing Chilean papers. It shows the reach of Chilean research work. Top universities in the United States and UK as well as the universities in Tokyo and Sao Paulo are citing Chile’s research efforts.

25. Copyright 2006Thomson 25 INFORMATION SOLUTIONS Fields of specialization in institutions 4824GENERAL & INTERNAL MEDICINE 2,5371.9 1959EXPERIMENTAL BIOLOGY 18601.05 7869BIOCHEMISTRY & BIOPHYSICS 78510.02 4028MEDICAL RESEARCH, ORGANS & SYSTEMS 7315.51 9362SPACE SCIENCE49418.95 Universidad de Chile Pontificia Universidad Católica de Chile 194EXPERIMENTAL BIOLOGY 4130.47 656CHEMISTRY3142.09 911ENVIRONMENT/ ECOLOGY 2403.8 1484ORGANIC CHEMISTRY/ POLYMER SCIENCE 2286.51 1145AQUATIC SCIENCES2175.28 Universidad de Concepción Universidad de Santiago 379EXPERIMENTAL BIOLOGY 3651.04 432VETERINARY MEDICINE/ANIMAL HEALTH 3461.25 1379AQUATIC SCIENCES2505.52 3LANGUAGE & LINGUISTICS 1860.02 209GENERAL & INTERNAL MEDICINE 1671.25 Universidad Austral de Chile 4007GENERAL & INTERNAL MEDICINE 2,5371.9 1959EXPERIMENTAL BIOLOGY 18601.05 7869BIOCHEMISTRY & BIOPHYSICS 78510.02 4028MEDICAL RESEARCH, ORGANS & SYSTEMS 7315.51 9362SPACE SCIENCE49418.95 577CHEMISTRY2162.67 1575PHYSICS2137.39 1818PHYSICAL CHEMISTRY /CHEMICAL PHYSICS 2108.66 1202BIOCHEMISTRY & BIOPHYSICS 1368.84 689ORGANIC CHEMISTRY/ POLYMER SCIENCE 1046.63 Source: National Citation Report: 1981-2004 source, citing and cited papers

26. Copyright 2006Thomson 26 INFORMATION SOLUTIONS Journal rankings by papers Journal NamePapers REVISTA MEDICA DE CHILE 5,532 ARCHIVOS DE BIOLOGIA Y MEDICINA EXPERIMENTALES 3,313 ASTRONONOMY & ASTROPHYSICS 1,182 ASTROPHYSICAL JOURNAL 823 BOLETIN DE LA SOCIEDAD CHILENA DE QUIMICA 732 REVISTA CHILENA DE HISTORIA NATURAL 625 ASTRONOMY JOURNAL 599 ARCHIVOS DE MEDICINA VETERINARIA 477 JOURNAL OF DENTAL RESEARCH 420 ESTUDIOS FILOLOGICOS 290 REVISTA CHILENA DE LITERATURA 274 Source: National Citation Report: 1981-2004 source, citing and cited papers

27. Copyright 2006Thomson 27 INFORMATION SOLUTIONS Essential Science Indicators, 1995-2005 - Provides Top 1% of institutions by one or more of 22 fields Source: Essential Science Indicators, 1995-2005 Plant and Animal Science Universidad de Chile#443 out of 702 Pontificia Universidad Católica de Chile#601 out of 702 Universidad Austral de Chile#673 out of 702 Environmental Universidad de Chile#302 out of 400 Pontificia Universidad Católica de Chile#350 out of 400 Engineering Universidad de Chile#675 out of 926 Clinical Medicine Universidad de Chile#711 out of 2538 Pontificia Universidad Católica de Chile#1071 out of 2538 Chemistry Universidad de Chile#588 out of 768

28. Copyright 2006Thomson 28 INFORMATION SOLUTIONS Hot Paper in Mathematics: Universidad Católica del Norte Source: Essential Science Indicators, 1995-2005

29. Copyright 2006Thomson 29 INFORMATION SOLUTIONS Papers citing Mathematics hot paper Source: Essential Science Indicators, 1995-2005

30. Copyright 2006Thomson 30 INFORMATION SOLUTIONS Conclusions Bibliometric view of Chilean papers for the period 1981-2004 showed: –Chile’s research output has grown 67% over the period, with an average growth of 6%. –The impact or cites/paper has grown 50% and Chile is making strides towards the world baselines. While Chile is 3 rd in the region in output, it is 1 st in impact. –Clinical Medicine, Chemistry and Space Science are the top 3 fields of research output in Chile with the contributions in 4 fields exceeding the country’s overall world contribution –Institutional achievements and specializations at various universities –7 of the 11 Spanish-language journals in this group were Chilean –Chilean contributions in the top 1% of fields from Plant and Animal Science through Chemistry –Overall conclusion: the literature indicates an active and growing research community with a global reach and growing impact

31. Copyright 2006Thomson 31 INFORMATION SOLUTIONS www.in-cites.com Editorial content related to Essential Science Indicators: Papers Journals Scientists Journals Institutions Countries

32. Copyright 2006Thomson 32 INFORMATION SOLUTIONS www.sciencewatch.com

33. Copyright 2006Thomson 33 INFORMATION SOLUTIONS www.esi-topics.com

34. Copyright 2006Thomson 34 INFORMATION SOLUTIONS Mary Van Allen mary.vanallen@thomson.com Gracias!