1. How Web of Knowledge Can Help Kyrgyzstan Research, It’s Visibility and Influence
David Horky & Metin Tunc 1

2. Agenda Thomson Reuters Effective Research Evaluation
Editorial Policy and Content
Web of Science
Journal Citation Reports with Impact Factors
Few Examples From Kyrgyzstan

3. Thomson Reuters
17th April, 2008: The Thomson Corporation and Reuters Group PLC combine to form Thomson Reuters
Thomson Reuters is the world’s leading source of intelligent information for businesses and professionals
More than 50,000 employees
Offices in 93 countries worldwide

4. How is Research Evaluation done?
Combination of various methodologies and approaches, e.g.:
Overall number of received grants
Number of awards (e.g. Nobel Price)
Peer-review
Publication activity
Citation count
Peer review – expensive, results are subjective
Not a single one of the indicators above works well by themselves. Independent expert interpretation of the results is necessary
Bibliometrics should always be taken in context

5. Increasing Interest in Bibliometric Methods
Countries with large research potential actively pursue bibliometric indicators when evaluating results of scientific activity
These days whole teams of analytics operate in may countries of the world. They prepare bibliometric analyses.
Practically in 100% cases the bibliometric analyses is based on Thomson Reuters data.

6. The world’s most used database for research evaluation
Izmir, Turkey - 15 May 2008
Web of Science®
The world’s most used database for research evaluation 6

7. A BRIEF HISTORY OF THE CITATION INDEX
Concept first developed by Dr Eugene Garfield
Science, 1955
The Science Citation Index (1963)
SCI print (1960’s)
On-line with SciSearch in the 1970’s
CD-ROM in the 1980’s
Web interface (1997) Web of Science
Content enhanced:
Social Sciences Citation Index (SSCI)
Arts & Humanities Citation Index (AHCI)
The Citation Index
Primarily developed for purposes of information retrieval
Development of electronic media and powerful searching tools have increased its use and popularity for purposes of Research Evaluation 7

8. USE OF WEB OF SCIENCE DATA IN MAJOR RESEARCH EVALUATIONS
World Academic Rankings:
Times Higher Education Ranking
ARWU (Shanghai) ranking
Major Country and EU–wide research evaluations:
US National Science Foundation
EU – Research Council
And many others
Кратко можно резюмировать что этот источник дает нам и ведущим научным организациям в мире как Университеты или Times Higher Education
Тематическое информирование
Справочно-библиографическое обслуживание
Формирование собственных баз данных
Поисковый интерфейс для пользователей любого уровня (ученые, аспиранты, студенты)
Аналитические инструменты - библиометрические исследования

9. GOVERNMENTS AND INSTITUTIONS USING TR DATA FOR EVALUATION
France: Min. de la Recherche, OST - Paris, CNRS
Germany: Max Planck Society, several gov’t labs, DKFZ, MDCUS: National Institutes of Health
United Kingdom: King’s College London; HEFCE
European Union: EC’s DGXII(Research Directorate)
US: NSF: biennial Science & Engineering Indicators report (since 1974)
Canada: NSERC, FRSQ (Quebec), Alberta Research Council
Australian Academy of Science, gov’t lab CSIRO
Japan: Ministry of Education, Ministry of Economy, Trade & Industry
People’s Republic of China: Chinese Academy of Science
Czech Republic: Czech Academy of Sciences; Government
Etc.

10. ISI WEB OF SCIENCE GLOBAL REACH TODAY: >6,000 CUSTOMERS IN 91 COUNTRIES
832+
customers
North
America
Europe,
Middle
East and
Africa
3,162+ Customers
In 51 countries
Asia-
Pacific
680+ Customers
in 26 countries
262+ Customers
in 12 countries
Latin
America
ISI Web of Science
20 million individual users
150,000 users every day
> 6,000 institutional users
> 12,500 journals, > 47 million records, > 750 million cited references 10 10

11. Times Higher Education
In November 2009, Times Higher Education (THE) announced:
“We have signed an agreement with Thomson Reuters, the world’s leading research data specialist, to provide all the data for our annual World University Rankings from 2010 and beyond
We have decided to end our relationship with QS, who will have no further involvement in Times Higher Education's annual World University Rankings.”
Thomson Reuters Global Institutional Profiles Project will be used as the data source for the Times Higher Education World University Rankings for 2010 and beyond
In November 2009, Times Higher Education (THE) announced:
“We have signed an agreement with Thomson Reuters, the world’s leading research data specialist, to provide all the data for our annual World University Rankings from 2010 and beyond
We have decided to end our relationship with QS, who will have no further involvement in Times Higher Education's annual World University Rankings.”
Thomson Reuters Global Institutional Profiles Project will be used as the data source for the Times Higher Education World University Rankings for 2010 and beyond.

12. The Concept of Citation
2004
The Concept of Citation
2006
Times Cited
2003
2007
2000
Cited References
2000
Related Records
1974
1998
2004
Locate a single paper using traditional search techniques, this is the paper in the center of the screen. Click the “Cited References” link to see all the research that this discovery was based upon. Click the “Times Cited” link to see the more recent developments. Click “Related Records” to see research that is closely related to the original article. Related Records using the concept of co-citation to establish the relationship; based on the fact that similar items often cite the same thing.
A CONNECTED network/ universe: from 1900 to today: tracing the evolution of the subject
1993
1999
2002
1994

13. Web of Science® overview
Multidisciplinary- Science, Social Science, Arts & Humanities
Largest citation index: >44 million records (1.9M in 2008)
More than 11,000 unique journal titles
More than 12,000 conferences covered annually
Data is updated weekly with short indexing lag
More than 100 years of uninterrupted coverage
Century of Science
1900
Science Citation Index
1945
Century of Social Sciences
1900
1956
SSCI
A&HCI
1975
CPCI
1990

14. Authority Evaluated authoritative content
Izmir, Turkey - 15 May 2008
Authority
Diversity
Evaluated authoritative content
Team of specialists evaluate journals to ensure that the content is trustworthy
Third party evaluation of all journals regardless of source:
Commercial publishers
Academic societies
Open Access journals
The core component of the Web of Knowledge is the Web of Science. The Web of Science content has 4 key benefits to the user. First of all is the Authoritative content.
Our team of highly qualified and experienced editors select journals for coverage using a stringent and time tested journal selection process. Because we are not associated with any primary publishers of academic journals our selection process is unbiased and impartial. We evaluate all types of journals including journals from commercial publishers, academic society journals, open access journals and electronic only journals.

15. WHY BE SELECTIVE? 40% of the journals: 80% of the publications
92% of cited papers
4% of the journals:
30% of the publications
51% of cited papers

16. WEB OF SCIENCE JOURNAL SELECTION POLICY
Approx journals evaluated annually
10-12% accepted
Thomson Reuters editors
Information professionals
Librarians
Experts in the literature of their subject area
Journal ‘quality’
Web of Science
Journals under evaluation

17. Izmir, Turkey - 15 May 2008
WHY EVALUATE JOURNALS?
Authority
Thomson Reuters’ editorial staff review around 2,000 new journals annually % of these journals are added
Basic publishing standards
Timeliness, Follows publishing conventions, Peer Review
English language bibliographic information
Editorial content, International Diversity
Will it enrich the database? Is it a hot topic?
Citation analysis
Impact Factor, Immediacy index
How the journal compares to other journals in its field
Citation analysis of editorial board
More information: science.thomsonreuters.com/mjl

18. JOURNAL CITATION REPORTS AND IMPACT FACTOR
В этой части презентации я хотела бы сказать Вам несколько слов о JCR, напомнить вам определение и способ расчёта Impact Factor, показать правильный способ использования его при оценке журналов и представить примеры грамотного пользования IF.
JCR это прежде всего доступ к данным, облегчающим оценку и сравнивание академических изданий. Это основной и уникальный источник, а точнее говоря инструмент для оценки журналов с использованием данных о цитатах (citation data) более чем из (восьми тысяч) журналов, изданных более чем 3,300 (издамелсмвам) , примерно из 60 (шестидесяти) стран. Создал это Dr. Garfielda более 40 (сорока) лет назад, но до сих пор этот инструмент является единственным и неповторимым в мире. Иначе говоря, JCR разработанный Thomson Reuters, является абсолютным мировым авторитетом в оценке научных изданий.
JCR включает в себя все категории естественных и общественных наук и эти два индекса содержатся в JCR. В нём показаны также взаимосвязи между цитирующими и цитируемыми журналами, а также статистические данные для отдельных журналов и областей науки. Целиком это представлено в ‘framework’ – удобном и наглядном в использовании. 18

19. JOURNAL CITATION REPORTS:
A UNIQUE RESOURCE TOOL TO COMPARE AND EVALUATE JOURNALS
Coverage of the most influential science and social sciences journals
Develivers citation-based, objective evaluation through quantifiable, statistical data
Versatile data refinement, sorting and analysis tools
Valuable metrics such as Impact Factor and Eigenfactor™
Full integration with ISI Web of KnowledgeSM data and tools
We are like a library; we are very careful in what we select. JCR is a result of this activity
provides easy access to data that helps you evaluate and compare scholarly journals. It is an essential, comprehensive, and unique resource tool for journal evaluation, using citation data drawn from over 7,500 journals from over 3,300 publishers in over 60 nations (check)
Journal Citation Reports is the only source of citation data on journals. It includes virtually all specialties in the areas of science, technology, and the social sciences. Moreover, it shows the relationship between citing and cited journals in a clear, easy-to-use framework.
The only source of citation data on journals
A Web-based Thomson Reuters solution for analysis of journals, authors, institutions and more, using citation data
A recognized authority for evaluating journals

20. WHY IS JCR USEFUL? WHO USES IT?
You can:
Measure research influence and impact at the journal and category levels
Support academic curriculum and your library’s collection development
Evaluate and document your institution’s research investment
Identify the most appropriate, influential journals in which to publish

21. EFFICIENCY JOURNAL IMPACT FACTOR
2009
2008
2007
Source paper – published in 2009
Cited reference – published in 2007 or 2008
Citations
All Previous Years
2006
2010
2009 Impact Factor

22. 2009 JCR IMPACT FACTOR CALCULATION
2009 CITES TO CONTENT
TOTAL # ARTICLES PUBLISHED IN
An Impact Factor IS: A journal level metric, normalizes citation count by the amount of scholarly citable content
An Impact Factor is NOT: An article level metric. Individual article citation counts vary greatly even within a single volume and year.
Impact Factor:
…the average number of times recent articles in a journal were cited in a particular year.
…citation performance of the journal as a whole, and not the performance of any specific article. 22 22

23. CALCULATING 2008 IMPACT FACTOR PHYSICS-USPEKHI
Citations in 2008
To items published in 2007 = 110
To items published in 2006 =
Sum = 299
299
121
= 2,471
Number of items
Published in 2007 =
Published in 2006 =
Sum =

24. Journal Citation Reports Category: Physics, applied
Impact Factor – indicator shown exclusively in Journal Citation Reports
Measure research influence and impact at the journal and category levels
Support academic curriculum and your library’s collection development
Evaluate and document your institution’s research investment
Identify the most appropriate, influential journals in which to publish
Category: Physics, applied

25. Izmir, Turkey - 15 May 2008
Research Evaluation based on Web of Science Few Examples From Kyrgyzstan

26. RESEARCH EVALUATION Citation analysis based on world’s standard
Izmir, Turkey - 15 May 2008
RESEARCH EVALUATION
Citation analysis based on world’s standard
Although the main objective of the Web of Science is intended to aid researchers to retrieve information, it is also commonly used as a research evaluation tool:
Count Papers  measure productivity
Count Citations  measure utility and influence
Based on the concept that if an article is cited it is an influential paper, or has had an impact upon the research community.
This concept can be extended beyond individual articles and used to evaluate:
Authors Counties and geographic regions
Journals Institutions
Topics

27. HELPING BOOST VISIBILITY AND INFLUENCE OF KYRGYZSTAN’S RESEARCH
Web of Science subscription helps increase the number of articles published in world’s most influential journals

28. Analyses, comparisons and ranking of countries, institutions, topics etc.

29. A SIMPLE ANALYSIS OF RESEARCH IN KYRGYZSTAN
Izmir, Turkey - 15 May 2008
A SIMPLE ANALYSIS OF RESEARCH IN KYRGYZSTAN
DATA FROM 05/2012
More than 1,500 journal articles and conference proceedings
These works have been cited more than 5,000 times

30. Kyrgyzstan Academy of Sciences Kyrgyzstan National University
Which Kyrgyzstan institutions have the highest number of articles in the Web of Science?
Kyrgyzstan Academy of Sciences
Kyrgyzstan National University
Kyrgyz Russian Slavic University
Kyrgyz State Medical Academy
American University of Central Asia

31. Izmir, Turkey - 15 May 2008
Kyrgyzstan: In which subject areas most articles were published? (top 10)

32. The most highly cited articles of Kyrgyzstan researchers
Izmir, Turkey - 15 May 2008
The most highly cited articles of Kyrgyzstan researchers

33. Web of Science Record – Article Abstract

34. Thank you! science.thomsonreuters.com
wokinfo.com/russian
David Horky & Metin Tunc 34