Guillaume Rivalle APRIL 2014 MEASURE YOUR RESEARCH PERFORMANCE WITH INCITES

Annual reports, Board of trustees reports Strategic plans/performance dashboards Strategic publishing/funding Competitive analysis PR, research magazines Recruitment, expert finding Collaboration analysis Departmental research strategy Building an institutional repository Build faculty expertise database HOW DO CUSTOMERS USE INCITES? Universities and other research producing institutions Research funding organizations Publishers Corporate sector

2 INTEGRATE CITATION METRICS INTO YOUR WORKFLOW INSTITUTIONAL REPOSITORIES Support data capture, public profiles, etc. RESEARCH MANAGEMENT SYSTEMS Feed internal or approved 3 rd party systems INTERNAL REPORTING Share among stakeholders at your institution EXTERNAL REPORTING Support strategic, funding and marketing activities InCites

3 THE CHALLENGES OF USING CITATION METRICS Work with « clean », unified and consistent data Generate relevant and normalised indicators Work and visualize several indicators (multiple angles) simultaneously Quickly and regularly produce standardised and reliable reports Identify weaknesses and demonstrate strengths of research activities Analyse collaborations and identify the most fruitful and efficient ones Being able to run fair comparisons between entities (people, departments, universities, countries, etc.)

4 WEB OF SCIENCE- A TRULY UNIQUE CITATION RESOURCE Selectivity and control of content: consistent, transparent standards Content: journals,12000 annual conferences books and 800 million Cited References Multidisciplinary: 251 subject categories Consistent and reliable data: - Cover-to-cover indexing - Cited references for all years of coverage - Indexing of all author names and addresses Funding acknowledgments: link funding source to outputs

INDEXING DIFFERENT LEVELS OF METADATA CAPTURE 5 MEDLINE/PUBMED record Web of Science Core Collection record

All Authors All Affiliations All Funding sources All Authors All Affiliations All Funding sources Without consistency, no meaningful data analysis is possible

JOURNAL SELECTION PROCESS FOR WEB OF SCIENCE Core Collection Journal Publishing Standards Editorial Content International Diversity Citation Analysis Four Points of Evaluation Core coverage in Web of Science is not static ! NEUTRAL

For decades, Thomson Reuters has carefully evaluated journals for potential inclusion in the database 100 % of the top 100 universities have Web of Science GOLD STANDARD used by 7,000+ institutions in 100+ countries SELECTIVE……YET COMPREHENSIVE

Web of Science data provide the foundation for research analytics solutions Thomson Reuters data sources and expertise Client Expertise and Information Address unification (5000 unified institutions by 2015) Author-Affiliation linking Normalization & baselines Default 10 years world dataset Researchers Departments, research units, institutes Repository InCites Researchers Profiles InCites Reports RIV

How “good” is this? What is the context? Additional metrics are needed to understand research performance cites/paper H-index: 13 Citation rates vary among fields and scientific communities. What is good or average in mathematics is very different from what is good or average in biochemistry. InCites provides REAL Metrics 14.5 cites/paper H-index: cites/paper H-index: cites/paper H-index: 3 10

11 Should this article be one of the most impactful publication of this author? Is this a high number of citations? Should this article be one of the most impactful publication of this author? Is this a high number of citations? The JIF is informative because it gives me the average influence of a journal, NOT of a researcher/institution/country/…

12 According to Essential Science Indicators, this article is within the 1% of the most cited 2011 articles in Chemistry Should this article be one of the most impactful publication of this author? Is this a high number of citations? Should this article be one of the most impactful publication of this author? Is this a high number of citations?

A new Essential Science Indicators

14 For each publication, InCites will take into account different data points for creation of truly Contextualized impact. According to InCites, this article has an impact that is 126 times above the expected impact in this category, and 58 times above the expected impact for this journal For each publication, InCites will take into account different data points for creation of truly Contextualized impact. According to InCites, this article has an impact that is 126 times above the expected impact in this category, and 58 times above the expected impact for this journal

Run Direct comparisons between the world’s institutions, countries, journals, researchers, EXAMPLES

Run Direct comparisons between the world’s institutions, countries, journals, researchers, EXAMPLES

Quickly analyze the effects of a collaboration EXAMPLES

Drill into one institution publication activities EXAMPLES

Use the “Analytics” tab to access your existing reports, do new analyses and generate new ‘tiles’ The “Explore” features allow you to do comprehensive analyses of various different entities

“System Reports” allow you to access various pre-configured reports “Scenario Planner” is designed to help you test the impact of various scenarios. For example the potential of a proposed merger or the impact of hiring a particular individual

The ‘Explore Organizations’ page lets you run complex analyses, browse institutions and benchmark your performance to peers,

Filter results using a variety of attributes

Also limit your search to certain research areas, document types, specific journals or to articles in Open Access journals

Change the type of visualization Each report (tile) can be based on any group of publications, e.g a researcher, a department, an institute, a journal, a topic, a country, etc. Each tile can be drilled through for analysis at individual article level Reports can be shared and sent to other users

By saving and building up a collection of your own tiles you can create your own ‘Dashboard’. Easy to access, interpret and share, yet built on robust and careful analysis

A new Journal Citation Report with more powerful and flexible analysis capabilities

Click a specific category in the Node & Link Network or the # of journals to view the journals for that category Navigate between journal or category ranks

Instantly search any journal title

Easily navigate to previous editions of the JCR to view trends. All customers have access to the full archive back to 1997

All customers have access to both Science and Social Sciences editions of the JCR at the same time. For the first time it is possible to group journals by the Essential Science Indicators subject classification schema of 22 disciplines

Limit your analysis to only those journals in certain quartiles of their subject area Or limit to a specific range of Impact Factors

Guillaume Rivalle APRIL 2014 MEASURE YOUR RESEARCH PERFORMANCE WITH INCITES