1. Evaluation Activities
Shawon Lahiri
MB meeting October, 2018
Leuven

2. 8.0. Evaluation activities
1. AMR Bibliometric analysis
Information and outcome of bibliometric analysis
2. Mapping AMR R&D landscape
Discussion on the research investments mapping; on gap analysis and research prioritisation
3. Database/ Dashboard
Discussion on display of the projects database
4. Overview of Monitoring policies of JPIAMR funded projects and networks
Decision- adoption of monitoring policy

3. 8.1. AMR bibliometric analysis
Aims to provide a set of bibliometric indicators such as publication count, field normalised citation rate, and share of publications above the 90th citation percentile for scientific publications related to anti-microbial resistance (AMR) research.
Publications were selected based on a keyword search in title and abstract from records in the Swedish Research Council (SRC) Bibliometric Database based from Clarivate Analytics.
Keywords were limited to bacterial infections and their prevention and treatment and grouped in six categories corresponding to keywords mapping research publication related to the six pillars of the JPIAMR Strategic Research Agenda.
The analysis was performed on publications published between 2008 and 2017.
Publications mapping on keywords related to therapeutics was the largest area in all countries.
“The JPIAMR bibliometric analysis of AMR scientific publications 2018” (original articles and review articles)
Patriq Fagerstedt, Swedish Research Council

4. 8.1. AMR bibliometric analysis: Overview of AMR related publications from Sweden
National data of Sweden on publications are presented for the years together with ranking of journals, authors, and affiliations.
Patriq Fagerstedt, Swedish Research Council

5. Diagnostics (Share of top 10% publications vs volume)
The indicators for number of publications vs the share of publications above 90th citation percentile (top 10%) during the period were plotted for all JPIAMR countries for each of the six pillars.
Patriq Fagerstedt, Swedish Research Council

6. 8.1. AMR Bibliometric analysis: Next steps
Final report on summarised bibliometric analyses to be prepared to support discussions for the SRiA workshop related to Roadmap development and research prioritisation.
Patriq Fagerstedt, Swedish Research Council

7. 8.2. Mapping AMR R&D landscape

8. 8.2. Mapping AMR R&D landscape
To obtain a comprehensive picture of the antimicrobial resistance (AMR) research landscape within the different JPIAMR member countries.
To obtain an overview of the grant investments, research capacity and research scope among JPIAMR member countries for AMR research.
Of the 27 member countries, only 22 countries provided information related to their investments at national level along with EU commission for the 2017 mapping exercise to scale AMR research landscape.
Data were not available from: Denmark, Greece, India, Poland and Romania

9. 8.2. Mapping AMR R&D landscape
Data inclusion criteria:
Grant investments by different organisations of JPIAMR member countries for awards that are active or where funding has been committed on 1st January 2017 were collected.
Both basic bacteriology and relevant to AMR research were included (projects pertaining to only viral infection/resistance were excluded).
Information on grant investments in fungal and parasite resistance were also included in this mapping.
Limitations:
The data provided is partial.
Includes information on only competitive grants.
Information on institutional funding of respective countries are not reflected in the dataset.

10. JPIAMR member countries
8.2. Mapping AMR R&D landscape: Total grant investments
Contributions from
2017
2015
No. of Projects
Total Investment (€)
Total Investment
(€)
JPIAMR member countries
1,787
1,331,860,000
1,189
679,557,086
European Commission
178
451,320,000
105
314,072,980
Overall
1,965
1,783,160,000
1,294
993,630,066
3.6%
3.3%
Proportion of total investment per resistance area of research
Proportion of total investment per priority areas

11. 8.2. Mapping AMR R&D landscape: General conclusions
A general trend in increased investment towards AMR research is observed from the mapping exercise at national levels.
Majority of awards are directed towards the priority topic of Therapeutics; investment increased for other priority areas as well.
A big gap in investments in Environment exists.

12. 8.2. Mapping AMR R&D landscape: Next steps
Final Mapping report to be prepared by end of November, 2018 to support discussions for the SRiA workshop related to Roadmap development.
Efforts are directed towards making the information collected from both the mapping exercise to be publicly available through a searchable database/dashboard hosted by JPIAMR.
The report and the dashboard will be published together.

13. Keyword-based search; allocated resource-based search
How we can utilise the mapping data to identify gaps for research/ investment prioritisation
Scaling current landscape by collecting relevant AMR research data and how resources are presently allocated to these processes (mapped data/ dashboard)
what has already been funded across the different strategic research areas of AMR.
what is yet required, in order to help set strategic priorities.
"where we are“
"where we want to be“
Keyword-based search; allocated resource-based search

14. 8.3. Database/Dashboard: AMR research landscape
Simple representation of the the global AMR research investments landscape
Dynamic dashboard with visual analytics
Keyword search (restricted to title)
As an example please check the H2020 interactive project data

15. Next steps 8.3. Database/Dashboard: AMR research landscape
Dashboard to be finalised by end of November 2018 to be utilised for research prioritization.
Dashboard and the mapping report to be published by the end of

16. 8.3. Database The integrated database with three major pillars
AMR research (funding towards AMR research landscape)
AMR infrastructure (Research infrastructure and Research Centers)
AMR industry (pipeline-focused dataset)

17. What we aim to achieve now
AMR research (Mapping the global AMR investments landscape): Dashboards with visual analytics
AMR infrastructure (Research infrastructure and Research Centers): To be integrated with the VRI platform
AMR industry (pipeline-focused dataset): Overlapping efforts with Spark (Pew trust) and WHO observatory

18. 8.4. Monitoring policy for JPIAMR funded projects and networks
Mid term monitoring 1,5 years after the start of the projects
First ex-post report 2 months after the end of the projects
Second ex-post follow-up 3 years after the end of the projects
Timeline of the Monitoring policy of JPIAMR supported Transnational Research Projects
Final ex-post report 2 months after the end of the funding
Workshop to present results from the research networks 1.5 years after the funding commenced
Second ex-post follow-up 2 years after the end of the funding
Timeline of the Monitoring policy of the JPIAMR supported research networks

19. 8.4. Monitoring policy for JPIAMR funded projects and networks
Midterm monitoring
On-line reporting Comprehensive analyses by JPIAMR secretariat
Report and analyses shared with JCS and CSG
First ex-post monitoring
On-line reporting Detailed analyses by JPIAMR secretariat on research outputs
Summarised report shared with SAB, JCS and CSG
SAB performs qualitative assessment and provides a commentary
Second ex-post monitoring
On-line reporting Additional analyses by JPIAMR secretariat on research outputs
Summarised report shared with SAB and CSG
Process for overall assessment of achievements of completed projects

20. Thank you!
@JPIonAMR