1. Evaluation of National Veterinary Services using the OIE PVS Tool
Workshop for OIE new Delegates of Europe
ENSV, Lyons, France
4 – 5 November 2008
Gastón Funes
Head, Regional Activities Department

2. OIE-PVS Evaluation Topics of the presentation: Background
Basis in OIE standard
Objectives
Procedures
Evaluation process
Gap analysis
Follow-up

3. SOME KEY FACTS Established in 1924: 172 Members
Intergovernmental organisation – predates the UN
Permanent Regional Representations: Bamako (Mali), Buenos Aires (Argentina), Tokyo (Japan), Sofia (Bulgaria) and Beirut (Lebanon)
Sub-regional Offices: Bangkok (Thailand), Gaborone (Botswana), Panama, Brussels (Belgium)
Regional Commissions: Africa, America, Asia-Pacific, Europe and Middle East 50 13
Go through OIE objectives that are related to the subject of this conference
Guarantee the transparancy of the world zoosanitary information
To encourage international solidarity in the control of animal diseases : avian influenza does not need a passport
To provide healt standards for international trade: to give the CVO’ s recommendations on the trade of animals and animal products in case of an outbreak of one of the listed diseases. This will provide unjustified trade barriers, lead to fairer trade and is of benefit for the developing countries.
Provide a better guarantee of the safety of food of animal origin. 29 52 28

4. ‘The improvement of animal health all around the world’
OIE MANDATE
Historical: ‘To prevent animal diseases
from spreading around the world’
The 4th Strategic Plan 2006/2010 extends the OIE’s global mandate to:
‘The improvement of animal health all around the world’

5. OIE OBJECTIVES ANIMAL HEALTH INFORMATION
to ensure transparency in the global animal disease and zoonosis situation
to collect, analyse and disseminate scientific veterinary information

6. OIE OBJECTIVES INTERNATIONAL STANDARDS
to promulgate health standards for the safety of international trade in animals and animal products (within its WTO mandate) and animal disease surveillance
to contribute to food safety and food security
and to promote animal welfare, through a science-based approach

7. OIE OBJECTIVES ACTIVITIES OF VETERINARY SERVICES
to provide expertise and encourage international solidarity in the control of animal diseases
to improve the legal framework and resources of national Veterinary Services
PVS concept linked with these objectives

8. OIE INTERNATIONAL STANDARDS
Official references of the World Trade Organisation SPS Agreement
Adopted by consensus of OIE Members
Terrestrial Animal Health Code
mammals, birds and bees
Available at
Section 3: Quality of Veterinary Services
Chapter Veterinary Services
Chapter Evaluation of VS

9. Evaluation of the Performance of
Veterinary Services

10. What is the OIE-PVS Tool?
An assessment tool on level of compliance with OIE international standards on Quality and Evaluation of Veterinary Services
Chapter 3.1.: Veterinary Services
Chapter 3.2.: Evaluation of VS

11. Use of the OIE-PVS Tool
Self evaluation performed by internal and/or OIE experts
for the purpose of assessing the performance of VS
…process reviewed on a regular basis to monitor improvements

12. Use of the OIE-PVS Tool
An evaluation relevant to bilateral negotiations between trading countries:
… performed at the request of either country
…best done by mutual agreement

13. Use of the OIE-PVS Tool
An independent objective evaluation that provides a strong legitimization of a request for national and/or international financing
Major donors have accepted the use of the OIE PVS Tool and the criteria in the Code in the evaluation of performance and priorities of VS, as a prerequisite and a key guide in helping countries make requests for investment

14. Output of OIE-PVS Evaluation:
“First diagnostic” of conformity of VS with OIE standards on Quality, which allows:
Gap identification (legitimacy of the request and leverage effect):
..national use for self improvement;
..external use for financial support;
..use for credibility in international trade.

15. Legal Basis (OIE Code) from Article 3.2.1.
The purpose of evaluation may be
to assist a national authority in the decision-making process regarding priorities for its own VS (self-evaluation)…
to assist the process of risk analysis in international trade … to which official sanitary and/or zoosanitary controls apply.

16. Legal Basis (OIE Code) from Article 3.1.3.
“Members should recognise the right of another Member to undertake, or request it to undertake, an evaluation of its VS where the initiating Member is an actual or prospective importer or exporter of commodities, and where the evaluation is to be a component of a risk analysis process which is to be used to determine sanitary measures to be applied to trade.”

17. OIE Code: Reference to OIE PVS-Tool:
from Article
Evaluation facilitated by OIE experts under the auspices of the OIE
…procedures for the evaluation of VS upon request by Members,
International Committee endorses a list of approved experts…,
Experts facilitate the evaluation of VS of Members based on the provisions in Chapter 3.2., using the OIE Tool for the Evaluation of Performance of Veterinary Services (OIE PVS Tool).

18. OIE Tool for the Evaluation of Performance of Veterinary Services
OIE-PVS Tool
OIE Tool for the Evaluation of Performance of Veterinary Services

19. 4 fundamental components Critical competencies (6 - 12)
OIE PVS TOOL
PVS
4 fundamental components
Critical competencies (6 - 12)
5 levels of advancement

20. OIE PVS TOOL 4 FUNDAMENTAL COMPONENTS
Human, physical and financial resources
Technical authority and capability
Interaction with stakeholders
Access to markets

21. OIE PVS TOOL
critical competencies in each fundamental component
I) Human, physical and financial resources
Professional and technical staffing
Competencies of veterinarians and veterinary para-professionals
Physical resources
Funding ……

22. Level 5 full compliance with OIE standards
OIE PVS TOOL
5 levels of advancement (qualitative) for each critical competency
Level 1 no compliance
Level 5 full compliance with OIE standards
A higher level assumes compliance with all preceding levels

23. OIE PVS TOOL Critical competency II-1 Veterinary Laboratory Diagnosis
Example
Critical competency II-1
Veterinary Laboratory Diagnosis
Definition:
‘The authority and capability of the VS to identify and record pathogenic agents, including those relevant for public health, that can adversely affect animals and animal products’.

24. Example II. 1 Level Veterinary Laboratory Diagnosis 1.
Disease diagnosis is almost always conducted by clinical means only,
with laboratory diagnostic capability being generally unavailable. 2.
For major zoonoses and diseases of national economic importance, the VS have access to and use a laboratory to obtain a correct diagnosis. 3.
For other zoonoses and diseases present in the country, the VS have access to and use a laboratory to obtain a correct diagnosis. 4.
For diseases of zoonotic or economic importance not present in the country, but known to exist in the region and/ or that could enter the country, the VS have access to and use a laboratory to obtain a correct diagnosis. 5.
In the case of new and emerging diseases in the region or world, the VS have access to and use a network of national or international reference laboratories (e.g. an OIE Reference Laboratory) to obtain a correct diagnosis.

25. OIE PVS APPROACH External independent evaluation
Upon request of the country
according to its context
To assess
Compliance with OIE Standards
Strengths / Weaknesses
Gaps / areas for improvement
Not an audit

26. OIE PVS APPROACH Experts trained and certified by the OIE
Assessment based on facts & evidence, not impressions
Donors have accepted the use of the OIE PVS Tool in the evaluation of the performance of VS
A prerequisite and a guide in helping countries request national and/or international financial support needed to make improvements

27. STEPS IN THE OIE-PVS EVALUATION
Official request from the OIE Delegate
Propose names of experts and dates
EVALUATION (documents and mission)
Draft Report
Peer review
Country agreement/comments on the draft report
Final report confidential until this stage
…for release only if agreed

28. OIE-PVS Evaluation Team
Team Leader + Expert(s)
…+ Observer(s) …+ Facilitator(s)
~ 150 OIE certified PVS experts trained so far
(May 06; July 06; Feb. 07 and in Feb. 08) (adopted by OIE Members and recognised by donors)
Four operating languages: EN, FR, SP & RU
Geographical balance
Missions financed through the OIE World Fund

29. OIE-PVS Evaluation OIE Forum for discussions and analysis:
OIE-PVS internal Task Force
OIE Ad Hoc Group on Evaluation of VS
OIE specific workshops (feed back experts)
Useful elements:
OIE-PVS Tool
Indicators for each CC
OIE-PVS Manual of the Assessor:
Vol 1: Guidelines for conducting an evaluation
Vol 2: Guidelines for writing an evaluation report

30. PVS Evaluation Missions – (As at 31 October 2008)
REGION
Official requests
from countries
Missions completed
Gap analysis
requests
AFRICA 36 32 6
AMERICAS 16 10 1
ASIA/ PACIFIC 13
EUROPE 11 9 2
MIDDLE EAST 12
TOTAL* 88 67
AFRICA (36): Algeria, Benin, Burkina Faso, Burundi, Cameroon, Chad, Côte D’Ivoire, Congo (DR), Djibouti, Egypt, Eritrea, Gabon, Ghana, Guinea, Guinea-Bissau, Kenya, Lesotho, Madagascar, Malawi, Mali, Mauritania, Mauritius, Morocco, Mozambique, Namibia, Niger, Nigeria, Senegal, Swaziland, Sudan, Tanzania, Togo, Tunisia, Uganda, Rwanda, Zambia.
AMERICAS (16): Barbados, Belize, Bolivia, Brazil, Colombia, Costa Rica, Dominican Republic, Guyana, Honduras, Jamaica, Mexico, Panama, Paraguay, Peru, Salvador, Uruguay.
ASIA/PACIFIC (13): Bangladesh, Bhutan, Brunei, Cambodia, Fiji, Indonesia, Korea (PDR), Lao, Mongolia, Nepal, Philippines, Sri Lanka, Vietnam.
EUROPE (11): Albania, Armenia, Azerbaijan, Bulgaria, Kazakhstan, Kyrgyzstan, Romania, Tajikistan, Turkey, Ukraine, Uzbekistan.
MIDDLE EAST (12): Afghanistan, Bahrein, Jordan, Lebanon, Kuwait, Qatar, Saudi Arabia, Palestinian National Authority, , Oman, Syria, UAE, Yemen,
Most of pending missions are planned until the end of the year 2008.

31. PVS Evaluation Missions in Europe
(As at 31 October 2008)
Country
Missions carried out
Report Released
Albania
yes
Armenia
Azerbaijan
Bulgaria
In planning
Kazakhstan
Yes
Kyrgyzstan*
Romania
Tajikistan
Turkey*
Ukraine
Uzbekistan
* Gap Analysis Request

32. Improving PVS process: Lessons Learnt
Delays or no answers from MC after OIE proposal;
Problems on communication/coordination between TL and the country for the previous organisation of the mission;
Provision of information and documents from the country to TL (designation of contact person);
Sooner answer (comments/agreement) from the evaluated country on the PVS report;
Authorisation from evaluated countries to release the report;

33. Improving PVS process: Lessons Learnt
Role of OIE Reg. and Sub-Reg. Representations:
Helpers / facilitators / nexus, between:
-Team Leaders and countries,
to help TL in getting information in advance,
-Countries and OIE HQs,
to get answers from MC,
to get agreement/comments from countries,
on the report,

34. “Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities”

35. Using OIE-PVS Evaluation results…
OIE-PVS Evaluation = “1st Diagnostic” (qualitative):
Compliance with OIE Standards
Strengths / Weaknesses
Gaps / areas for improvement
Next step of the process, “Treatment”:
Gap Analysis:
Evaluation of Needs and Priorities
(quantitative assessment of corresponding needs)
Preparation of strengthening investment programmes

36. Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities
PVS Gap Analysis: baseline for the investment programs
Investment programmes: prepared in collaboration with OIE partners (FAO) and donors
Need of additional expertise: economists, project managers, etc.
Deep involvement of countries concerned: priority setting process (national factors and conditions)
Focus on specific FC or CC
Shifting from level “x” to “x +1” or to “x + 2”….

37. Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities
To identify specific activities, tasks and resources required to address “gaps” (from PVS evaluation)
To determine priorities (country involvement)
Estimation of costs (collaboration from partners and donors)
Preparation of investment programmes (involvement of country and commitment from donors)

38. Gap Analysis Missions Upon request of countries
Team composed by OIE-PVS Experts + partners + donors + local team
Desk review of PVS report + o identify specific activities, tasks and resources required to address “gaps” (from PVS evaluation)
Gap Analysis template (based on PVS structure)
GA Manual (to be developed with partners/donors)
Training on GA ofr PVS experts and others

39. OIE Complementary Assistance to GA
Sanitary Legislation Model: Specific missions
Laboratory twinning proposals
OIE Vaccine Bank support (AI)
Regional training programmes for OIE Delegates and focal points
PVS follow up missions

40. OIE-PVS Follow Up missions GA and implementation of Projects
PVS Evaluation
« 1st Diagnostic »
GA and implementation of Projects
« Treatment »
Continuous missions (each 1-2 years)
Upon request of countries
OIE-PVS Experts
Monitoring and improvement process
Assessment of progressive evolution of steps taken
Final objective: compliance with OIE standards
PVS Follow Up missions
Evaluation of
« Evolution »

41. of Veterinary Services OIE Objectives can not be achieved »
« Without Good Governance
of Veterinary Services
OIE Objectives can not be achieved »

42. World Organisation for Animal Health
Thank you for your attention
World Organisation for Animal Health
12 rue de Prony
75017 Paris, France
Tel: 33 (0)
Fax: 33 (0)