1. Institute for Information Problems of the Russian academy of Sciences and its linguistic research Olga Kozhunova CML-2008, Becici, 6-13 September

2. The Institute for Informatics Problems of the Russian Academy of Sciences (IPI RAN) was founded in 1983 with a goal of conducting fundamental and applied research in the area of hardware and software for mass application and in the area of relevant computer systems

3. The Institute is a member of the Department of Information technologies and Computing Systems of the Russian Academy of Sciences. IPI RAN has 22 departments and laboratories

4. Our Department of Information Technologies for Data Structuring and Retrieval supports several linguistic projects, namely: “Intertext: a multilingual knowledge base for machine translation” “Intertext: a multilingual knowledge base for machine translation” “Semantic dictionary for Monitoring system of the Russian Academy of Sciences: evaluating for institutional R&D activities” “Semantic dictionary for Monitoring system of the Russian Academy of Sciences: evaluating for institutional R&D activities”

5. In 2007 an experiment on assessment researchers’ performance in the Russian Academy of Sciences was carried out In order to fulfil the evaluation task of the experiment for my Institute a Monitoring system has been designed and implemented

6. One of the components of the Monitoring system is Semantic dictionary It’s necessity is motivated by problems arisen at the period of monitoring and evaluation of the researchers’ performance held

7. The problems dealt with absence of unambiguous terms’ definitions and of common understanding of their meanings by experts of the Monitoring system This strongly defined the structure of the dictionary: it contains links to normative, informative, algorithmic, and other components of the Monitoring system

8. Dictionary’s architecture is based on classification scheme, in which indicators of researcher’s performance been integrated

9. When designing Semantic dictionary, several aspects were taken into account: Normative documents rarely contain indicators’ definitions Normative documents rarely contain indicators’ definitions Sometimes indicators are differently understood by experts Sometimes indicators are differently understood by experts There are indicators depending on several parameters (for example, values of citation indexes depend on the set of scientific papers analyzed) There are indicators depending on several parameters (for example, values of citation indexes depend on the set of scientific papers analyzed)

10. Numeric values of indicators may depend on the amount of elements in normative files and their contents Numeric values of indicators may depend on the amount of elements in normative files and their contents For example, values of citation indexes depend on the list of journals used

11. Aspects mentioned were taken into account when elaborating the procedure of indicators’ meanings clarification Aspects mentioned were taken into account when elaborating the procedure of indicators’ meanings clarification The procedure was brought out in two stages: integration of an indicator into classification scheme and its definition and clarification The procedure was brought out in two stages: integration of an indicator into classification scheme and its definition and clarification

12. Examples of indicators: Invited reports on International conferences Invited reports on International conferences Patents Patents Russian citation index Russian citation index………………………….

13. Thank You for Your attention!