Presentation is loading. Please wait.

Presentation is loading. Please wait.

Www.my-xml.com MyCaTeX Presentation Copyright © my-xML, 2005.

Similar presentations


Presentation on theme: "Www.my-xml.com MyCaTeX Presentation Copyright © my-xML, 2005."— Presentation transcript:

1 MyCaTeX Presentation Copyright © my-xML, 2005

2 2 2 Who we are my-xML is a software editor specialized in multilingual systems using linguistic engineering technologies Based in Luxembourg & Brussels Active in the industry, media, national and European public organizations my-xML tools: MyTerm: linguistic API for “cross-language” search in pluri-lingual databases MyTerm-Glossy: CAT and proof-reading tool for Word and HTML texts MyCaTeX: language independent terms extractor

3 3 3 What is MyCaTeX? A language independant term extractor My:my-xML technology, based on J. Vergne’s algorithms Ca: Candidate T: Terms eX:eXtractor

4 4 4 *.txt *.html *.xml Extraction (optional) Stop words Invalid words Term Candidates Selection MARTIF Terms repository Terms description (Graph) MyCaTeX Architecture Indexed text

5 5 5 Extraction Follows Jacques Vergne’s algorithm (Univ. Caen) Supports txt, html and xml format Language independent 9 parameters 3 stop lists (optional) Can use a set of pre-defined words

6 6 6 Extraction Algorithm 3 stages: Document tagging, 3 sets of tags: "I" informative words "n" non informative words "-" punctuation marks and html/xml tags Pattern recognition: I+, I+n+I+ or I+n+I+n+I+ Score calculation: number of occurrences * length

7 7 7 Informative/non-informative word General language properties Zipf: "what is used frequently is short" Saussure: "in the language, there are only differences" Informative word: longer and less frequent than its neighbors "informativity" = length/occurrences Informativity variation word tagging

8

9 9 9 *.txt *.html *.xml Extraction (optional) Stop words Invalid words Term Candidates Selection MARTIF Terms repository Terms description (Graph) MyCaTeX Architecture Indexed text

10 Term selection/validation Navigating between the candidate terms and the source text Adding new entries Getting information about term frequency and position in the text

11

12 *.txt *.html *.xml Extraction (optional) Stop words Invalid words Term Candidates Selection MARTIF Terms repository Terms description (Graph) MyCaTeX Architecture Indexed text

13 Terms description Show/Define part of speech information Show/Define gender Edit synonym information Show/Define relations between terms

14

15 *.txt *.html *.xml Extraction (optional) Stop words Invalid words Term Candidates Selection MARTIF Terms repository Terms description (Graph) MyCaTeX Architecture Indexed text

16 Terms Repository Allows to save and re-use information about the terms MARTIF format (XML) Terms can be organized into domains Re-usability in my-xML software suite

17 Terms Repository main entry noun constitution T15:44: T15:36:29 domain1

18 Programming tools Programming language: Java XML handling: JDOM Graph generation: Prefuse

19 Current results Extraction quality depending on the clarity of the source text A clear source text is a text from which you can extract the main themes by quickly browsing it. Extraction quality lower for agglutinative languages (German, Finnish and Turkish) Extraction quality depending on the various parameter settings and text size (testing in progress)

20 Further developments Use of MyTerm as first term repository Further extraction engine test and calibration on multilingual aligned corpora Integration of Eurovoc Improvement of the technical performance of the extractor

21 Result example COUNCIL DECISION OF 2 APRIL 1963 LAYING DOWN GENERAL PRINCIPLES FOR IMPLEMENTING A COMMON VOCATIONAL TRAINING POLICY ( 63/266/EEC ) THE COUNCIL OF THE EUROPEAN ECONOMIC COMMUNITY, HAVING REGARD TO THE TREATY ESTABLISHING THE EUROPEAN ECONOMIC COMMUNITY, AND IN PARTICULAR ARTICLE 128 THEREOF ; HAVING REGARD TO THE PROPOSAL FROM THE COMMISSION ; HAVING REGARD TO THE OPINION OF THE ECONOMIC AND SOCIAL COMMITTEE ; HAVING REGARD TO THE OPINION OF THE EUROPEAN PARLIAMENT ( 1 ) ; WHEREAS, IN ORDER TO FULFIL THE OBLIGATION IMPOSED ON THEM BY THE TREATY, TO ENSURE THE MAINTENANCE OF A HIGH LEVEL OF EMPLOYMENT THROUGH THEIR ECONOMIC POLICIES, MEMBER STATES SHOULD TAKE APPROPRIATE ACTION TO ADAPT THE SKILLS OF THEIR LABOUR FORCES TO CHANGES IN THE GENERAL ECONOMIC SITUATION AND TO CHANGES IN PRODUCTION TECHNOLOGY ; WHEREAS AGAINST THE BACKGROUND OF THE RAPID IMPLEMENTATION OF THE COMMON MARKET AND IN CONJUNCTION WITH THE CO-ORDINATION OF REGIONAL POLICIES AND THE PROGRESSIVE ACHIEVEMENT OF A COMMON AGRICULTURAL POLICY, THE STRUCTURAL CHANGES WHICH ARE AT PRESENT TAKING PLACE IN CERTAIN ECONOMIC SECTORS RAISE URGENT PROBLEMS OF VOCATIONAL TRAINING AND RETRAINING ; ……………………

22 Result example English (268)French (276)German (201)Polish (391)Greek (236) common vocational training policy politique commune de formation professionnelle berufsausbildung zawodowegoκαταρτίσεως vocational training policy professionnellemitgliedstaaten ustanawiająca ogólne zasady realizowania wspólnej polityki εφαρμογή κοινής πολιτικής επαγγελματικής καταρτίσεως vocational commune de formation professionnelle gemeinsamen politik der berufsausbildung miejsca kształcenia i miejsca kształcenia i miejsca pracy πολιτικής επαγγελματικής καταρτίσεως member states oeuvre d' une politique commune de formation professionnelle durchführung einer gemeinsamen politik der berufsausbildung współpracy z państwami członkowskimi κοινής πολιτικής επαγγελματικής καταρτίσεως implementing a common vocational training policy politique commune grundsätze für die durchführung einer gemeinsamen politik realizowania wspólnej polityki kształcenia zawodowego κράτη μέλη principles for implementing a common vocational états membresgemeinsamen politik zatrudnieni na stanowiskach niższych niż kierownicze τομέα της επαγγελματικής καταρτίσεως common vocational formation professionnelle grundsätze für die durchführung einer gemeinsamen miejsca kształcenia i miejsca kształcenia i miejsca επαγγελματικής καταρτίσεως commission mise en oeuvre d' une politique commune politik der berufsausbildung polityki kształcenia zawodowego εφαρμογή κοινής πολιτικής principles for implementing a common formation allgemeinen grundsätze für die durchführung einer gemeinsamen politik życie wspólnej polityki kształcenia zawodowego 2ας απριλίου 1963 περί θεσπίσεως των γενικών αρχών implementing a common vocational principes généraux pour la mise en oeuvre ausbildungsstätte sowie des ausbildungs - und beschäftigungsorts polityki kształcenia zawodowego szczególną επαγγελματικής particular oeuvre d' une politique commune berufstätigkeit bis zu mittleren stellungen in betracht kommen państwa członkowskieκοινή πολιτική επαγγελματικής καταρτίσεως πρέπει community mise en oeuvre d' une politique allgemeinen grundsätze für die durchführung einer gemeinsamen ustanawiająca ogólne zasady realizowania δύνανται να ασκήσουν επαγγελματική δραστηριότητα principles for implementing communauté durchführung einer gemeinsamen szczególnościγενικών αρχών για την εφαρμογή κοινής πολιτικής states and the competent institutions of the community Politique mitgliedstaaten und den zuständigen organen der gemeinschaft nauczycieli i instruktorówγενικές αρχές για την εφαρμογή κοινής πολιτικής co-operation with the member states commissionbetracht kommen oder eine solche tätigkeit bereits ausüben stanowiskach niższych niż kierownicze απριλίου 1963 περί θεσπίσεως των γενικών αρχών

23 Q/A


Download ppt "Www.my-xml.com MyCaTeX Presentation Copyright © my-xML, 2005."

Similar presentations


Ads by Google