Machine Translation – Whats the use? Tony Hartley University of Leeds, UK Centre for Translation Studies

Slides:



Advertisements
Similar presentations
Numbers Treasure Hunt Following each question, click on the answer. If correct, the next page will load with a graphic first – these can be used to check.
Advertisements

Jack Jedwab Association for Canadian Studies September 27 th, 2008 Canadian Post Olympic Survey.
Symantec 2010 Windows 7 Migration EMEA Results. Methodology Applied Research performed survey 1,360 enterprises worldwide SMBs and enterprises Cross-industry.
Repaso: Unidad 1 Lección 2
Repaso: Unidad 2 Lección 2
Symantec 2010 Windows 7 Migration Global Results.
1 A B C
Simplifications of Context-Free Grammars
Variations of the Turing Machine
3rd Annual Plex/2E Worldwide Users Conference 13A Batch Processing in 2E Jeffrey A. Welsh, STAR BASE Consulting, Inc. September 20, 2007.
AP STUDY SESSION 2.
1
Flexible Budgets, Variances, and Management Control: II
Copyright © 2003 Pearson Education, Inc. Slide 1 Computer Systems Organization & Architecture Chapters 8-12 John D. Carpinelli.
1 Copyright © 2013 Elsevier Inc. All rights reserved. Chapter 4 Computing Platforms.
Slide 1 FastFacts Feature Presentation October 16 th, 2008 We are using audio during this session, so please dial in to our conference line… Phone number:
ASTM Member Website Tools Jeff Adkins Diane Trinsey 1 September 2012 Officers Training Workshop.
September 2013 ASTM Officers Training Workshop September 2013 ASTM Officers Training Workshop ASTM Member Website Tools September 2013 ASTM Officers Training.
David Burdett May 11, 2004 Package Binding for WS CDL.
Local Customization Chapter 2. Local Customization 2-2 Objectives Customization Considerations Types of Data Elements Location for Locally Defined Data.
Process a Customer Chapter 2. Process a Customer 2-2 Objectives Understand what defines a Customer Learn how to check for an existing Customer Learn how.
CALENDAR.
1 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt BlendsDigraphsShort.
Unité 1 Leçon 2 Vocabulaire.
1 Advanced Tools for Account Searches and Portfolios Dawn Gamache Cindy Bylander.
1 Click here to End Presentation Software: Installation and Updates Internet Download CD release NACIS Updates.
Chapter 7: Steady-State Errors 1 ©2000, John Wiley & Sons, Inc. Nise/Control Systems Engineering, 3/e Chapter 7 Steady-State Errors.
60 Great Ways to Use MS Word in the Classroom Using MS Word in the classroom is a practice that should be social as well as technical The social organisation.
5-1 Chapter 5 Probability 1.
Break Time Remaining 10:00.
Shopping Day Free Powerpoint Templates.
Turing Machines.
Table 12.1: Cash Flows to a Cash and Carry Trading Strategy.
PP Test Review Sections 6-1 to 6-6
Maths Trail. How many hanging baskets are there in the garden? 1.
CS 6143 COMPUTER ARCHITECTURE II SPRING 2014 ACM Principles and Practice of Parallel Programming, PPoPP, 2006 Panel Presentations Parallel Processing is.
Operating Systems Operating Systems - Winter 2010 Chapter 3 – Input/Output Vrije Universiteit Amsterdam.
Exarte Bezoek aan de Mediacampus Bachelor in de grafische en digitale media April 2014.
Copyright © 2012, Elsevier Inc. All rights Reserved. 1 Chapter 7 Modeling Structure with Blocks.
1..
Example-based Machine Translation The other corpus-based approach to MT.
Adding Up In Chunks.
MaK_Full ahead loaded 1 Alarm Page Directory (F11)
12-1 Adjective clauses: introduction
Artificial Intelligence
By CA. Pankaj Deshpande B.Com, FCA, D.I.S.A. (ICA) 1.
Center on Knowledge Translation for Disability and Rehabilitation Research Information Retrieval for International Disability and Rehabilitation Research.
1 Lab 17-1 ONLINE LESSON. 2 If viewing this lesson in Powerpoint Use down or up arrows to navigate.
: 3 00.
5 minutes.
1 hi at no doifpi me be go we of at be do go hi if me no of pi we Inorder Traversal Inorder traversal. n Visit the left subtree. n Visit the node. n Visit.
1 Let’s Recapitulate. 2 Regular Languages DFAs NFAs Regular Expressions Regular Grammars.
Speak Up for Safety Dr. Susan Strauss Harassment & Bullying Consultant November 9, 2012.
1 Titre de la diapositive SDMO Industries – Training Département MICS KERYS 09- MICS KERYS – WEBSITE.
Essential Cell Biology
Tom Heath Knowledge Media Institute The Open University 30/05/2006 Supporting User Tasks Online through Social Networks.
Converting a Fraction to %
Clock will move after 1 minute
PSSA Preparation.
Chapter 13: Digital Control Systems 1 ©2000, John Wiley & Sons, Inc. Nise/Control Systems Engineering, 3/e Chapter 13 Digital Control Systems.
Physics for Scientists & Engineers, 3rd Edition
Select a time to count down from the clock above
Copyright Tim Morris/St Stephen's School
1.step PMIT start + initial project data input Concept Concept.
1 Decidability continued…. 2 Theorem: For a recursively enumerable language it is undecidable to determine whether is finite Proof: We will reduce the.
1 Non Deterministic Automata. 2 Alphabet = Nondeterministic Finite Accepter (NFA)
FIGURE 3-1 Basic parts of a computer. Dale R. Patrick Electricity and Electronics: A Survey, 5e Copyright ©2002 by Pearson Education, Inc. Upper Saddle.
CSA4050: Advanced Topics in NLP Example Based MT.
Presentation transcript:

Machine Translation – Whats the use? Tony Hartley University of Leeds, UK Centre for Translation Studies

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 1 What is Machine Translation? Machine Translation (MT) is the attempt to automate all, or part of the process of translating from one human language to another. La traduction automatique (MT) est la tentative d'automatiser tout, ou la partie du processus de traduction d'une langue humaine à un autre. [Promt – Reverso] La traduction automatique (la TA) est la tentative d'automatiser tous, ou une partie du processus de la traduction d'une langue humaine à l'autre. [Systran – Premium Pro]

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 2 What is Machine Translation? Machine Translation (MT) is the attempt to automate all, or part of the process of translating from one human language to another. La traduction automatique (MT) est la tentative d'automatiser tout, ou la partie du processus de traduction d'une langue humaine à un autre. [Promt – Reverso] La traduction automatique (la TA) est la tentative d'automatiser tous, ou une partie du processus de la traduction d'une langue humaine à l'autre. [Systran – Premium Pro]

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 3 How fast? If it takes a human translator 1 working day to translate 2,500 words, how long does it take an MT system to translate 500 words? A: 5 seconds

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 4 How fast? If it takes a human translator 1 working day to translate 2,500 words, how long does it take an MT system to translate 500 words? A: 5 secondsB: 50 seconds

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 5 How fast? If it takes a human translator 1 working day to translate 2,500 words, how long does it take an MT system to translate 500 words? A: 5 secondsB: 50 seconds C: 5 minutes

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 6 How fast? If it takes a human translator 1 working day to translate 2,500 words, how long does it take an MT system to translate 500 words? A: 5 secondsB: 50 seconds C: 5 minutesD: 50 minutes

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 7 How fast? If it takes a human translator 1 working day to translate 2,500 words, how long does it take an MT system to translate 500 words? A: 5 secondsB: 50 seconds C: 5 minutesD: 50 minutes

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 8 So prove it …

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 9 MT – a futile exercise? History provides no better example of the improper use of computers than machine translation. (Kay 1980 The proper place of men and machines in translation Xerox, Palo Alto) FAHQT […] is surely a worthy ideal and one which has attracted a regrettably small number of linguists and computer scientists. Even if it is never achieved, it provides an incomparable matrix in which to study the workings of human language. It is hoped that [the translators amenuensis] will be built with taste by people who understand languages and computers well enough to know how little it is they know.

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 10 Some other questions … Why is it hard? How does it work? What is it useful for? Can we improve it? How do you tell how good it is?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 11 Why is it hard? 1/2 Ambiguous words light: lumière, allumer, clair, léger … Resolution may need only a simple syntactic context I light the light light Jallume la lumière claire … or sophisticated world knowledge The troops fired at the women and they fell Les soldats ont tiré sur les femmes et ils/elles sont tombé(e)s

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 12 Why is it hard? 2/2 Ambiguous phrases Clever boys and girls go to school Resolution may need a wider context of general knowledge Les garçons habiles et les filles vont à lécole Les garçons et les filles habiles vont à lécole Pregnant women and children have priority Les femmes enceintes et les enfants sont prioritaires Les femmes et les enfants enceints sont prioritaires

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 13 MT – a major enterprise A Manhattan project could produce an atomic bomb, and the heroic efforts of the sixties could put a man on the moon, but even an all-out effort on the scale of these would probably not solve the translation problem. (Martin Kay, 1982)

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 14 Some other questions … Why is it hard? How does it work? What is it useful for? Can we improve it? How do you tell how good it is?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 15 How does it work? Empirical, corpus-based methods Statistical EBMT Rule-based methods Transfer Interlingua Hybrid methods

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 16 Empirical, corpus-based methods Require a corpus of previously translated texts Aligned in parallel, segment by segment Typical of the target text type and subject field For example, the Canadian Hansard – bilingual record of parliamentary debates

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 17 Statistical approaches 1/2 Translation Model Probability that a given SL word is translated by a given TL word (in the corpus) French: the > le / > la (Target-)Language Model Probabilities of sequences of TL words (in the corpus) Language Model orders the bag of words given by the Translation Model

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 18 Statistical approaches 2/2 Models are sensitive to the training corpus Canadian Hansard is widely used for English / French hear is translated as bravo with a probability of It is only translated about half the time …

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 19 EBMT The EB in EBMT stands for … A: European BankB: Entropy-Biased C: Example-BasedD: Extremely Basic

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 20 EBMT The EB in EBMT stands for … B: Entropy-Biased C: Example-Based

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 21 EBMT The EB in EBMT stands for … B: Entropy-Biased C: Example-Based

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 22 EBMT – the basic intuition Translation of new text is done by analogy with previous, similar translations Three stages Matching of ST candidate segments / sentences in database Alignment of the parts of the TT segment to use Recombination of the TT parts to form a whole target text

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 23 Matching – word-based Classical approach found in Nagao (1984): He eats potatoes. Input Matches A man eats vegetables. Hito wa yasai o taberu. Result Kare wa jagaimo o Acid eats metal. San wa kinzoku o okasu. Sulphuric acid eats iron. Ryūsan wa tetsu o taberu. okasu.

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 24 Matching – use of thesaurus Japanese A no B examples yōka no gogothe afternoon of the eighth kaigi no mokutekithe subject of the conference kaigi no sankaryō the application fee for the conference kyōto-de no kaigia conference in Kyoto isshukan no kyukaone weeks holiday mittsu no hoteruthree hotels kyōto-e no denshathe Kyoto train tōkyō-de no kenyukai kyōto-e no shinkansen a workshop in Tokyo the Kyoto bullet-train * *

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 25 Die Gefahrenstellen befinden sich in mit Triebschnee beladenen Rinnen und Mulden sowie hinter Geländekuppen aller Expositionen oberhalb von rund 2400 m. Les endroits dangereux se situent dans les creux et les couloirs chargés de neige soufflée ainsi que derrière les croupes du terrain quelle que soit l'orientation des pentes, au-dessus de 2400 m environ. In Graubünden befinden sich die Gefahrenstellen an Steilhängen aller Expositionen oberhalb von rund 2000 m. Dans les Grisons, les endroits dangereux se situent sur les pentes raides quelle que soit leur orientation, au-dessus de 2000 m environ. In den übrigen Gebieten liegen die Gefahrenstellen an Steilhängen der Expositionen West über Nord bis Südost oberhalb rund 2000 m, im südlichen Wallis oberhalb rund 2400 m. oberhalb rund 2400 m. Dans les autres régions, les zones dangereuses se situent sur les pentes raides exposées depuis l'ouest jusqu'au sud-est en passant par le nord, au-dessus de 2000 m environ et dans le sud du Valais au-dessus de 2400 m environ. au-dessus de 2000 m environ et dans le sud du Valais au-dessus de 2400 m environ. Die Gefahrenstellen befinden in den nördlichen Voralpen an Steilhängen in den übrigen Gebieten in mit Triebschnee beladenen Rinnen und Mulden aller Expositionen oberhalb von rund 2200 m. Dans le nord des Préalpes, les endroits dangereux se situent sur les pentes raides et dans les autres régions il y a lieu de se méfier des creux et des couloirs chargés de neige soufflée quelle que soit l'orientation des pentes, au-dessus de 2200 m environ. au-dessus de 2200 m environ. Alignment of common elements

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 26 Recombination – boundary friction 1/2 Input: The handsome boy entered the room Matches: The handsome boy ate his breakfast. I saw the handsome boy. Der schöne Junge aß sein Frühstück Ich sah den schönen Jungen.

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 27 Recombination – boundary friction 2/2 He buys a book on politics Matches He buys a notebook. Kare wa n ō to o kau. I read a book on politics. Watashi wa seiji nitsuite kakareta hon o yomu. He buys a pen. Kare wa pen o kau. She wrote a book on politics. Kanojo wa seiji nitsuite kakareta hon o kaita. Result Kare wa o kau. wa seiji nitsuite kakareta hon o

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 28 Rule-based methods – Transfer Analysis Generation TransferIntermedRep SL IntermedRep TL SL Monolingual TL Knowledge Bilingual Knowledge Output Sentences Input Sentences

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 29 Transfer representations

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 30 Transfer Modules

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 31 Transfer Modules (n * n-1) + n*2 analysis / synthesis

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 32 Rule-based methods – Interlingua Analysis Generation SL Monolingual TL Knowledge Output Sentences Input Sentences Neutral InterLing Rep

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 33 Interlingua n*2 modules

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 34 Some other questions … Why is it hard? How does it work? What is it useful for? Can we improve it? How do you tell how good it is?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 35 How widely is MT used? Free online MT Every day, portals like Altavista and Google process nearly ten million requests for automatic translation. (Van der Meer 2003 LISA Newsletter XII) Commercial MT SMART Communications Inc., NY: up to 1m pages per month European Commission: 739,000 pages in ,000 pages post-edited into polished translations SAP AG: 3-5m words per year in each of 6 language pairs, for internal use and external publication Microsoft Research: up to 1m words per month (Elliott 2003 Survey of MT users)

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 36 Texts translated by companies using MT user manuals technical docs web pages legal docs internal company docs business letters instruction booklets s medical docs calls for tender memos newspaper articles scientific docs software strings academic papers patents financial docs tourist/travel info Number of respondents

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? web pages academic papers newspaper articles technical docs s tourist/travel info scientific docs medical docs legal docs internal company docs business letters patents calls for tender user manuals software strings memos instruction booklets financial docs Number of respondents Texts translated by single users of MT (non-commercial use)

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 38 Language pairs translated by MT users Eng-Span Eng-Fr Eng-De Eng-Port Eng-Ital Eng-Jap Eng-Dan Eng-Dutch Eng-Grk Eng-Ch Eng-Fin Eng-Nor Eng-Rus Eng-Swed Eng-Viet De-Eng Fr-Eng Span-Eng Ital-Eng Jap-Eng Chin-Eng Port-Eng Fin-Eng Viet-Eng Number of respondents

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 39 Even crummy MT creates its own demand … FilteringDiscard / retain (relevant, not relevant, dont know) DetectionSort by topic of interest TriageSort within a topic by relevance ExtractionIdentify persons, locations, organisations, times, dates … GistingSummarise according to amount of information preserved

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 40 What is it useful for? A user " " pledges not to be contrary to the following condition on the occasion of the use of "the newspaper account data for Japanese- English" to the independent administrative institution Communications Research Laboratory.

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 41

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 42 Good for poetry? Beware the Jabberwock, my son! The jaws that bite, the claws that catch! Beware the Jubjub bird, and shun the frumious Bandersnatch! Prenez garde du Jabberwock, mon fils! Les mâchoires qui mordent, les griffes qui attrapent! Prenez garde de l'oiseau de Jubjub, et l' é vitez le Bandersnatch $$FRUMIOUS!

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 43 TechDoc – maybe …

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 44 Some other questions … Why is it hard? How does it work? What is it useful for? Can we improve it? How do you tell how good it is?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 45 Improving MT by first doing Named Entity (NE) recognition The problem illustrated ORI: The agreement was reached by a coalition of four of Pan Am's five unions. MT: L'accord a été conclu par une coalition de quatre de la casserole étais cinq syndicats. The solution ORI: TWA stock closed at $28 … MT: Fermé courant de TWA à $28 … MT+NE: Laction de TWA sest fermée à $28 …

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 46 Some other questions … Why is it hard? How does it work? What is it useful for? Can we improve it? How do you tell how good it is?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 47 Translation evaluation – why is it hard? Spell-cjhecking has a gold standard Grammar-checking do too But a gold standard in translation … ???

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 48 Whats the purpose? There are no absolute standards of translation quality but only more or less appropriate translations for the purpose for which they are intended. (Sager 1989: 91)

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 49 Who evaluate for? Stakeholders: investors, developers, vendors, managers, translators Feasibility Can it be done? Internal Do the parts work? Usability Can I actually use it? Operational Is it worth it? Comparison Is that system better than this? Declarative Does it translate well?

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 50 What data? Test suites Sets of sentences to systematically test cross- linguistic differences Small, simplified lexicon Artificially constructed Cf translation for language learning Corpora Sets of texts representing users interests Naturally occurring Cf translation as a communicative act

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 51 Which aspects? Emphasis on relationship ST– TT Fidelity Accuracy Cf equivalence-based theories of translation Emphasis on internal characteristics of TT Fluency Intelligibility Cf function-based theories of translation

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 52 What metrics? Rating usefulness by performance Assessing intelligibility by Cloze test Rating fluency on an n-point scale Rating adequacy an n-point scale Fluency and fidelity/adequacy are strongly correlated (e.g. Carroll 1966, Nagao 1985, DARPA 1994)

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 53 Example: Fluency evaluation (DARPA 1994) _______________________________________ It is a (the hitotoki) that probably holds out in the organ____ It takes a piano such as the year that the oldest daughter entered into an elementary school and I, and it caused to study the piano at 2 people with ones second daughter.____ It looks at does the exercise of the girl friend plural, and when I also probably plays the piano.together with this child quality is said, it decided.____ ____________________________________________________________________ 5 Excellent 4 Good 3 Fair 2 Poor 1 Very poor

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 54 Example: Adequacy evaluation (DARPA 1994) ______________________________________________________________________________ [Funeral Service for Michael Jordans Father]____Funeral service for the father of Michael Jordan [Family and close friends of American basketball____The family and the near the star of Star Michael Jordan gathered together on Sunday]the American basket-ball Michael Jordan develop are gathered Sunday [for a memorial service for Jordans father, James.]____for a funeral service to the memory of his/her/its father James. _____________________________________________________________________________________ 5All meaning expressed in the source fragment appears in the translation fragment 4Most of the source fragment meaning is expressed in the translation fragment 3Much of the source fragment meaning is expressed in the translation fragment 2Little of the source fragment meaning is expressed in the translation fragment 1None of the meaning expressed in the source fragment is expressed in the translation fragment

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 55 Any questions? …

Principles & Applications of MT CTS, U of Leeds Tony Hartley Machine Translation – Whats the use? 56