Speech Recognition and Machine Translation Stephan Kanthak AIXPLAIN AG, Aachen, Germany.

Slides:



Advertisements
Similar presentations
The Application of Machine Translation in CADAL Huang Chen, Chen Haiying Zhejiang University Libraries, Hangzhou, China
Advertisements

Non-Native Users in the Let s Go!! Spoken Dialogue System: Dealing with Linguistic Mismatch Antoine Raux & Maxine Eskenazi Language Technologies Institute.
INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING NLP-AI IIIT-Hyderabad CIIL, Mysore ICON DECEMBER, 2003.
ACCESSIBLE TECHNOLOGIES FOR SPEECH MANAGEMENT “Making media accessible to all” ITU workshop – Geneva October 2013.
Centro per la Ricerca Scientifica e Tecnologica Spoken language technologies: recent advances and future challenges Gianni Lazzari VIENNA July 26.
Natural Language and Speech Processing Creation of computational models of the understanding and the generation of natural language. Different fields coming.
Speech Translation on a PDA By: Santan Challa Instructor Dr. Christel Kemke.
Spoken Language Technologies: A review of application areas and research issues Analysis and synthesis of F0 contours Agnieszka Wagner Department of Phonetics,
Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.
J. Turmo, 2006 Adaptive Information Extraction Summary Information Extraction Systems Multilinguality Introduction Language guessers Machine Translators.
Machine Translation via Dependency Transfer Philip Resnik University of Maryland DoD MURI award in collaboration with JHU: Bootstrapping Out of the Multilingual.
Tanja Schultz, Alan Black, Bob Frederking Carnegie Mellon University West Palm Beach, March 28, 2003 Towards Dolphin Recognition.
Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.
Jumping Off Points Ideas of possible tasks Examples of possible tasks Categories of possible tasks.
The Use of Speech in Speech-to-Speech Translation Andrew Rosenberg 8/31/06 Weekly Speech Lab Talk.
تمرين شماره 1 درس NLP سيلابس درس NLP در دانشگاه هاي ديگر ___________________________ راحله مکي استاد درس: دکتر عبدالله زاده پاييز 85.
Why is ASR Hard? Natural speech is continuous
1 The Web as a Parallel Corpus  Parallel corpora are useful  Training data for statistical MT  Lexical correspondences for cross-lingual IR  Early.
The LC-STAR project (IST ) Objectives: Track I (duration 2 years) Specification and creation of large word lists and lexica suited for flexible.
AQUAINT Kickoff Meeting – December 2001 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.
Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.
DFKI GmbH, , R. Karger Indo-German Workshop on Language Technologies Reinhard Karger, M.A. Deutsches Forschungszentrum für Künstliche Intelligenz.
Direct Translation Approaches: Statistical Machine Translation
Exploiting Ontologies for Automatic Image Annotation M. Srikanth, J. Varner, M. Bowden, D. Moldovan Language Computer Corporation
Experiments on Building Language Resources for Multi-Modal Dialogue Systems Goals identification of a methodology for adapting linguistic resources for.
Overview of technologies for translators and language service providers Belinda Maia University of Porto.
Advanced Signal Processing 05/06 Reinisch Bernhard Statistical Machine Translation Phrase Based Model.
May 2006CLINT-CS Verbmobil1 CLINT-CS Dialogue II Verbmobil.
Natural Language Processing Guangyan Song. What is NLP  Natural Language processing (NLP) is a field of computer science and linguistics concerned with.
Suléne Pilon & Danie Prinsloo Overview: Teaching and Training in South Africa 25 November 2008;
17.0 Distributed Speech Recognition and Wireless Environment References: 1. “Quantization of Cepstral Parameters for Speech Recognition over the World.
Chapter 10 Language and Computer English Linguistics: An Introduction.
1 A Finite-State Approach to Machine Translation Srinivas Bangalore Giuseppe Riccardi AT&T Labs-Research NAACL 2001, Pittsburgh,
Machine Translation  Machine translation is of one of the earliest uses of AI  Two approaches:  Traditional approach using grammars, rewrite rules,
Edinburg March 2001CROSSMARC Kick-off meetingICDC ICDC background and know-how and expectations from CROSSMARC CROSSMARC Project IST Kick-off.
The ICT Statistical Machine Translation Systems for IWSLT 2007 Zhongjun He, Haitao Mi, Yang Liu, Devi Xiong, Weihua Luo, Yun Huang, Zhixiang Ren, Yajuan.
Coşkun Mermer, Hamza Kaya, Mehmet Uğur Doğan National Research Institute of Electronics and Cryptology (UEKAE) The Scientific and Technological Research.
NUDT Machine Translation System for IWSLT2007 Presenter: Boxing Chen Authors: Wen-Han Chao & Zhou-Jun Li National University of Defense Technology, China.
Advanced MT Seminar Spring 2008 Instructors: Alon Lavie and Stephan Vogel.
LML Speech Recognition Speech Recognition Introduction I E.M. Bakker.
Approaches to Machine Translation CSC 5930 Machine Translation Fall 2012 Dr. Tom Way.
1 CSI 5180: Topics in AI: Natural Language Processing, A Statistical Approach Instructor: Nathalie Japkowicz Objectives of.
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
What you have learned and how you can use it : Grammars and Lexicons Parts I-III.
Dirk Van CompernolleAtranos Workshop, Leuven 12 April 2002 Automatic Transcription of Natural Speech - A Broader Perspective – Dirk Van Compernolle ESAT.
ICS 482: Natural language Processing Pre-introduction
30 March – 8 April 2005 Dipartimento di Informatica, Universita di Pisa ML for NLP With Special Focus on Tagging and Parsing Kiril Ribarov.
Subproject II: Robustness in Speech Recognition. Members (1/2) Hsiao-Chuan Wang (PI) National Tsing Hua University Jeih-Weih Hung (Co-PI) National Chi.
Translingual Information Management Stephan Busemann Language Technology Lab German Research Center for Artificial Intelligence.
DFKI GmbH, , R. Karger Perspectives for the Indo German Scientific and Technological Cooperation in the Field of Language Technology Reinhard.
金聲玉振 Taiwan Univ. & Academia Sinica 1 Spoken Dialogue in Information Retrieval Jia-lin Shen Oct. 22, 1998.
Introduction A field survey of Dutch language resources has been carried out within the framework of a project launched by the Dutch Language Union (Nederlandse.
Statistical Machine Translation Part II: Word Alignments and EM Alex Fraser Institute for Natural Language Processing University of Stuttgart
Behrooz ChitsazLorrie Apple Johnson Microsoft ResearchU.S. Department of Energy.
Chapter 7 Speech Recognition Framework  7.1 The main form and application of speech recognition  7.2 The main factors of speech recognition  7.3 The.
Natural Language Processing Group Computer Sc. & Engg. Department JADAVPUR UNIVERSITY KOLKATA – , INDIA. Professor Sivaji Bandyopadhyay
 digital methodologies for global media research Randy Kluver Dept of Communication Texas A&M University.
1 ICASSP Paper Survey Presenter: Chen Yi-Ting. 2 Improved Spoken Document Retrieval With Dynamic Key Term Lexicon and Probabilistic Latent Semantic Analysis.
A Syntax-Driven Bracketing Model for Phrase-Based Translation Deyi Xiong, et al. ACL 2009.
Message Source Linguistic Channel Articulatory Channel Acoustic Channel Observable: MessageWordsSounds Features Bayesian formulation for speech recognition:
N-best list reranking using higher level phonetic, lexical, syntactic and semantic knowledge sources Mithun Balakrishna, Dan Moldovan and Ellis K. Cave.
Tools for Natural Language Processing Applications
Speech recognition in mobile environment Robust ASR with dual Mic
Juicer: A weighted finite-state transducer speech decoder
Course Projects Speech Recognition Spring 1386
3.0 Map of Subject Areas.
Computer, Communication and Information Sciences
Translingual Knowledge Projection and Statistical Machine Translation
Idiap Research Institute University of Edinburgh
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Speech Recognition and Machine Translation Stephan Kanthak AIXPLAIN AG, Aachen, Germany

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Technology Knowledge Management Machine Translation Speech Recognition Focus on Statistical Methods Focus on Statistical Methods Modular Software Architecture: Modular Software Architecture: Speech Recognition Speech Recognition Machine Translation Machine Translation Retrieval Retrieval Combined Applications: Combined Applications: Multilingual Retrieval Multilingual Retrieval Retrieval of Multimedia Data Retrieval of Multimedia Data Speech-To-Speech Translation Speech-To-Speech Translation Original Mission: Original Mission: Speech-To-Speech Translation (for Mobile Devices) Speech-To-Speech Translation (for Mobile Devices)

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Speech Recognition Search Acoustic Models Result Language Model Pronunciation Lexicon Preprocessing

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Speech Recognition: Current Research Feature Extraction Feature Extraction Phase Information Phase Information Noise Robustness Noise Robustness Acoustic Models Acoustic Models Adaptation Adaptation Maximum Entropy Models Maximum Entropy Models Discriminative Training Discriminative Training Multilingual Acoustic Models Multilingual Acoustic Models Language Models Language Models Class-Based Backing-Off Models Class-Based Backing-Off Models Open Vocabulary Open Vocabulary Search Search Weighted Finite-State Transducer Weighted Finite-State Transducer Dialogue Management Dialogue Management Reinforcement Learning Reinforcement Learning

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation MT: Alignment Templates Search Lexical Models Postprocessing Language Model Alignment Templates Preprocessing

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Machine Translation: Current Research General General Incorporate Syntactic Knowledge Incorporate Syntactic Knowledge Improved Alignment Models Improved Alignment Models Context-Free Grammars Context-Free Grammars Phrase-Based Models Phrase-Based Models Language Models Language Models Class-Based Backing-Off Models Class-Based Backing-Off Models Maximum Entropy Models Maximum Entropy Models Search Search Stochastic Parser Stochastic Parser Weighted Finite-State Transducer Weighted Finite-State Transducer

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Research Projects At Lehrstuhl für Informatik VI At Lehrstuhl für Informatik VI Current Projects: Current Projects: PF-Star: Speech Translation PF-Star: Speech Translation TransType2: Computer Assisted Translation TransType2: Computer Assisted Translation LC-Star: Lexica and Speech Corpora for Speech-To-Speech Translation LC-Star: Lexica and Speech Corpora for Speech-To-Speech Translation Completed Projects: Completed Projects: TC-Star_P: Preparation of TC-Star TC-Star_P: Preparation of TC-Star CORETEX: Core Speech Recognition Technology CORETEX: Core Speech Recognition Technology VERBMOBIL II: Speech-To-Speech Translation VERBMOBIL II: Speech-To-Speech Translation Eutrans: Speech-To-Speech Translation Eutrans: Speech-To-Speech Translation ADVISOR: Transcription of German Broadcast News and Retrieval of Videoclips ADVISOR: Transcription of German Broadcast News and Retrieval of Videoclips GIZA++: Open-Source Statistical Machine Translation GIZA++: Open-Source Statistical Machine Translation

AIXPLAIN AGStephan Kanthak,Speech Recognition / Machine Translation Success Stories Research Systems: Research Systems: DARPA HUB4 Evaluation‘99: 4th best ASR system DARPA HUB4 Evaluation‘99: 4th best ASR system VERBMOBIL: fastest and 2nd best ASR system VERBMOBIL: fastest and 2nd best ASR system VERBMOBIL: best MT system VERBMOBIL: best MT system DARPA MT Evaluation‘02: best MT system DARPA MT Evaluation‘02: best MT system DARPA MT Evaluation‘03: 2nd best MT system DARPA MT Evaluation‘03: 2nd best MT system Production Systems: Production Systems: Almost 200 speech recognition licenses sold in 2003 Almost 200 speech recognition licenses sold in 2003 Largest installation of a pick-by-voice system in Europe in December 2003 Largest installation of a pick-by-voice system in Europe in December 2003