Presentation is loading. Please wait.

Presentation is loading. Please wait.

A Lightweight and High Performance Monolingual Word Aligner Xuchen Yao, Benjamin Van Durme, (Johns Hopkins) Chris Callison-Burch and Peter Clark (UPenn)

Published byHarvey Tucker Modified over 8 years ago

Similar presentations

Presentation on theme: "A Lightweight and High Performance Monolingual Word Aligner Xuchen Yao, Benjamin Van Durme, (Johns Hopkins) Chris Callison-Burch and Peter Clark (UPenn)"— Presentation transcript:

1 A Lightweight and High Performance Monolingual Word Aligner Xuchen Yao, Benjamin Van Durme, (Johns Hopkins) Chris Callison-Burch and Peter Clark (UPenn) (Vulcan)

2 2013-8-6ACL 2013, Sofia2 monolingual word alignment Aligning one sentence pair from RTE2 Premise: Linda Johnson, who lives with her husband, Charles, and two cats in..., said Katrina has... Hypothesis: Linda Johnson is married to Charles alignment contributed by Brockett (2007)

3 2013-8-6ACL 2013, Sofia3 monolingual vs. bilingual aligment less training data (labeled or unlabeled), but more lexical resources semantic relatedness: cued by distributional word similaries the same grammar shared by source/target sentences

4 2013-8-6ACL 2013, Sofia4 monolingual vs. bilingual aligment less training data (labeled or unlabeled), but more lexical resources semantic relatedness: cued by distributional word similaries the same grammar shared by source/target sentences

5 2013-8-6ACL 2013, Sofia5 monolingual vs. bilingual aligment less training data (labeled or unlabeled), but more lexical resources semantic relatedness: cued by distributional word similaries the same grammar shared by source/target sentences

6 2013-8-6ACL 2013, Sofia6 a discriminative model first proposed by Blunsom and Cohn (2006): s, t: source (observation), target sentence a: target word indices (0 to target length), state 0 is NULL state for deletion. f(): feature functions

7 2013-8-6ACL 2013, Sofia7 a discriminative model first proposed by Blunsom and Cohn (2006): s, t: source (observation), target sentence a: target word indices (0 to target length), state 0 is NULL state for deletion. f(): feature functions

8 2013-8-6ACL 2013, Sofia8 a discriminative model first proposed by Blunsom and Cohn (2006): s, t: source (observation), target sentence a: target word indices (0 to target length), state 0 is NULL state for deletion. f(): feature functions

9 2013-8-6ACL 2013, Sofia9

10 2013-8-6ACL 2013, Sofia10 desired Viterbi decoding path

11 2013-8-6ACL 2013, Sofia11 a discriminative model first proposed by Blunsom and Cohn (2006): s, t: source (observation), target sentence a: target word indices (0 to target length), state 0 is NULL state for deletion. f(): feature functions

12 2013-8-6ACL 2013, Sofia12 features string similarity –Jaro Winkler, Dice Sorensen, Hamming, Jaccard, Levenshtein, NGram overlapping and common prefix matching POS tags matching WordNet –hypernym, hyponym, synonym, derived form, entailing, causing, members of, have member, substances of, have substances, parts of, have part

13 2013-8-6ACL 2013, Sofia13 features string similarity –Jaro Winkler, Dice Sorensen, Hamming, Jaccard, Levenshtein, NGram overlapping and common prefix matching POS tags matching WordNet –hypernym, hyponym, synonym, derived form, entailing, causing, members of, have member, substances of, have substances, parts of, have part

14 2013-8-6ACL 2013, Sofia14 features string similarity –Jaro Winkler, Dice Sorensen, Hamming, Jaccard, Levenshtein, NGram overlapping and common prefix matching POS tags matching WordNet –hypernym, hyponym, synonym, derived form, entailing, causing, members of, have member, substances of, have substances, parts of, have part

15 2013-8-6ACL 2013, Sofia15 features positional –offset difference between src/tgt word context –whether neighboring words are similar –helps to align functional words distortion (Markov feature) –how far apart are two aligned target words

16 2013-8-6ACL 2013, Sofia16 features positional –offset difference between src/tgt word context –whether neighboring words are similar –helps to align functional words distortion (Markov feature) –how far apart are two aligned target words

17 2013-8-6ACL 2013, Sofia17 features positional –offset difference between src/tgt word context –whether neighboring words are similar –helps to align functional words distortion (Markov feature) –how far apart are two aligned target words

18 2013-8-6ACL 2013, Sofia18 Implementation: jacana-align source code at http://code.google.com/p/jacana lightweight: only used a POS tagger and WordNet written in Scala, optimize with LBFGS platform independent, compiles to a.jar file, fully interoperable with Java high performance? -> evaluation

19 2013-8-6ACL 2013, Sofia19 Baselines GIZA++ Tree Edit Distance (with stem/wordnet matching) MANLI –MacCartney, B.; Galley, M. & Manning, C. D., A Phrase-Based Alignment Model for Natural Language Inference, EMNLP 2008 MANLI-constraint (decoding with ILP) –Thadani, K. & McKeown, K. Optimal and syntactically-informed decoding for monolingual phrase-based alignment. ACL 2011

20 2013-8-6ACL 2013, Sofia20 Baselines GIZA++ Tree Edit Distance (with stem/wordnet matching) MANLI –MacCartney, B.; Galley, M. & Manning, C. D., A Phrase-Based Alignment Model for Natural Language Inference, EMNLP 2008 MANLI-constraint (decoding with ILP) –Thadani, K. & McKeown, K. Optimal and syntactically-informed decoding for monolingual phrase-based alignment. ACL 2011

21 2013-8-6ACL 2013, Sofia21 Baselines GIZA++ Tree Edit Distance (with stem/wordnet matching) MANLI –MacCartney, B.; Galley, M. & Manning, C. D., A Phrase-Based Alignment Model for Natural Language Inference, EMNLP 2008 MANLI-constraint (decoding with ILP) –Thadani, K. & McKeown, K. Optimal and syntactically-informed decoding for monolingual phrase-based alignment. ACL 2011

22 2013-8-6ACL 2013, Sofia22 Baselines GIZA++ Tree Edit Distance (with stem/wordnet matching) MANLI –MacCartney, B.; Galley, M. & Manning, C. D., A Phrase-Based Alignment Model for Natural Language Inference, EMNLP 2008 MANLI-constraint (decoding with ILP) –Thadani, K. & McKeown, K. Optimal and syntactically-informed decoding for monolingual phrase-based alignment. ACL 2011

23 2013-8-6ACL 2013, Sofia23 performance in F1 10.3%

24 2013-8-6ACL 2013, Sofia24 performance in F1 0.8% 3.3%

25 2013-8-6ACL 2013, Sofia25 performance in speed (seconds per sentecne) when sentences are more balanced, jacana- align is about 20x faster corpussentence pair length MANLI-approx.MANLI-exactjacana-align RTE229/111.67s0.08s0.025s FUSION27/2761.96s2.45s0.096s 20x

26 2013-8-6ACL 2013, Sofia26 performance in speed (seconds per sentecne) the speed of jacana-align is not as sensitive to sentence length increase corpussentence pair length MANLI-approx.MANLI-exactjacana-align RTE229/111.67s0.08s0.025s FUSION27/2761.96s2.45s0.096s 30x 4x

27 2013-8-6ACL 2013, Sofia27 Conclusion state-of-the-art monolingual word aligner –in accuracy –in speed open source, use it and hack it!

28 thank you with a demo

Download ppt "A Lightweight and High Performance Monolingual Word Aligner Xuchen Yao, Benjamin Van Durme, (Johns Hopkins) Chris Callison-Burch and Peter Clark (UPenn)"

Similar presentations

Joint Parsing and Alignment with Weakly Synchronized Grammars David Burkett, John Blitzer, & Dan Klein TexPoint fonts used in EMF. Read the TexPoint manual.

Joint Parsing and Alignment with Weakly Synchronized Grammars David Burkett, John Blitzer, & Dan Klein TexPoint fonts used in EMF. Read the TexPoint manual.
COGEX at the Second RTE Marta Tatu, Brandon Iles, John Slavick, Adrian Novischi, Dan Moldovan Language Computer Corporation April 10 th, 2006.

COGEX at the Second RTE Marta Tatu, Brandon Iles, John Slavick, Adrian Novischi, Dan Moldovan Language Computer Corporation April 10 th, 2006.
Specialized models and ranking for coreference resolution Pascal Denis ALPAGE Project Team INRIA Rocquencourt F-78153 Le Chesnay, France Jason Baldridge.

Specialized models and ranking for coreference resolution Pascal Denis ALPAGE Project Team INRIA Rocquencourt F Le Chesnay, France Jason Baldridge.
COGEX at the Second RTE Marta Tatu, Brandon Iles, John Slavick, Adrian Novischi, Dan Moldovan Language Computer Corporation April 10 th, 2006.

COGEX at the Second RTE Marta Tatu, Brandon Iles, John Slavick, Adrian Novischi, Dan Moldovan Language Computer Corporation April 10 th, 2006.
Large-Scale Entity-Based Online Social Network Profile Linkage.

Large-Scale Entity-Based Online Social Network Profile Linkage.
1 Extended Gloss Overlaps as a Measure of Semantic Relatedness Satanjeev Banerjee Ted Pedersen Carnegie Mellon University University of Minnesota Duluth.

1 Extended Gloss Overlaps as a Measure of Semantic Relatedness Satanjeev Banerjee Ted Pedersen Carnegie Mellon University University of Minnesota Duluth.
Baselines for Recognizing Textual Entailment Ling 541 Final Project Terrence Szymanski.

Baselines for Recognizing Textual Entailment Ling 541 Final Project Terrence Szymanski.
Deciding entailment and contradiction with stochastic and edit distance-based alignment Marie-Catherine de Marneffe, Sebastian Pado, Bill MacCartney, Anna.

Deciding entailment and contradiction with stochastic and edit distance-based alignment Marie-Catherine de Marneffe, Sebastian Pado, Bill MacCartney, Anna.
Automatic Identification of Cognates, False Friends, and Partial Cognates University of Ottawa, Canada University of Ottawa, Canada.

Automatic Identification of Cognates, False Friends, and Partial Cognates University of Ottawa, Canada University of Ottawa, Canada.
Maurice Hermans.  Ontologies  Ontology Mapping  Research Question  String Similarities  Winkler Extension  Proposed Extension  Evaluation  Results.

Maurice Hermans.  Ontologies  Ontology Mapping  Research Question  String Similarities  Winkler Extension  Proposed Extension  Evaluation  Results.
Measures of Text Similarity

Measures of Text Similarity
LEDIR : An Unsupervised Algorithm for Learning Directionality of Inference Rules Advisor: Hsin-His Chen Reporter: Chi-Hsin Yu Date: 2007.12.11 From EMNLP.

LEDIR : An Unsupervised Algorithm for Learning Directionality of Inference Rules Advisor: Hsin-His Chen Reporter: Chi-Hsin Yu Date: From EMNLP.
Robust Textual Inference via Graph Matching Aria Haghighi Andrew Ng Christopher Manning.

Robust Textual Inference via Graph Matching Aria Haghighi Andrew Ng Christopher Manning.
CS4705 Natural Language Processing.  Regular Expressions  Finite State Automata ◦ Determinism v. non-determinism ◦ (Weighted) Finite State Transducers.

CS4705 Natural Language Processing.  Regular Expressions  Finite State Automata ◦ Determinism v. non-determinism ◦ (Weighted) Finite State Transducers.
Confidence Estimation for Machine Translation J. Blatz et.al, Coling 04 SSLI MTRG 11/17/2004 Takahiro Shinozaki.

Confidence Estimation for Machine Translation J. Blatz et.al, Coling 04 SSLI MTRG 11/17/2004 Takahiro Shinozaki.
1 Quasi-Synchronous Grammars  Based on key observations in MT: translated sentences often have some isomorphic syntactic structure, but not usually in.

1 Quasi-Synchronous Grammars  Based on key observations in MT: translated sentences often have some isomorphic syntactic structure, but not usually in.
Midterm Review CS4705 Natural Language Processing.

Midterm Review CS4705 Natural Language Processing.
A Phrase-Based Model of Alignment for Natural Language Inference Bill MacCartney, Michel Galley, and Christopher D. Manning Stanford University 26 October.

A Phrase-Based Model of Alignment for Natural Language Inference Bill MacCartney, Michel Galley, and Christopher D. Manning Stanford University 26 October.
PZ02A - Language translation

PZ02A - Language translation
Inducing Information Extraction Systems for New Languages via Cross-Language Projection Ellen Riloff University of Utah Charles Schafer, David Yarowksy.

Inducing Information Extraction Systems for New Languages via Cross-Language Projection Ellen Riloff University of Utah Charles Schafer, David Yarowksy.

Similar presentations

Ads by Google