A Survey for Interspeech 2013

Xavier Anguera Information Retrieval-based Dynamic TimeWarping

The goal of Dynamic time warping system is to find matching subsequences in two time series Recent DTW approaches usually require prior knowledge of start/end time, and memory-hunger This paper propose a matching approach- IR-DTW by using a vector of counts, which is inspired by IR community Introduction

The IR-DRW algorithm Information Retrieval-based Dynamic TimeWarping

Linear/Diagonal Subsequence Matching Information Retrieval-based Dynamic TimeWarping

Non-linear subsequence matching algorithm Information Retrieval-based Dynamic TimeWarping

query ref m

Information Retrieval-based Dynamic TimeWarping

query ref m maxQDist

Time warping constraints Information Retrieval-based Dynamic TimeWarping

The time sequences are constructed by MFCC-39 vector Mediaeval 2012 SWS is used as corpus, which contains 7.5 hours of telephone record Minimum Term Weighted Value is used to measure the performance Experiment and Result

This paper presents the IR-DTW algorithm to find non-linearly matching sequences and reduce the memory use The future work includes using different parts of the algorithm to close the S-DTW Conclusion

Larry Heck, Dilek Hakkani-T¨ur, Gokhan Tur Leveraging Knowledge Graphs forWeb-Scale Unsupervised Semantic Parsing

Spoken language understanding systems aim to automatically identify the intent of the user as expressed in natural language, extract as sociated arguments or slots Most SLU systems are based on statistical methods, and these methods usually rely on supervised training instances This paper leverage web-scale semantic graphs to bootstrap a web-scale semantic parser with no requirement for semantic schema design, no data collection, and no manual annotations Introduction

We align the knowledge populated in the semantic graph with the related documents, and transfer entity annotations Then we use these to bootstrap models and further improve them by combining with gazetteers mined from the knowledge graphs and adapting them to the target domain with a MAP-style algorithm Introduction

Gazetteers is a important feature in SLU, can also seemed as entity lists But gazetteers usually contain ambiguous, confusable or incorrect phrases; to improve the precision, the method learns from user clicks uses the results to compare the importance of entities Refining Gazetteers with Web Search

The unsupervised graph crawling algorithm is summarized as a sequence of the following 6 steps 1.Initialize the crawl Select a entity as the “central pivot node” 2.Retrieve sources of NL surface forms Use the CPN to retrieve documents; the documents are used as resources of natural language surface forms 3.Annotate with first order Use this gazetteer to automatically annotate the sentences from the retrieved documents These annotations will be used as “truth” labels for subsequent (statistical) training passes Unsupervised Data Mining with Knowledge Graphs

4.Extract features with large-scale entity lists For the CPN and each of its K related properties, enumerate all possible entity instances and form large-scale gazetteers The web search refining method is used here to increase the precision 5.Annotate with high order relations Extending to higher order relations, and repeat step 3~4 Documents retrieved above again annotate by these relations 6.Crawl graph to select new CPN and repeat Unsupervised Data Mining with Knowledge Graphs

With high precision label of sentences, we can generate millions if auto annotate sentences for statistical semantic parsers we frame the entity extraction (slot filling) task as a sequence classification problem to obtain the most probable entity sequence; we use discriminative conditional random fields (CRFs) for modeling Modeling Entities for Semantic Parsing

After the transition and emission probabilities are optimized, the most probable state sequence, Y, can be determined using the well-known Viterbi algorithm Modeling Entities for Semantic Parsing

We leverage these patterns to induce semantic parsing grammars or templates, and then use the templates to spot entities –ent(movie name) -> rel(directed by) -> ent(director) we use the grammars of the entity-relationbased parser as a final pass after the entity extraction parsing Modeling Relations for Semantic Parsing

Experiments and Results

We develop a graph crawling algorithm for data mining, and two entity extraction approaches: CRF-based method and a relation model with induced entity extraction grammars We also investigate the impact of higher order knowledge graph relations on semantic parsing Conclusion