A.F.K. by SoTel. An Introduction to SoTel SoTel created A.F.K., an Android application used to auto generate text message responses to other users. A.F.K.

Slides:



Advertisements
Similar presentations
School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Chunking: Shallow Parsing Eric Atwell, Language Research Group.
Advertisements

CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 2 (06/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Part of Speech (PoS)
Natural Language Understanding Difficulties: Large amount of human knowledge assumed – Context is key. Language is pattern-based. Patterns can restrict.
QA-LaSIE Components The question document and each candidate answer document pass through all nine components of the QA-LaSIE system in the order shown.
For Monday Read Chapter 23, sections 3-4 Homework –Chapter 23, exercises 1, 6, 14, 19 –Do them in order. Do NOT read ahead.
1 Words and the Lexicon September 10th 2009 Lecture #3.
Natural Language and Speech Processing Creation of computational models of the understanding and the generation of natural language. Different fields coming.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
Introduction to Computational Linguistics Lecture 2.
Introduction to CL Session 1: 7/08/2011. What is computational linguistics? Processing natural language text by computers  for practical applications.
Part of speech (POS) tagging
تمرين شماره 1 درس NLP سيلابس درس NLP در دانشگاه هاي ديگر ___________________________ راحله مکي استاد درس: دکتر عبدالله زاده پاييز 85.
March 1, 2009 Dr. Muhammed Al-Mulhem 1 ICS 482 Natural Language Processing INTRODUCTION Muhammed Al-Mulhem March 1, 2009.
Natural Language Processing DR. SADAF RAUF. Topic Morphology: Indian Language and European Language Maryam Zahid.
Conceptual Architecture of PostgreSQL PopSQL Andrew Heard, Daniel Basilio, Eril Berkok, Julia Canella, Mark Fischer, Misiu Godfrey.
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)
Trouble History Database of HIMAC ~ Current Status and Future Plan ~ T.Kadowaki (Accelerator Engineering Corporation) 28.SEP.2007
9/8/20151 Natural Language Processing Lecture Notes 1.
CCSB354 ARTIFICIAL INTELLIGENCE (AI)
LING 388: Language and Computers Sandiway Fong Lecture 17.
BTANT 129 w5 Introduction to corpus linguistics. BTANT 129 w5 Corpus The old school concept – A collection of texts especially if complete and self-contained:
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Computational Linguistics Yoad Winter *General overview *Examples: Transducers; Stanford Parser; Google Translate; Word-Sense Disambiguation * Finite State.
Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
Chapter 10: Compilers and Language Translation Invitation to Computer Science, Java Version, Third Edition.
Learning to Transform Natural to Formal Language Presented by Ping Zhang Rohit J. Kate, Yuk Wah Wong, and Raymond J. Mooney.
Natural Language Processing Rogelio Dávila Pérez Profesor – Investigador
Methods for the Automatic Construction of Topic Maps Eric Freese, Senior Consultant ISOGEN International.
Chapter 15 Natural Language Processing (cont)
System Initialization 1)User starts application. 2)Client loads settings. 3)Client loads contact address book. 4)Client displays contact list. 5)Client.
Introduction to CL & NLP CMSC April 1, 2003.
Preventing Automated Use of STMP Reservation System Using CAPTCHA.
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
Linguistic Essentials
CSA2050 Introduction to Computational Linguistics Lecture 1 Overview.
CSA2050 Introduction to Computational Linguistics Lecture 1 What is Computational Linguistics?
CSE573 Autumn /20/98 Planning/Language Administrative –PS3 due 2/23 –Midterms back today –Next topic: Natural Language Processing reading Chapter.
Towards the Semantic Web 6 Generating Ontologies for the Semantic Web: OntoBuilder R.H.P. Engles and T.Ch.Lech 이 은 정
Artificial Intelligence: Natural Language
CSA2050 Introduction to Computational Linguistics Parsing I.
For Monday Read chapter 24, sections 1-3 Homework: –Chapter 23, exercise 8.
CSE573 Autumn /23/98 Natural Language Processing Administrative –PS3 due today –PS4 out Wednesday, due Friday 3/13 (last day of class) special.
Data Mining: Text Mining
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 1 (03/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Introduction to Natural.
For Friday Finish chapter 23 Homework –Chapter 23, exercise 15.
1 An Introduction to Computational Linguistics Mohammad Bahrani.
Natural Language Processing (NLP)
For Monday Read chapter 26 Homework: –Chapter 23, exercises 8 and 9.
NATURAL LANGUAGE PROCESSING
XML & JSON. Background XML and JSON are to standard, textual data formats for representing arbitrary data – XML stands for “eXtensible Markup Language”
Kenneth Baclawski et. al. PSB /11/7 Sa-Im Shin
Natural Language Processing (NLP)
CSCE 590 Web Scraping - NLTK
Natural Language - General
Conceptual Architecture of PostgreSQL
CS323 Android Topics Network Basics for an Android App
Conceptual Architecture of PostgreSQL
Natural Language Processing
Natural Language Processing
CS246: Information Retrieval
A User study on Conversational Software
Natural Language Processing (NLP)
CSCE 590 Web Scraping - NLTK
Artificial Intelligence 2004 Speech & Natural Language Processing
Information Retrieval
Natural Language Processing (NLP)
Presentation transcript:

A.F.K. by SoTel

An Introduction to SoTel SoTel created A.F.K., an Android application used to auto generate text message responses to other users. A.F.K. created to help automate responses to those annoying, needy text-ers.

How does it work?

High Level Diagram

NLP Phonology o Sounds of words, for spoken input Morphology o Meanings of the different parts of the word (suffix, prefix...) Lexical o Meaning of individual words Syntactic o Grammatical structure of the sentence Semantic o Overall meaning of a sentence Discourse o Meaning of all sentences together Pragmatic o Understanding intentions of speech

NLP The Basics: o Tagging o Parsing o Dependencies Example: The Stanford Parser 

Input sentence: The dog runs very quickly Penn-style Parse tree: (TOP (S (NP (DT The) (NN dog)) (VP (VBZ runs) (ADVP (RB very) (RB quickly))))) Flattened String: TOP S NP DT The NN dog VP VBZ runs ADVP RB very RB quickly Tokens: TOP, S, NP. DT, The, NN, dog, VP, VBZ, runs, ADVP, RB, very, RB, quickly Our NLP

The parse tree also contains information as to what kind of sentence it is, such as a question, or statement. By looking at our parse tree and the Penn Tree Bank POS tags we extract the main subject of the sentence to send to the NLG. Ex. I love cats. Main Subject: CATS If it is a question, it will even tell us if it is a who, what, or where question. If it is a question with no subject then we just pass it to our NLG, which may or may not have an answer.

Android SMS Background Android works in mysterious ways. Currently there is no standard long term database for text messages. Any text messaging client can have its own individual text message database. Although there's no documentation on how to do this, it is an unwritten rule to use the stock app's database This allows any text messages sent and received from on app to apply to the history of all apps.

Android App' 1.When the app is opened, your most recent text messages are logged. 2.A background thread is also started which diffs your most recent text message received against the previously logged messages at 1/30 Hz. (The rest of the program is executed in the background thread) 3.Once a diff is found, the thread requests for a response from the server. 4.Then creates a message deliver intent and a BroadcastReciever. 5.If the message is successfully sent, the message is added to the sent message database and then updates old text DB.

Server The server is comprised of three parts: aiServer: a Python-based web server NLPmes: Our NLP (mentioned earlier) AIML Database: Our database of response tokens. AIMLParse: AIML Database manipulator.

Server

Project Feedback and Evaluation Based on the Turing Test and Other Questions Is there an automated response to the text message? Does the response seem intelligent for a computer? Does the response seem at the intelligence level of a human? Is the response a reasonable reply for the text message? Is it plausible that without knowing the truth, a person would believe that there was another person sending the texts? (Turing test) User Feedback Impressions on Overall Project How were the auto-generated responses?