School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Google Research: Theorizing from Data COMP3310 AI32 Natural Language Processing Taught by: Eric Atwell, and guest lecturers …

Peter Norvig, Google Research Today we will watch a Youtube video: Peter Norvig, Director of Research, Google Google Developers Day talk: Theorizing from Data Covers some Google tools beyond keyword-search And statistical language models behind the tools Video is 37 minutes long, plus questions from the audience (skip these?)

Watch out for… The rise of probabilistic, statistical (Markov or N-gram) models More Data is better than Better Algorithms (Banko & Brill) Google N-gram Corpus: WWW freqs of words, word-pairs, … New Google tools: Google Sets, Google Trends, … Question-Answering: how to extract facts from WWW Statistical Machine Translation, learning from aligned texts How many bits are needed to store probabilities? (4!!) To save space, truncate words – to how many letters? (4!!) Google AI tools dont try to replace human intelligence – they AUGMENT intelligence

Theorizing from Data

Did you see? … The rise of probabilistic, statistical (Markov or N-gram) models More Data is better than Better Algorithms (Banko & Brill) Google N-gram Corpus: WWW freqs of words, word-pairs, … New Google tools: Google Sets, Google Trends, … Question-Answering: how to extract facts from WWW Statistical Machine Translation, learning from aligned texts How many bits are needed to store probabilities? (4!!) To save space, truncate words – to how many letters? (4!!) Google AI tools dont try to replace human intelligence – they AUGMENT intelligence