Presentation is loading. Please wait.

Presentation is loading. Please wait.

Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,

Published byCharleen McKinney Modified over 7 years ago

Similar presentations

Presentation on theme: "Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,"— Presentation transcript:

1 Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill, Kim Biointelligence Laboratory, Seoul National University http://bi.snu.ac.kr/ 2009.07.30

2 Contents 5.0 Language Acquisition vs. Language Change  Slightly imperfect individual learning  Language change in the population level  Learning vs. Evolutionary dynamics 5.1 An Acquisition-Based Model of Language Change  Qualitative explanation 5.2 A Preliminary Model  5.2.1 Learning by Individuals  5.2.2 Population Dynamics  5.2.3 Some Examples  Memoryless Learners  Batch Error-Based Learner  Cue-Based Learner 5.3 Implications and Further Directions 2(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

3 Language Acquisition vs. Language Change Language Acquisition  The mechanism by which language is transmitted from parrent to child Perfect acquisition = Perfect transmission  Perfectly same language = No change! However, a number of language-change cases are reported.  Imperfect learning! 3(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

4 Is it Possible Language Change by Slightly imperfect learning ? It is possible  Slightly imperfect individual learning  Language change in the population level  Lightfoot (1991)  Someone’s new parameter setting  New grammar  Different output  Linguistic environmental change  New parameter setting in younger people  New grammar …  Let’s show formally  Relations between Learning & Evolutionary dynamics  A model of language change emerges as a logical consequence of language acquisition 4(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

5 An Acquisition-Based Model of Language Change (1/3) We want …  Grammatical theory + Learning algorithm  Model of language change  Individual level problem  Population level problem Learning problem (Individual level)  PLD(Primary Linguistic Data)  “How children acquire the target language from their PLD?” Linguistic composition change problem (Population level)  Changeable Case 1: PLD for children is altered  By foreign speakers, disfluencies, …  Changeable Case 2: Finite sentences from grammar 5(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

6 An Acquisition-Based Model of Language Change (2/3) Finite sentences from the adults’ grammar  Slightly different grammar of children  Over successive generations, the linguistic composition evolves as a dynamical system Microscopic & macroscopic view Different learning models  Different evolutionary results 6(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

7 An Acquisition-Based Model of Language Change (3/3) Assumptions  Grammar hypothesis space  The space of possible grammars that humans might acquire  Usually simplified to particular parameters  Language acquisition device  The learning algorithm the child uses to develop grammatical hypotheses on the basis of data  Primary linguistic data (PLD)  The distribution of sentences that a child is exposed to and that affect its linguistic development 7(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

8 A Primary Model Σ: a finite alphabet Σ*: all possible series of character Language: L i ⊂ Σ* In general, L 1 ∩ L 2 ≠ g i means the grammar of the language L i 8(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

9 A Primary Model Consider ONLY TWO languages, L 1 & L 2 Monolingual case: just ONE language for ONE user Population: TWO generations State variable  α t : proportion of users of L 1 at the t th generation  1- α t : `` `` L 2 `` Sentence : s ∈ Σ* P 1 : Probability distribution of sentences of L 1  P 1 (s) : Probability to produce a sentence s by a user of L 1 9(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

10 Learning by Individuals : learning algorithm 10(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

11 Population Dynamics Finite sentences for learning  “Mature” after K examples Begin  All uses L 1  All example are s ~ P 1 11(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

12 Summary Phase Space  Linear Stability Analysis  Nullclines  Poincare-Bendixson Theorem  Hopf Bifurcation Population Dynamics in the Wilson-Cowan Model 12(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/http://bi.snu.ac.kr/

Download ppt "Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,"

Similar presentations

WHY LANGUAGES DIFFER IN THE WAY THEY DO ? Traditional thinking HISTORICAL DRIFT. History separates languages in space and time. Lupyan and Dale research.

WHY LANGUAGES DIFFER IN THE WAY THEY DO ? Traditional thinking HISTORICAL DRIFT. History separates languages in space and time. Lupyan and Dale research.
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.

Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
I NNATIST HYPOTHESIS, (UG) Second language acquisition.

I NNATIST HYPOTHESIS, (UG) Second language acquisition.
Main points of Interlanguage, Krashen, and Universal Grammar

Main points of Interlanguage, Krashen, and Universal Grammar
Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, 2006. Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.

Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
Second Language Acquisition (SLA)

Second Language Acquisition (SLA)
The dynamics of iterated learning Tom Griffiths UC Berkeley with Mike Kalish, Steve Lewandowsky, Simon Kirby, and Mike Dowman.

The dynamics of iterated learning Tom Griffiths UC Berkeley with Mike Kalish, Steve Lewandowsky, Simon Kirby, and Mike Dowman.
Ch 13. Sequential Data (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, 2006. Summarized by Kim Jin-young Biointelligence Laboratory, Seoul.

Ch 13. Sequential Data (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Kim Jin-young Biointelligence Laboratory, Seoul.
A Bayesian view of language evolution by iterated learning Tom Griffiths Brown University Mike Kalish University of Louisiana.

A Bayesian view of language evolution by iterated learning Tom Griffiths Brown University Mike Kalish University of Louisiana.
1 Introduction to Computational Natural Language Learning Linguistics 79400 (Under: Topics in Natural Language Processing ) Computer Science 83000 (Under:

1 Introduction to Computational Natural Language Learning Linguistics (Under: Topics in Natural Language Processing ) Computer Science (Under:
Topic: Theoretical Bases for Cognitive Method Objectives Trainees will be able to give reasons for the design and procedures of the Cognitive Method.

Topic: Theoretical Bases for Cognitive Method Objectives Trainees will be able to give reasons for the design and procedures of the Cognitive Method.
Biological Evolution of the Saussurean Sign as a Component of the Language Acquisition Device James R. Hurford University of Edinburgh, Scotland Presented.

Biological Evolution of the Saussurean Sign as a Component of the Language Acquisition Device James R. Hurford University of Edinburgh, Scotland Presented.
Analyzing iterated learning Tom Griffiths Brown University Mike Kalish University of Louisiana.

Analyzing iterated learning Tom Griffiths Brown University Mike Kalish University of Louisiana.
Second language acquisition

Second language acquisition
What counts as evidence in linguistics?. WHAT IS UNIVERSAL GRAMMAR? A system of grammatical rules and constraints believed to underlie all natural languages.

What counts as evidence in linguistics?. WHAT IS UNIVERSAL GRAMMAR? A system of grammatical rules and constraints believed to underlie all natural languages.
Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger 11.02.2010.

Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger
Modelling Language Evolution Lecture 5: Iterated Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.

Modelling Language Evolution Lecture 5: Iterated Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
Liza Funke EDU 528 INTRODUCTION Our students are technology-oriented Second language acquisition is social in nature MOOs are technological, social language.

Liza Funke EDU 528 INTRODUCTION Our students are technology-oriented Second language acquisition is social in nature MOOs are technological, social language.
Bi-Weekly BTP Meeting Bhargava Reddy 110050078.

Bi-Weekly BTP Meeting Bhargava Reddy
Stephen Krashen D. Fleming University of Ottawa. Stephen Krashen is one of the best known applied linguists today has been severely (and often justifiably)

Stephen Krashen D. Fleming University of Ottawa. Stephen Krashen is one of the best known applied linguists today has been severely (and often justifiably)

Similar presentations

Ads by Google