Usage vs Acquisition in Language Change Andrew Wedel and Clay Beckner Language as a Complex System Workshop University of Arizona, 2008.

Slides:



Advertisements
Similar presentations
Chapter 16 Table of Contents Section 1 Genetic Equilibrium
Advertisements

Second Language Acquisition
Plasticity, exemplars, and the perceptual equivalence of ‘defective’ and non-defective /r/ realisations Rachael-Anne Knight & Mark J. Jones.
Cognitive Neuroscience of Language 1. Premise 1: Constituent Cognitive Processes Phonological analysis Syntactic analysis Semantic analysis Premise 2:
Evolution of Biodiversity
General architecture of Functional Discourse Grammar.
Approaches to Data Acquisition The LCA depends upon data acquisition Qualitative vs. Quantitative –While some quantitative analysis is appropriate, inappropriate.
 Evolution is the Change in the genetic material of a population of organisms from one generate to the next.  The Emergence of new species happen due.
Cognitive Processes PSY 334 Chapter 2 – Perception April 9, 2003.
Language, Mind, and Brain by Ewa Dabrowska Chapter 10: The cognitive enterprise.
Pattern Recognition Pattern - complex composition of sensory stimuli that the human observer may recognize as being a member of a class of objects Issue.
Language: Nature and Acquisition
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 1: Introduction to Decision Support Systems Decision Support.
Associative Learning in Hierarchical Self Organizing Learning Arrays Janusz A. Starzyk, Zhen Zhu, and Yue Li School of Electrical Engineering and Computer.
How do speech patterns spread through a community? Or, “Oh no, not another linguistics model”
Cognitive Processes PSY 334 Chapter 2 – Perception.
12 -1 Lecture 12 User Modeling Topics –Basics –Example User Model –Construction of User Models –Updating of User Models –Applications.
McEnery, T., Xiao, R. and Y.Tono Corpus-based language studies. Routledge. Unit A 2. Representativeness, balance and sampling (pp13-21)
A Complex Systems Approach to Language Patterning Andrew Wedel University of Arizona April 10, 2008.
Language Acquisition.
Educational Services for Individuals with Exceptionalities Adapted Lesson Plan.
Lecture # 8 SCIENCE 1 ASSOCIATE DEGREE IN EDUCATION DIVERSITY, ADAPTATION, AND EVOLUTION.
Speech Perception 4/6/00 Acoustic-Perceptual Invariance in Speech Perceptual Constancy or Perceptual Invariance: –Perpetual constancy is necessary, however,
Basic concepts of language learning & teaching materials.
Modelling Language Evolution Lecture 5: Iterated Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
EDU 385 Education Assessment in the Classroom
Adaptive Design of Speech Sound Systems Randy Diehl In collaboration with Bjőrn Lindblom, Carl Creeger, Lori Holt, and Andrew Lotto.
Selection and Change: Biology and Behavior AILUN – Lecture 4 S. Glenn - AILUN 2008.
Lexical Analysis Hira Waseem Lecture
Results presented here hint that growing cultures of bacteria under highly stable conditions for several thousand generations may lead to a global decrease.
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
1 Compiler Construction (CS-636) Muhammad Bilal Bashir UIIT, Rawalpindi.
Genetics and Speciation
SPEECH AND WRITING. Spoken language and speech communication In a normal speech communication a speaker tries to influence on a listener by making him:
Service Service metadata what Service is who responsible for service constraints service creation service maintenance service deployment rules rules processing.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
Chapter 16 Table of Contents Section 1 Genetic Equilibrium
Copyright © by Holt, Rinehart and Winston. All rights reserved. ResourcesChapter menu To View the presentation as a slideshow with effects select “View”
Comparing Snapshots of Networks Shah Jamal Alam and Ruth Meyer Centre for Policy Modelling 28 th March, 2007 – CAVES Bi-annual Meeting, IIASA,
Introduction of Intelligent Agents
What is Communicative Language Teaching??. Communicative Language: Blends listening, speaking, reading, and writing. Is the expression, interpretation,
Lexicography Lexicon has two different meanings:
Chia Y. Han ECECS Department University of Cincinnati Kai Liao College of DAAP University of Cincinnati Collective Pavilions A Generative Architectural.
Levels of Linguistic Analysis
Language Evolution and Change Presented by Brianna Conrey Complex Adaptive Systems Seminar February 27, 2003.
Biological Evolution Standard B – 5.4. Standard B-5 The student will demonstrate an understanding of biological evolution and the diversity of life. Indicator.
Evolutionary Phonology. Why?  Many universals and universal tendencies: phonetics, stress, syllable structure  Can’t be explained through rules alone.
Bridging the gap between L2 speech perception research and phonological theory Paola Escudero & Paul Boersma (March 2002) Presented by Paola Escudero.
The Computational Nature of Language Learning and Evolution 10. Variations and Case Studies Summarized by In-Hee Lee
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate its.
Lecture 2 Compiler Design Lexical Analysis By lecturer Noor Dhia
The Problem of Pattern and Scale in Ecology - Summary What did this paper do that made it a citation classic? 1.It summarized a large body of work on spatial.
LECTURE 9. Genetic drift In population genetics, genetic drift (or more precisely allelic drift) is the evolutionary process of change in the allele frequencies.
Usage-Based Phonology Anna Nordenskjöld Bergman. Usage-Based Phonology overall approach What is the overall approach taken by this theory? summarize How.
Chapter 9. A Model of Cultural Evolution and Its Application to Language From “The Computational Nature of Language Learning and Evolution” Summarized.
Exemplar Dynamics VOT of stops varies in languages VOT of stops varies in languages So people learn language specific VOT So people learn language specific.
How to Use This Presentation
Population Genetics And Speciation.
It is the study of the properties of genes in populations
Natural Selection Lab 14.
Cognitive Processes PSY 334
Abstraction versus exemplars
Revealing priors on category structures through iterated learning
Event-Based Architecture Definition Language
Levels of Linguistic Analysis
Chapter 16 Table of Contents Section 1 Genetic Equilibrium
Using the 7 Step Lesson Plan to Enhance Student Learning
Realtime Recognition of Orchestral Instruments
Presentation transcript:

Usage vs Acquisition in Language Change Andrew Wedel and Clay Beckner Language as a Complex System Workshop University of Arizona, 2008

Change in a steady-state population requires turnover Can be thought of as information loss + information gain. Bottlenecks in biological evolution

Kirby: Language acquisition is an information bottleneck

Acquisition-based model of compositionality vs. idiosyncrasy 2 dimensional meaning space with 25 bimorphemic words –a 0-4 x b 0-4 = 25 meanings –Each meaning is associated with a string of characters. Speaker utters 50 randomly chosen meanings to learner, who stores mappings between strings and meanings. Learner becomes new speaker, and utters another 50 random meanings to new learner. –If the meaning was encountered in the learning phase, the corresponding string is uttered. –If not, composition is attempted from other words sharing meaning components. –Small chance of deleting a character

Frequency differences of meaning expressions

Sample Results Intended take home message: high frequency enables idiosyncrasy to survive the acquisition bottleneck.

Change through drift Information is lost and gained in any population with turnover, whether abrupt or gradual. –Drift in biological populations –Drift in populations within categories through usage  Language change through information loss/gain could arise in principle in acquisition OR in usage.

Illustrate functional equivalence with Kirby-esque model Translate Kirby model into an exemplar format : –Words comprise 2 morphemes of 2 characters each. {a1, a2, a3, a4} + {b1, b2, b3, b4} –Listener is privy to the speaker’s meaning, and stores all percepts as exemplars of that meaning category Generalizations about string-morpheme mappings are passively stored within the total exemplar set, rather than as explicit rules.

Illustrate functional equivalence with Kirby-esque model Translate Kirby model into an exemplar format: –Provide two pathways for production of a meaning: Holistic: An exemplar is chosen at random from the set for the current meaning and produced. Compositional: The most frequent character string types for each morpheme in the current meaning are concatenated and produced. –Bias choice of pathway by frequency Highly frequent forms rarely use the compositional pathway. Very infrequent forms use the compositional pathway relatively more.

Bottleneck versus Drift Models Bottleneck: –Two agents, conceived as teacher and learner. –Teacher produces 200 outputs for a naive learner, who stores each as an exemplar in the corresponding meaning category. –Learner becomes teacher to new naive learner. Teacher’s choice of holistic versus compositional routes for each production influenced by the number of times the teacher heard each form as a learner.

Bottleneck versus Drift Models Drift: –Two agents conceived as continuously conversing to each other. –Speaker produces an output which is stored as a new exemplar by the listener, displacing an old exemplar. Speaker’s choice of holistic versus compositional routes for each production influenced by the frequency with which that meaning has been previously heard.

Results Run 200 independently seeded simulation runs in both drift and bottleneck mode. –Each run involves 40,000 productions Calculate a regularity score for the most common exemplar in each meaning category –1 if morphemes match the highest type frequency in the lexicon. –0 otherwise. Average scores for each meaning over 200 runs.

Results

Interim conclusion Change through information turnover in acquisition versus usage is not qualitatively different at this level of abstraction. What is qualitatively different between acquisition and usage? –Rate of category label creation/loss

Category creation versus category usage Category creation involves abstraction of category labels from distributions in input data. –Language acquisition Usage involves mapping data to and from existing category labels. –Language use

Categories contain variants /letter ‘a’/ [aA A aaå a a ] Two qualitatively different kinds of change given this conception: Change in category labels, or change in category contents.

Influence of existing categories on present behavior Wide array of evidence that perception and production are influenced by preexisting category structure. –Perception: Categorical perception (?) Perceptual magnet effect (Kuhl 1991) –Production: Motor patterns (e.g., Zanone & Kelso 1997) Language change patterns (cf. ‘Choice’, Blevins 2004)

Category creation versus category usage Acquisition and usage contribute qualitatively distinct pathways of language change. –Acquisition Changes in category system –Usage Changes in category contents Each constrains the other.

Illustrate with contrast- maintenance simulation Horizontal, usage phase –Agents produce forms with reference to existing sound categories Sound outputs are an average, with sampling biased toward within-category exemplars. Vertical, acquisition phase –Agents abstract new sound categories on the basis of the distribution of perceived sounds.

Expected properties of this architecture Change in category contents in the horizontal phase should be influenced by the existing sound category labels Change in the set of sound category labels should be influenced by changes in category contents.

Horizontal phase: two sound categories abab

Horizontal phase: one sound category a

Vertical phase Depending on the breadth of a bimodal distribution from the preceding horizontal phase, it may be acquired as one or two categories in the vertical phase. –with distinct repercussions on the trajectory of change in the following horizontal phase.

The interdependency of category label abstraction and category use Two experiments: 1.Keep the number of total vertical acquisition steps constant, but vary the number of horizontal usage steps between. 2.Keep the number of total horizontal usage steps constant, but vary the number of vertical acquisition steps.

Experiment structure Six word categories Seed with a sound distribution that will be initially acquired into nine categories. –With six word categories each comprising two sounds, three sound categories is the most stable state in this simulation architecture. Look at rate of relaxation from nine towards three sound categories.

1: Acquisition steps constant, usage steps vary Each point is the average of 10 independent runs

2: Acquisition steps vary, usage steps constant Each point is the average of 10 independent runs

Conclusions Usage versus acquisition may not be a particularly useful apposition in understanding language change given that they do not refer to well- distinguished mechanisms. –Acquisition involves usage –At least some kinds of language acquisition continue throughout life

Conclusions A more useful distinction may lie between change in category labels versus change in category mappings –Roughly correspond to frequent types of changes that occur in ‘acquisition’ versus ‘usage’.

Conclusions We illustrated interaction of both types of change in a simulation instantiating two experimentally-supported properties of language: 1.Pathways of change in usage are influenced by the existing set of categories. 2.Abstraction of category labels is influenced by the input distribution -- which evolves through usage in the previous generations.