Presentation is loading. Please wait.

Presentation is loading. Please wait.

Grounded Language Acquisition Enables Intuitive Reasoning Josefina Sierra Software Department Technical University of Catalonia, Spain Josefina Santibáñez.

Similar presentations


Presentation on theme: "Grounded Language Acquisition Enables Intuitive Reasoning Josefina Sierra Software Department Technical University of Catalonia, Spain Josefina Santibáñez."— Presentation transcript:

1 Grounded Language Acquisition Enables Intuitive Reasoning Josefina Sierra Software Department Technical University of Catalonia, Spain Josefina Santibáñez Education Department University of La Rioja Spain

2 Experiment simulates a grounded approach to language acquisition conceptualization environment shared lexicon and grammar Communicate facts about their environment self-generated they understand in an intuitive way they can reason about

3 Perception dark light Categories VHL O O O O O1 ≈ {up, left, light} O2 ≈ {up, right, dark} O3 ≈ {down, left, light} O4 ≈ {down, right, dark} L(x) 0.5

4 Categorization builds Perceptually grounded categories: up, right … Perceptually grounded categorizers: cognitive procedures that allow checking whether a cate- gory holds or not for a given object. Categorizer: righ C (x) ≡ 0.0 < H(x) < 0.5 Perceptual cognitive processes an agent must go through in order to evaluate a given category. If the agent is conscious of such processes it can use them for intuitive reasoning.

5 Truth Evaluation Truth evaluation is a cognitive process capable of applying the categorizers of a tuple of cate- gories to an object and observing their output. E ( (c 1,…, c n ), x ) = (v 1,…, v n ) where v i = c i C (x) E(light,O1)=1 E(up,O4)=0 E ( (light,up),O3 ) = (1,0) E((light,up),{O1,O2,O4}) = {(1,1), (0,1), (0,0)} light → up

6 Logical categories: not, and, nand, or, nor, iff, xor, if, nif, oif and noif. E((light,up),{O1,O2,O4}) = {(1,1), (0,1), (0,0)} ≡ S if light → up charaterizes the subset {O1,O2,O4} Single: E(c, x) є {0, 1} S not = {0} Pairs: E((c 1,c 2 ), x) є {(0,0), (0,1), (1,0), (1,1)} S or ≡ {(1,1), (0,1), (0,1)} S and ≡ {(1,1)} S iff ≡ {(1,1), (0,0)} S if ≡ {(1,1), (0,1), (0,0)}

7 Logical categories: not, and, nand, or, nor, iff, xor, if, nif, oif and noif. Logical categorizers: cognitive procedures that allow determining whether a logical category holds for a tuple of categories and an object. not C ≡ E(c, x) є {0} S not and C ≡ E((c1,c2), x) є {(1,1)} S and iff C ≡ E((c1,c2), x) є {(0,0), (1,1)} S iff or C ≡ E((c1,c2), x) є {(0,1), (1,0), (1,1)} S or E(ā, x) є S l where l is a logical category and S l is the subset of the range for which l holds

8 Topic {O1, O2, O4} Conceptualizations E ( (down,light), T ) = S nand {(0,1),(0,0),(1,0)} E ( (down,light), B ) = {(1,1)} E((up,right), T) = S or {(1,0),(1,1),(0,1)} E((up,right), B) = {(0,0)}  (down  light) Background {O3} up  right

9 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] Hearer Topic Background

10 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Background Topic Hearer

11 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Hearer 0.7 [or, up, right] 0.5 [xor, up, right] Interpret {1,2,4} Topic Background

12 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Hearer 0.7 [or, up, right] 0.5 [xor, up, right] Interpret {1,2,4} = Topic? yes Background Topic

13 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Hearer 0.7 [xor, up, right] 0.5 [or, up, right] Interpret {1,4} = Topic? no Background Topic

14 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Hearer can’t parse Topic Background

15 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] 0.8 arriba o derecha 0.7 excepto claro abajo 0.6 claro implica arriba 0.5 arriba si claro "arriba o derecha" Generation Hearer can’t parse arriba o derecha [if, light, up] adopts assoc concept topic Topic Background

16 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] can’t generate Background Topic

17 [nand, light, down] [or, up, right] Concept Speaker [if, light, up] “arriba o derecha" Hearer can’t parse arriba o derecha [if, light, up] adopts assoc concept topic invents sentence [or, up, right] and adopts assoc can’t generate Background Topic

18 Conclusions At the end of a simulation run agents build different conceptualizations and grammars. Compatible enough to allow unambiguous communication of propositional formulas. The categorizers of perceptually grounded and logical categories built in the language acquisition process can be used for limited forms of common sense reasoning. This requires the agents to be conscious of using categorizers and of their behavior.


Download ppt "Grounded Language Acquisition Enables Intuitive Reasoning Josefina Sierra Software Department Technical University of Catalonia, Spain Josefina Santibáñez."

Similar presentations


Ads by Google