1. Chapter 9. The PlayMate System （ 2/2 ） in Cognitive Systems Monographs. Rüdiger Dillmann et al. Course: Robots Learning from Humans Summarized by Nan Changjun Biointelligence Laboratory School of Computer Science and Engineering Seoul National University http://bi.snu.ac.kr

2. Contents 9.1 Introduction 9.2 System Overview 9.3 System Level Control of Information Flow 9.3.1 Cross Modal Learning 9.3.2 Clarification and Question Answering 9.3.3 Mediating between Qualitative and Quantitative Representations 9.4 Conclusions and Discussion © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 2

3. 9.3 System Level Control of Information Flow Chapter 9. The PlayMate System （ 2/2 ） © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 3

4. 9.3.1 Cross Modal Learning Methods for cross modal learning( Chapter7 ) A continuous learning algorithm that is used for learning associations between vision and language. Tutor driven Tutor supervised learning © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 4

5. 9.3.1 Cross Modal Learning © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 5 Fig. 9.6. The extended timeline for learning activity for the "This is a blue square." example

6. 9.3.1 Cross Modal Learning Tutor driven learning Utterances Motive Plan © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 6

7. 9.3.1 Cross Modal Learning Tutor supervised learning Utterances Motive Plan © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 7

8. 9.3.2 Clarification and Question Answering How to answering ambiguous questions? Ambiguous However, lacking information it must clarify the ambiguous reference – the system’s attempt to raise a motive to answer the question : “What shape is this thing?” © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 8

9. 9.3.2 Clarification and Question Answering © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 9 Fig. 9.7. Tutor driven learning, question answering, tutor supervised learning and clarification of ambiguity are all handled in a similar framework.

10. 9.3.3 Mediating between Qualitative and Quantitative Representations © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 10 https://www.youtube.com/watch?v=tkK8pjRSPvI

11. 9.4 Conclusions and Discussion Chapter 9. The PlayMate System （ 2/2 ） © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 11

12. 9.4 Conclusions and Discussion Goal: Presented a systems level cognitive systems A synthesis of old and new approaches from AI and robotics Building complete cognitive systems. The PlayMate architectural solutions Shared representations: Parallel processing of distributed representations Abstraction Abstract, stable representations Binding Processing control © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 12

13. Thank you for your attention! © 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 13