1. Intelligent Robot Architecture (1-3)  Background of research  Research objectives  By recognizing and analyzing user’s utterances and actions, an intelligent robot must be able to capture the intention of the user to make correct responses  In a multimodal dialog environment, a human and a robot interact by using combinations of spoken language and various gestures, even facial expressions. Therefore, a multimodal interface technique is important for developing an intelligent robot  Multimodal interaction manager model - Combine and analyze the speech and gesture - Recognition to capture the intention of the user - Decide the robot’s intention according to the user’s intention. i.e., decide what to do and what to say.  Intelligent user modeling - Define generic user models and develop a reinforcement learning for a friendly evolving interaction.

2.  Research contents Intelligent Robot Architecture (1-3)  Developing a multimodal interaction model - Developing a Multimodal anaphora processing method - Defining the representation of user’s intentions and robot’s domain actions in a multimodal interaction environment - Developing a prototype system of a multimodal interaction manager Observation Observable Object Agent Time Instance Observing Agent Observing Agent Observation Time Observation Time Drinking Action Drink Table Notebook Observed Object Observed Object Drinking Time Drinking Time Drinking Agent Drinking Agent Drinked Drink Drinked Drink 솔의눈 space At Cup 사람 Robot Vision Hold On X,Y,Z Absolute Cord Volume Model Volume 거실 Dialogue Model User’s Intention Recognizer Robot’s Task Planner DiscourseHistoryDiscourseKnowledge Multimodal Interaction Manager Real-world & Object Ontology Speech & Gesture Recognition MultimodalInstanceGrounding Recognized Speech & Gesture Anaphora Instance 컵 101

3.  Research contents Intelligent Robot Architecture (1-3)  Recognition model of user’s goal and intention - Developing to analyze user’s intention using a plan inference technique and a dialogue manager - Developing a sentence generation engine  Inference technique based on user models - Defining a ontology to include a user profile. i.e., preference, life pattern

4. Jungyun Seo Dept. of Computer Science & Interdisciplinary Prog. of Integrated Biotechnology, Sogang Univ. seojy@sogang.ac.kr, http://nlp.sogang.ac.kr Research Institutes : Sogang University, Kangwon National University, Dongseo University Researchers : 18(Univ. 18, Industry 0) Project Leader