Greta MPEG-4 compliant Script based behaviour generator system: Script based behaviour generator system: input - BML or APML input - BML or APML output.

Slides:

Advertisements

Similar presentations

Delivering Effective Presentations. The audience Talking to small groups Presenting to larger groups Do you know the audience members? Appropriate language.

Advertisements

Expressive Gestures for NAO NAO TechDay, 13/06/2012, Paris Le Quoc Anh - Catherine Pelachaud CNRS, LTCI, Telecom-ParisTech, France.

ENTERFACE’08 Multimodal Communication with Robots and Virtual Agents.

RRL: A Rich Representation Language for the Description of Agent Behaviour in NECA Paul Piwek, ITRI, Brighton Brigitte Krenn, OFAI, Vienna Marc Schröder,

Herwin van Welbergen Dennis Reidsma Stefan Kopp.  Beyond turn taking interaction ◦ Continuous perception and behavior generation  Interpersonal coordination.

Persuasive Listener in a Conversation Elisabetta Bevacqua, Chris Peters, Catherine Pelachaud (IUT de Montreuil - Paris 8)

Class 6 LBSC 690 Information Technology Human Computer Interaction and Usability.

MUSCLE movie data base is a multimodal movie corpus collected to develop content- based multimedia processing like: - speaker clustering - speaker turn.

Game Development with Kinect

Written Communication Objective: to design, construct and implement written communication that facilitates understanding and results in action taken Written.

Sketchify Tutorial Graphics and Animation in Sketchify sketchify.sf.net Željko Obrenović

1 Transparent control of avatar gestures A prototype Francesca Barrientos GUIR Meeting  28 April 2000.

Communicating with Avatar Bodies Francesca Barrientos Computer Science UC Berkeley 8 July 1999 HCC Research Retreat.

CSD 5230 Advanced Applications in Communication Modalities 7/3/2015 AAC 1 Introduction to AAC Orientation to Course Assessment Report Writing.

Unit 3 Communication. 2 Types of Communication Verbal Verbal.

GUI: Specifying Complete User Interaction Soft computing Laboratory Yonsei University October 25, 2004.

NON-VERBAL COMMUNICATION

Expressive Emotional ECA ✔ Catherine Pelachaud ✔ Christopher Peters ✔ Maurizio Mancini.

Windows Web Xbox Mobile … and WakeUpAndCode.com.

Introduction to Maya. Maya’s Layout User Interface Elements In Maya, you can tear off menus to create separate floating boxes that you can place anywhere.

Chapter 7. BEAT: the Behavior Expression Animation Toolkit

Geometric Psychology Mentoring CPD & Supervision.

The persuasive import of gesture and gaze. The importance of bodily behaviour in persuasive discourse has been acknowledged as early as in ancient Rome.

APML, a Markup Language for Believable Behavior Generation Soft computing Laboratory Yonsei University October 25, 2004.

ASL I RICHLAND HS J. PARMLEY BIRDVILLE ISD The Structure and Function of ASL.

1 Université Paris 8 Multimodal Expressive Embodied Conversational Agents Catherine Pelachaud Elisabetta Bevacqua Nicolas Ech Chafai, FT Maurizio Mancini.

Full-body motion analysis for animating expressive, socially-attuned agents Elisabetta Bevacqua Paris8 Ginevra Castellano DIST Maurizio Mancini Paris8.

«WAYS, MEANS AND SOME “LANGUAGES” «WAYS, MEANS AND SOME “LANGUAGES” OF COMMUNICATION» OF COMMUNICATION»

Sign Language – 5 Parameters Sign Language has an internal structure. They can be broken down into smaller parts. These parts are called the PARAMETERS.

Chapter 4: Nonverbal Communication Skills

Lecture 15 – Social ‘Robots’. Lecture outline This week Selecting interfaces for robots. Personal robotics Chatbots AIML.

Backchannels Through Gaze as Indicators of Persuasive Success E. Bevacqua, M. Mancini, C. Peters, C. Pelachaud University of Paris 8 Isabella Poggi Università.

1 MPML and SCREAM: Scripting the Bodies and Minds of Life-Like Characters Soft computing Laboratory Yonsei University October 27, 2004.

ENTERFACE 08 Project 1 “MultiParty Communication with a Tour Guide ECA” Mid-term presentation August 19th, 2008.

Speech Chapter 3: Sending Nonverbal Messages. Nonverbal Communication Any form of communication that doesn’t use words. – Body language – Appearance –

1 Representing New Voice Services and Their Features Ken Turner University of Stirling 11th June 2003.

Toward a Unified Scripting Language 1 Toward a Unified Scripting Language : Lessons Learned from Developing CML and AML Soft computing Laboratory Yonsei.

Mixed Reality: A Model of Mixed Interaction Céline Coutrix, Laurence Nigay User Interface Engineering Team CLIPS-IMAG Laboratory, University of Grenoble.

Österreichisches Forschnungsinstitut für Artificial Intelligence Representational Lego for ECAs Brigitte Krenn.

CITA 342 Section 2 Visual Programming. Allows the use of visual expressions (such as graphics, drawings, or animation) in the process of programming.

Human Figure Animation. Interacting Modules The ones identified –Speech, face, emotion Plus others: –Perception –Physiological states.

The art of composing, writing, acting, or producing plays drama.

Animated Speech Therapist for Individuals with Parkinson Disease Supported by the Coleman Institute for Cognitive Disabilities J. Yan, L. Ramig and R.

Communication Jargon. jargon jargon: A special language of a particular activity or group.

Understanding Nonverbal Language

Computer Programming Modeling a Passive Solar Home.

TYPES OF COMMUNICATION

Nonverbal Communication. Communication in general is process of sending and receiving messages that enables humans to share knowledge, attitudes, and.

Drilling Visualisation API. Application / API One main desktop application Possibility to switch to VR mode (wand + head tracking + stereo) Possibility.

Multimodal Plan Representation for Adaptable BML Scheduling Dennis Reidsma, Herwin van Welbergen, Job Zwiers.

COMMUNICATING EFFECTIVELY Chapter 4. Communication to me is,………

ENTERFACE 08 Project #1 “ MultiParty Communication with a Tour Guide ECA” Final presentation August 29th, 2008.

Chapter Nineteen The Body in Delivery. Chapter Nineteen Table of Contents zFunctions of Nonverbal Communication in Delivery zBody Language zPracticing.

ENTERFACE’08 Multimodal Communication with Robots and Virtual Agents mid-term presentation.

Practice Quiz. A Lesson on Language One of the features that make language unique is the set of symbols that can be broken down into smaller parts.

Non-verbal communication. Non-verbal messages People tend to believe in non-verbal messages more than they do with verbal messages.

Chapter 5 Lesson 2 What is communication?. Communication is when 2 or more people exchange thoughts, feelings, and beliefs. Listening and speaking form.

NONVERBAL COMMUNICATION.  As much as 93 % of communication is nonverbal, with 55% sent through facial expression, posture, and gestures and 38% through.

Use of Symbols Gestures Voice Output Devices – low and high tech Sign language Visuals – Picture Exchange Words Sentences.

WP6 Emotion in Interaction Embodied Conversational Agents WP6 core task: describe an interactive ECA system with capabilities beyond those of present day.

Communication. What is communication? Communication is successfully making your wants, needs, feelings and ideas known to other people. There are three.

Krista Cohen Maura Herman Lauren Thomas.  Body Language ◦ a form of mental and physical ability of human non-verbal communication which consists of body.

Modeling Expressivity in ECAs

(things that make one sign different from another)

POSITIVE COACHING SCOTLAND POSITIVE BODY LANGUAGE

Miss Weaver MEDIA/VISUAL ART. SIGN LANGUAGE: WHAT IS IT? A sign language (also signed language or simply signing) is a language which, instead of acoustically.

Performing Poetry.

Outstanding issues for Animgen

Verbal Language is… A system: consists of sounds, words, and their arrangement Symbolic Conventional Learned.

Presentation transcript:

Greta MPEG-4 compliant Script based behaviour generator system: Script based behaviour generator system: input - BML or APML input - BML or APML output - MPEG-4 animation output - MPEG-4 animation realistic multimodal behaviour: uses gestures, gaze, head nodes, facial expressions, intonation, torso movements voice - external TTS Non-interactive University Paris 8

Interface 1. choose language 2. choose APML/BML file 4. generate animation 5. see it 3. choose espressivity values

Greta tools: BML Editor University Paris 8

BML behaviour mark-up language of SAIBA framework operates at signal level different channels of (non)verbal communication can be defined:  head movements  gaze  facial expressions  gestures  speech

BML head=head_down 1 1 affect=surprise 0

BML head=head_down 1 1 affect=surprise 0 expressivity parameters duration class and instance unique name

BML head=head_down 1 1 affect=surprise 0 expressivity parameters duration class and instance unique name

BML head=head_down 1 1 affect=surprise 0 expressivity parameters duration class and instance unique name

BML head=head_down 1 1 affect=surprise 0 expressivity parameters duration class and instance unique name

BML Editor Different communication channels can be used simultaneously Each signal is defined in a separate « block » Each block is defined by :  unique name  class and instance of a signal according to Poggi`s taxonomy  start and end time  five expressivity parameters

BML Editor: expressivity The expressivity parameters can be defined for each nonverbal signal:

BML Editor: Feedback Window « feedback widow » allows for an immediate visualisation of animation

Greta tools: Gesture Editor University Paris 8

Gesture Editor it is used to create and edit gestures it uses a graphical interface, hiding the gesture textual description STARTFRAME 0.2 FRAMETYPE stroke_start ARM XC YCC ZNear HAND form_fist WRIST FBAway PalmInwards ADDNOISE ENDFRAME STARTFRAME 0.2 FRAMETYPE stroke_start ARM XC YCC ZNear HAND form_fist WRIST FBAway PalmInwards ADDNOISE ENDFRAME

Gesture Editor It allows you to define: arm position hand shape hand and fingers orientation gesture phrases e.g.: stroke, hold hase

Gesture Editor Expressivity parameters can also be set for each gesture:

Gesture Editor Finally the gesture can be tested. The Greta agent performs it as it will be shown during animations: