Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Towards Human-Realistic Animation by Observing Real Human Dynamics Darren.

Slides:

Advertisements

Similar presentations

Inspiration Communication

Advertisements

Understanding Body Language. Body Language Make a group of 4 Make a group of 4 As a group, for the following images of couples, analyze what message you.

Alignment in multimodal dialogue corpora Robin Hill and Ellen Gurman Bard Edinburgh.

Alina Pommeranz, MSc in Interactive System Engineering supervised by Dr. ir. Pascal Wiggers and Prof. Dr. Catholijn M. Jonker.

HUMAINE Summer School - September Basic Emotions from Body Movements HUMAINE Summer School 2006 Casa Paganini Genova, Italy Ahmad S. Shaarani The.

APGV04 Towards Perceptually Realistic Talking Heads: Models, Methods and McGurk David Marshall, Darren Cosker and Paul Rosin Cardiff School of Computer.

Rui Tang, Darren Cosker and Wenbin Li Global Alignment for Dynamic 3D Morphable Model Construction University of Bath.

Real-Time Dynamic Wrinkles Caroline Larboulette Marie-Paule Cani GRAVIR Lab, Grenoble, France.

Info Vis in Games Ameya Datey Ameya Datey Sanjiv Parikh Sanjiv Parikh Ajay Jampani Ajay Jampani.

Designing Facial Animation For Speaking Persian Language Hadi Rahimzadeh June 2005.

Facial expression as an input annotation modality for affective speech-to-speech translation Éva Székely, Zeeshan Ahmed, Ingmar Steiner, Julie Carson-Berndsen.

3D Face Modeling Michaël De Smet.

GERG Santorini, June, 2004 “Ekman versus Scherer” or “What is important to recognize/express emotion?” (Selected GERG studies directed by Susanne.

Integrate face tracking into driving simulator COMP6470 Special topic in computing Lei Wang Supervisor: Tom Gedeon.

Towards Human-Realistic Animation by Studying Human Dynamics Darren Cosker Towards Human-Realistic Animation by Studying Human Dynamics Darren Cosker Department.

Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. Thomas Vetter Germany University of Freiburg

The Emotional Intelligence Association Developing the Emotional Intelligence of Leaders.

Emotional Intelligence and Agents – Survey and Possible Applications Mirjana Ivanovic, Milos Radovanovic, Zoran Budimac, Dejan Mitrovic, Vladimir Kurbalija,

Sunee Holland University of South Australia School of Computer and Information Science Supervisor: Dr G Stewart Von Itzstein.

Matthias Wimmer, Sylvia Pietzsch, Freek Stulp and Bernd Radig Chair for Image Understanding Institute for Computer Science Technische Universität München.

Computer Vision in Graphics Production Adrian Hilton Visual Media Research Group Centre for Vision, Speech and Signal Processing University of Surrey

California Department of Aging Participant Staff Training Assessments SENIOR COMMUNITY SERVICE EMPLOYMENT PROGRAM (SCSEP)

Traits Motives & Characteristics of Leadership Amir Akbar.

Grafica(1): Introduction Dott. Alessio Malizia

Enabling enactive interaction in virtualized experiences Stefano Tubaro and Augusto Sarti DEI – Politecnico di Milano, Italy.

Interstate New Teacher Assessment and Support Consortium (INTASC)

EWatchdog: An Electronic Watchdog for Unobtrusive Emotion Detection based on Usage Analysis Rayhan Shikder Department.

Facial animation retargeting framework using radial basis functions Tamás Umenhoffer, Balázs Tóth Introduction Realistic facial animation16 is a challenging.

Graphite 2004 Statistical Synthesis of Facial Expressions for the Portrayal of Emotion Lisa Gralewski Bristol University United Kingdom

Interactive Spaces Huantian Cao Department of Computer Science The University of Georgia.

Full-body motion analysis for animating expressive, socially-attuned agents Elisabetta Bevacqua Paris8 Ginevra Castellano DIST Maurizio Mancini Paris8.

Modeling and simulation of systems Model building Slovak University of Technology Faculty of Material Science and Technology in Trnava.

N n Debanga Raj Neog, Anurag Ranjan, João L. Cardoso, Dinesh K. Pai Sensorimotor Systems Lab, Department of Computer Science The University of British.

VIRTUAL WORLDS IN EDUCATIONAL RESEARCH © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.

Howard Gardner’s Logan Gordon Kellie Kelsch Clint Mason.

Perceptual Analysis of Talking Avatar Head Movements: A Quantitative Perspective Xiaohan Ma, Binh H. Le, and Zhigang Deng Department of Computer Science.

Cognitive Systems Foresight Language and Speech. Cognitive Systems Foresight Language and Speech How does the human system organise itself, as a neuro-biological.

CPSC : Data-driven Computer Graphics Jinxiang Chai.

Electronic visualization laboratory, university of illinois at chicago Towards Lifelike Interfaces That Learn Jason Leigh, Andrew Johnson, Luc Renambot,

Immersive Virtual Characters for Educating Medical Communication Skills J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine)

INPUT DEVICES. Keyboard & Mouse  Keyboard: Enter text and commands  Mouse: Point, Select & enter Commands.

WP6 Emotion in Interaction Embodied Conversational Agents WP6 core task: describe an interactive ECA system with capabilities beyond those of present day.

COMMUNICATION MEDIA, AND . PRESENTERS: CHOGO,M,D (092SIS10). :AKPADE, YAYRA EDNA (092SIS1).

Chapter 18: Your Body in Delivery. Pay Attention to Body Language  Body language includes  Facial expressions;  Eye behavior;  Gestures;  General.

Presented By Meet Shah. Goal  Automatically predicting the respondent’s reactions (accept or reject) to offers during face to face negotiation by analyzing.

3D Animation 1. Introduction Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.

Nataliya Nadtoka James Edge, Philip Jackson, Adrian Hilton CVSSP Centre for Vision, Speech & Signal Processing UNIVERSITY OF SURREY.

Virtual Reality Prepared By Name - Abhilash Mund Regd.No Branch - Comp.sc & engg.

Crowds (and research in computer animation and games)

Klara Nahrstedt Spring 2009

Automatic Speed Control Using Distance Measurement By Single Camera

Multiple View Geometry

AHED Automatic Human Emotion Detection

Character Composition

Character Composition

Communication and Its Process.

Real-Time Human Pose Recognition in Parts from Single Depth Image

Effective Teacher Partner up & name 5 characteristics that you think make up an effective teacher. Communicate Compassionate Knowledgeable Personable Perceptive.

Crowds (and research in computer animation and games)

Teaching for Multiple Intelligences

J. Hernendez, A. Stevens, D. S. Lind

“man, how you define computer

Towards lifelike Computer Interfaces that learn

A POCKET GUIDE TO PUBLIC SPEAKING 5TH EDITION Chapter 18

F. Durupinar, M. Kapadia, S. Deutsch, M. Neff & N. Badler

Marian Stewart Bartlett, Gwen C. Littlewort, Mark G. Frank, Kang Lee

Motivation It can effectively mine multi-modal knowledge with structured textural and visual relationships from web automatically. We propose BC-DNN method.

Effective presentation skills II

Presentation transcript:

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Department of Computer Science, University of Bath

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Motivation

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Overview Analysis and Re-Synthesis of Facial Dynamics –Dynamics > CG Puppet –Dynamics > us –Dynamics > Computer Vision Intuitive/Automatic methods for animation –Voice Driven Animation/Analysis –Reactive Avatars

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing/Resynthesising Dynamics Time Parameter Magnitude

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing/Resynthesising Dynamics Study effect of manipulating temporal characteristics of emotions, e.g. smiles [Emotion 2007]

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing/Resynthesising Dynamics

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing/Resynthesising Dynamics

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing/Resynthesising Dynamics What did we learn? –Genuine Dynamics = More likeable/Trustworthy/Employable –Fake Dynamics = Less Likeable/Trustworthy/Employable Relationship between Attractiveness and Facial Dynamics To Do! - Mock Video Game Scenario

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 1.Define facial regions local to sub-facial actions 2.Construct new training set of artificial images Analysing Multiple Actions

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Analysing Multiple Actions 3.Create a corresponding artificial training set of shape vectors

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Performance Analysis

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Image Based Transfer

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Performance Analysis

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 3D Model Transfer Animation of a 3D facial model

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 3D Model Transfer Dynamic knowledge easily applied to existing pipelines

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 3D Facial Modelling 4D Camera – Continuous 3D Scanning (Cardiff/Surrey)

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 3D Facial Modelling (Link to 3D Example Expression)Example

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker 3D Facial Modelling

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Voice Driven Animation Visual Speech Synthesis Non-Verbal Action Synthesis

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Perceptual Evaluation Motivation: How best to evaluate facial animation? –Perceptual test based on McGurk effect [ACM TAP 2005]

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Perceptual Evaluation Record participant responses Compare real and synthetic Subtle - participants blind to real motivation Isolate strengths and weaknesses

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Reactive Full Body Avatar Animation Motivation: –Animate based on an input performance –Key avatar drives other avatar behaviour

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Conclusions and Future Directions Humans are very sensitive to different dynamics Different interpretation depending on timing Human realism will depend on understanding dynamic behaviours Realism will also depend on the accurate modelling and resynthesis of dynamics - e.g. McGurk effect Technology now allows study of 3D dynamics - our work has only just started!

Towards Human-Realistic Animation by Observing Real Human Dynamics Darren Cosker Thanks for listening! Acknowledgements: Eva Krumhuber, Antony Manstead, Lanthao Benedikt, David Marshall, Paul Rosin, Alistair Calvert, Cathy Holt, Daniel Mason, Gemma Whatling, Simon Rushton, Susan Paddock RAEng, EPSRC.