Presentation is loading. Please wait.

Presentation is loading. Please wait.

The EmoTV Corpus Naturalistic data Emotion in dialogue/interaction: Television databases from QUB and LIMSI (Sarkis Abrilian, Laurence Devillers, Jean-Claude.

Similar presentations


Presentation on theme: "The EmoTV Corpus Naturalistic data Emotion in dialogue/interaction: Television databases from QUB and LIMSI (Sarkis Abrilian, Laurence Devillers, Jean-Claude."— Presentation transcript:

1 The EmoTV Corpus Naturalistic data Emotion in dialogue/interaction: Television databases from QUB and LIMSI (Sarkis Abrilian, Laurence Devillers, Jean-Claude Martin, Ellen Douglas-Cowie) The EmoTV Corpus HUMAINE - Workshop on Databases - Belfast

2 Theoretical Issues Study naturalistic and non-acted dataStudy naturalistic and non-acted data How to annotate real-life non basic emotions ?How to annotate real-life non basic emotions ? Define a typology of non-basic emotionDefine a typology of non-basic emotion How do emotion and multimodality correlate ?How do emotion and multimodality correlate ? Cross cultural studiesCross cultural studies Specification of real-life emotions in ECAsSpecification of real-life emotions in ECAs Coordination between modalitiesCoordination between modalities Specification of mixed emotionsSpecification of mixed emotions

3 Collection Video selection criteria in EmoTV1 TV monologue in interview contextTV monologue in interview context Realistic non acted situationsRealistic non acted situations Presence of emotional behaviorPresence of emotional behavior Speaker face and upper body (close-medium shot)Speaker face and upper body (close-medium shot) Multimodal signs: speech, head, face, gaze, gesture, torsoMultimodal signs: speech, head, face, gaze, gesture, torso French languageFrench language One personOne person Ordinary peopleOrdinary people

4 EmoTV-1 Video clips 51 clips from French TV channels51 clips from French TV channels Mostly interviews from newsMostly interviews from news 48 different persons48 different persons 24 different topics : politics, sport, law, religion…24 different topics : politics, sport, law, religion… Duration: 12 min (4 – 43 seconds per clip)Duration: 12 min (4 – 43 seconds per clip) Words: 2500 (800 different words)Words: 2500 (800 different words) Wide range of positive / negative emotionsWide range of positive / negative emotions

5 Topic distribution

6 Advantages & Drawbacks AdvantagesAdvantagesSpontaneous Various contexts Reveals requirements on annotation schemes at several levels DrawbacksDrawbacks Visibility ofVisibility of facial expression: glasses / hairs / beardfacial expression: glasses / hairs / beard gesturesgestures Video and audio qualityVideo and audio quality

7 Future directions Copyrights : TF1 (70% of the corpus), ELDA Copyrights : TF1 (70% of the corpus), ELDA EmoTV2 EmoTV2 More news More news Interaction between 2 persons Interaction between 2 persons Annotations with new coding schemes Annotations with new coding schemes Study the use for specification of ECAs Study the use for specification of ECAs Perceptual tests Perceptual tests

8 Output for exemplar « Provocative » corpus« Provocative » corpus Coding schemesCoding schemes EmotionEmotion ContextContext Multimodal signsMultimodal signs Samples of annotation files and videoSamples of annotation files and video Protocole and annotation guidesProtocole and annotation guides Collection, annotation, validationCollection, annotation, validation

9 Related talks Annotation of emotion and contextAnnotation of emotion and context Annotation of multimodal signsAnnotation of multimodal signs


Download ppt "The EmoTV Corpus Naturalistic data Emotion in dialogue/interaction: Television databases from QUB and LIMSI (Sarkis Abrilian, Laurence Devillers, Jean-Claude."

Similar presentations


Ads by Google