Presentation on theme: "Descriptive schemes for facial expression introduction."— Presentation transcript:
Descriptive schemes for facial expression introduction
Facial expression databases The truth is out there –15 different image databases in D5b + multimodal ones Are they any good? –Limited color quality, bad lighting, extreme, acted emotions –Most of them are still images, some come from VHS tapes
Facial expression databases (cont.) Why bother with automatic annotation? Huge amounts of video data –Manual, per frame annotation is consuming No objective methods/experts High-level annotation does not pick out specific features –Synthesis side? ECAs?
Facial expression understanding FAPs: high-level representation of facial motion Are they any good for expression modeling? Humans seem to possess an even higher-level perception –enables them to estimate emotion when information is missing
Multimodality Different modalities may provide contrasting cues Visual events don’t coincide with audio –You open your mouth right before you start talking Audio and video can complement each other –Pause detection helps mouth area extraction –Viseme detection may help speech recognition
Database requirements Are all databases born the same? What qualities does your video need? Common mishaps Live test with feature extraction and understanding –Problems in image processing and representation