1. Modeling Emotion Frameworks Useful In Computation and Speech Frank Enos

2. Overview General Questions Approaches to Describing Emotion Theoretical Models of Emotion Some Computational Frameworks

3. General Questions What makes E. relevant to Computation? What makes E. relevant to the study of speech? How can a subjective process be understood in computational terms? How do we operationalize our model? Caveat: emotions vs. linguistic labels

4. Describing Emotions Taxonomic descriptions* (Izzard) Discreet descriptions*  “Basic” emotions (Frijda, Plutchick) Dimensional (continuous) descriptions (Arnold, Schlosberg) Raw “empirical” observations, anecdotal reports Evidence  Langugage, self reports, behavioral, physiological *not an exhaustive list

5. Theoretical Frameworks (Cornelius) Evolutionary (Darwin)  Behavioral – physiological  Expression Jamesian  Physiological – behavioral  Experience Cognitive (Arnold)  Thought and emotion inseparable  Appraisal Social Constructivist (Averill)  E. fully understood only on social level of analysis

6. Appraisal Theory (Arnold) Describes mechanism that elicits the appropriate emotion in circumstances in which the functions of that emotion are called for. (Smith) Meaning based and evaluative  Individuals react differently Continuous process (not necessarily conscious) Produces action tendency / action readiness Highly differentiated Conducive to computational modeling

7. Beyond Appraisal Theory Emotion as Information (Clore)  Conceptual Priming vs. Feelings as Information  Judgement (Damasio) Intentionality, Agency and Emotion (Ableson)  Goal  Action  Causal Inst.  Outcome  Alternative construals of events So what’s a good definition, anyway?

8. Some Definitions “A felt tendency toward anything intuitively appraised as good (beneficial), or away from anything intuitively appraised as bad” (Arnold) “Valenced reactions to events, agents or objects, with their particular nature being determined by the way in which the eliciting situation is construed.” (Clore/Ortnoy) “Reaction to significant stimulus events that impinge on organismic equilibruim or that change the organism-environment relationship.” (Scherer)

9. A Few Computational Approaches Must specify: (Scherer)  Appraisal Criteria (Input vector)  Parameters (theoretical appraisal vectors)  Predicted Affective Response (vocal, action)  Computational Model (Implementation) Situated Cognizers (Petta) Modeling Emotional Agents (Wehrle) Predicting Emotion (Enos)

10. Classifying Emotion Using Appraisal Criteria ISEAR Database (Scherer) Subjects surveyed about remembered emotional episodes (N=7659) JOY, FEAR, ANGER, SADNESS, DISGUST, SHAME, GUILT Survey elicited variables for antecedents and reactions to the episode, as well as name of emotion Maximum likelihood to determine optimal directed graphical model of dependencies.

11. Digraph of Variable Dependencies

12. Classification Accuracy

13. Implications for Speech Understanding of Context Appraisal CriteriaEmotionSpeech Action Context Appraisal CriteriaEmotionSpeech

14. Implications for Speech Understanding of Context Appraisal CriteriaEmotionSpeech Action Context Appraisal CriteriaEmotionSpeech