1. SceneMaker: Automatic Visualisation of Screenplays School of Computing & Intelligent Systems Faculty of Computing & Engineering University of Ulster, Magee, Northern Ireland hanser-e@email.ulster.ac.uk, {p.mckevitt, tf.lunney, j.condell}@ulster.ac.uk Eva Hanser Prof. Paul Mc Kevitt Dr. Tom Lunney Dr. Joan Condell

2. SCENEMAKER OVERVIEW Automatically generate animated scenes from screenplays

3. AIMS Realistic visualisation of emotional aspects Well-designed representation through 3D animation, speech, audio and cinematography Enhance believability of virtual actors and scene presentation : AIMS & OBJECTIVES Input: Screen- play SceneMaker System Output: Animation

4. OBJECTIVES Inferencing emotions and semantic information within story context Common sense, affective and cinematic knowledge reflecting human cognitive reasoning Automatic genre recognition from text Design, implementation and evaluation of SceneMaker : AIMS & OBJECTIVES

5. Standardized format and language of screenplays Automatic access to information on location, timing, props, actors, events, manners, dialogue and camera direction (Jhala 2008) SEMANTIC TEXT PROCESSING : RELATED PROJECTS INT. M.I.T. HALLWAY -- NIGHT Lambeau and Tom come around a corner. His P.O.V. reveals a figure in silhouette blazing through the proof on the chalkboard. There is a mop and a bucket beside him. As Lambeau draws closer, reveal that the figure is Will, in his janitor's uniform. There is a look of intense concentration in his eyes. LAMBEAU Excuse me! WILL Oh, I'm sorry. LAMBEAU What're you doing? WILL (walking away) I'm sorry. Screenplay Extract from ‘Good Will Hunting (1997)’

6. Reflecting emotions in automatic physical transformation of 3D models Manner influences intensity, scale, force, fluency and timing of an action MODELLING EMOTIONAL BEHAVIOUR Personality & Emotion Engine (Su et al. 2007) Greta (Pelachaud 2005) : RELATED PROJECTS

7. WordsEye – Scene composition (Coyne & Sproat 2001) ScriptViz – Screenplay visualisation (Liu & Leung 2006) CONFUCIUS – Action & speech animation (Ma 2006) CAMEO – Cinematic and genre visualisation (Shim & Kang 2008) VISUALISING 3D SCENES WordsEye CONFUCIUSScriptVizCAMEO : RELATED PROJECTS

8. Animatio n Player Script Editor Screen- play Text & Language Processing Text & Language Processing Context Interpretation Context Interpretation Multimedia Generation Multimedia Generation } Genre Emotio n Action } ARCHITECTURE OF SCENEMAKER : DESIGN AND IMPLEMENTATION

9. GENRE IDENTIFICATION : DESIGN AND IMPLEMENTATION Gate Tokenizer Film Script.txt Part-Of-Speech Gazetteer Sentence Splitter WordNet WordNet- Affect Tagged Film Script.xml Script Element Ontology Training corpora Location key-phrases Training corpora Light key-phrases Controlled Indexing Free Indexing KEA Key-phrase Extractor Genre Location Ontology Genre Relevant Locations Genre Light Ontology Genre Relevant Lighting Theme Concept Net Emotion Module Most Dominant Emotions Genre DirectorNotation (Film Ontology) Dialogue Length Motion Content Film Pace

10. EVALUATION OF SCENEMAKER AspectEvaluation Correctness of screenplay interpretation Hand-animating scenes Effectiveness of output scenes Existing feature film scenes Suitability for genre typeUnknown scripts categorised by readers Functionality of interfaceTesting with drama students and directors : DESIGN AND IMPLEMENTATION

11. SUMMARY SceneMaker Heightens expressiveness, naturalness and artistic quality of computer generated animations Assists crew on set – directors, actors, camera men,... – drama students, script writers and advertising agencies Mobile user interface for immediate use on set or anywhere Animations manually editable

12. Thank you. QUESTIONS OR COMMENTS ?