1. T-111.5350 Multimedia Programming Programming Lifecycle Heikkinen, Pitkänen, Setälä, Stenroos

2. Programming lifecycle Multimedia authoring process Stages of the process Authoring tools Authoring paradigms

3. Stages of the process Concept Planning Script User interface Implementation Evaluation

4. Stage: Concept Starts with an idea What? To whom? Why? Own idea vs. given idea Motivation – Artistic – Commercial

5. Stage: Planning Synopsis Structural plan Technical requirements and limitations Resource allocation and scheduling Funding and costs Distribution Contracts and rights to the product

6. Stage: Script Elements of the story Storyline The form and structure of the story – Linear/tree/web Degree of interaction Definition of events or scenes

7. Stage: User interface Interaction design Usability – Usage environment – Consistency within the story – Logic of use Part of the content – UI supports the atmosphere

8. Stage: Implementation Stepwise production plan Producing the framework – Programming – Authoring tools Producing media content Integrating content to the framework Testing

9. Producing media content Using existing material – Finding what is needed – Copyrights – Editing the material for this production Creating own material – Own production – Subcontractor

10. Stage: Evaluation Feedback - how the audience reacts? Customer support Bugfixes and patches Potential for a sequel? Commercial exploitation

11. Authoring tools (1/2) Graphics – Photoshop, Illustrator, Freehand, GIMP Video – Final Cut Pro, Edius, Vegas Video, Premiere Pro Audio – Cubase, Protools, Audition

12. Authoring tools (2/2) Compositing – After Effects,.werkkzeug1 Presentation authoring – Director, Flash, Encore Programming – Flash, GoLive, LimSee2

13. Authoring Paradigms Structure-Based Paradigm Time-Based Paradigm Graph-Based Paradigm Script-Based Paradigm

14. Structure-Based Paradigm (1/3) A structured hierarchy (tree) of elements Combining elements as intermediate nodes Content items as leaf nodes Example combining nodes: parallel, sequence, choice Mostly used in experimental software

15. Structure-Based Paradigm (2/3)

16. Structure-Based Paradigm (3/3) Can be viewed at different levels Allows interactive products and different timing models Different layout models can be supported Spearate structure must be created even for straightforward products Not straightforward to learn

17. Time-Based Paradigm (1/3) Based on a single timeline Multiple tracks Generally one element per track Possibly special tracks for effects Most commonly used in video and animation software

18. Time-Based Paradigm (2/3)

19. Time-Based Paradigm (3/3) Easy to learn for simple linear work Allows precise timing Links can be created with scripting, but not shown on the timeline No intuitive way to present user interaction and non-linear events

20. Graph-Based Paradigm (1/3) Based on a flowchart or directed graph Contains objects and transitions Can contain flow control objects such as selection points Used in some presentation authoring software

21. Graph-Based Paradigm (2/3)

22. Graph-Based Paradigm (3/3) Powerful for editing non-temporal events and user interaction such as multiple choices No way to show a temporal (timeline) view during editing Hard to incorporate screen layout intuitively

23. Script-Based Paradigm (1/3) Direct editing via a scripting language Can also be a general purpose programming language Several languages can be edited directly in this way

24. Script-Based Paradigm (2/3)

25. Script-Based Paradigm (3/3) Provides complete control Hard to learn Easy to make mistakes No intuitive editing view

26. Conclusion Multimedia production is a process ”No silver bullet” Different authoring paradigms for different productions

27. References Bulterman, D. C. and Hardman, L. 2005. Structured multimedia authoring. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1 (Feb. 2005), 89-109. Hardman, L. 1998. Modelling and authoring hypermedia documents. Ph.D. dissertation. Univ. Amsterdam. ISBN: 90- 74795-93-5. (Available at http://www.cwi.nl/~lynda/thesis/.)http://www.cwi.nl/~lynda/thesis/ Keränen, V. et al. Digitaalinen media. Docendo, 2005. ISBN: 951-846-198-8. Vazirgiannis, M. Interactive multimedia documents : modeling, authoring, and implementation experiences Lecture notes in computer science 1564. Springer-Verlag GmbH Berlin, 1999. ISBN: 3-540-66711-3