1. MULTIMEDIA SYSTEMS IREK DEFEE MULTIMEDIA SYSTEMS and SERVICES SGN-5116 Irek Defée TF316, irek.defee@tut.fi

2. MULTIMEDIA SYSTEMS IREK DEFEE SCOPE OF THE COURSE: this lecture REQUIREMENTS exam+exercises WEB PAGES – course powerpoints available

3. MULTIMEDIA SYSTEMS IREK DEFEE COURSE OVERVIEW CONCEPTS OF MULTIMEDIA AND DIGITAL MEDIA PROBLEMS AND REQUIREMENTS FOR MULTIMEDIA DATA MULTIMEDIA COMPRESSION AND DATA HANDLING SIGNAL MODULATION FOR DATA TRANSMISSION

4. MULTIMEDIA SYSTEMS IREK DEFEE COMMUNICATION NETWORKS AND SYSTEMS, WIRED NETWORKS ARCHITECTURE OF WIRELESS MULTIMEDIA – RADIO LINKS AND TECHNIQUES MULTIMEDIA DATA TRANSPORT NETWORKS AND PROTOCOLS MULTIMEDIA SYSTEMS OTHER ISSUES

5. MULTIMEDIA SYSTEMS IREK DEFEE CONCEPTS WHAT IS MEDIA? - SPECIFIC CARRIER OF INFORMATION MULTI+MEDIA – MULTIPLE CARRIERS OF INFORMATION MEDIA INDUSTRY – BUSSINESS OF PRODUCING AND HANDLING INFORMATION

6. MULTIMEDIA SYSTEMS IREK DEFEE MULTIMEDIA USED IN TWO WAYS - HUMAN INFORMATION AND COMMUNICATION SYSTEM USES MULTIPLE MEDIA - MEDIA INDUSTRY IS MOVING TOWARDS DIGITAL MEDIA

7. MULTIMEDIA SYSTEMS IREK DEFEE HUMAN PERCEPTUAL SYSTEM COMPOSED OF SENSES: VISUAL - INPUT ACOUSTICAL – I/O HAPTIC – I/O (TOUCH, SKIN SENSORS,MOTORIC SYSTEM) TASTE, SMELL BRAIN IS PROCESSING, CONTROLLING AND COORDINATION CENTER FOR SENSES

8. MULTIMEDIA SYSTEMS IREK DEFEE HUMAN SENSES ARE PERFECTLY COORDINATED INTO A FULLY INTEGRATED SYSTEM THIS SYSTEM CAN RECEIVE AND PROCESSES MULTIMODAL INFORMATION FROM THE SENSES AND PRODUCE MULTIMEDIA OUTPUT SEEMINGLY WITH NO EFFORT

9. MULTIMEDIA SYSTEMS IREK DEFEE HOW THIS IS DONE IN THE BRAIN WE DON’T KNOW EXACTLY HUMAN ARE FANTASTIC MULTIMEDIA ”SYSTEMS” - MANY ENCODING LEVELS OF INFORMATION FROM BASIC TO ABSTRACT: SOUNDS, SPEECH-LANGUAGE, MUSIC GESTURES, READING, WRITING

10. MULTIMEDIA SYSTEMS IREK DEFEE HUMAN SENSORY SYSTEM IS OPTIMIZED TO PRODUCE AND RECEIVE MULTIMODAL INFORMATION – BUT OPTIMALITY IS DONE ON MANY LEVELS SINGLE MEDIA MIGHT BE BORING (SPEECH), MULTIMEDIA MIGHT BE EXCITING, BUT IT DEPENDS ON THE CONTENT OF INFORMATION

11. MULTIMEDIA SYSTEMS IREK DEFEE WHAT IS MULTIMEDIA FROM THE POINT OF HUMAN PERCEPTION? -IT IS USING MULTIMODAL INFORMATION TO ACHIEVE OPTIMAL STIMULATION - CINEMA EXAMPLE: VISUAL AND ACOUSTICAL STIMULATION IS USED BUT MUSIC HAS ITS SUBTLE IMPORTANT ROLE

12. MULTIMEDIA SYSTEMS IREK DEFEE BUT HUMAN SYSTEM IS BOTH RECEIVING AND PRODUCING INFORMATION, THIS MEANS BOTH THESE PARTS SHOULD BE USED OPTIMAL STIMULATION IS THEN DESCRIBED AS: ’FULL INVOLVEMENT’, ’ENLIVED EXPERIENCE’ (EXAMPLE: COMPUTER GAMES)

13. MULTIMEDIA SYSTEMS IREK DEFEE MULTIMEDIA TECHNOLOGY AIMS TO PROVIDE (SOME) MATCHING OF INFORMATION DEVICES TO HUMAN PERCEPTION SYSTEM MULTIMEDIA SYSTEM: INTERFACE, PROCESSING, DELIVERY OF INFORMATION NETWORK

14. MULTIMEDIA SYSTEMS IREK DEFEE DIGITAL MEDIA DIGITAL MEDIA IS A CONCEPT OF INTEGRATION OF DIFFERENT MEDIA INDUSTRIES ON DIGITAL PLATFORM MEDIA INDUSTRY IS A BUSSINESS WHOSE PRIMARY PRODUCT IS INFORMATION IN VARIOUS FORMS -MASS MEDIA – INDUSTRIES WHICH DO THIS ON HUGE SCALE

15. MULTIMEDIA SYSTEMS IREK DEFEE TRADITIONALLY MEDIA INDUSTRIES EMERGED BECAUSE SPECIFIC TECHNOLOGIES WERE INVENTED: - BOOKS - NEWS - CINEMA - RADIO - TELEVISION - TELEPHONE PAPER, PRINTING CELLULOID, PHOTOGRAPHY ELECTRONICS

16. MULTIMEDIA SYSTEMS IREK DEFEE MEDIA INDUSTRY IS OFFERING A SERVICE CONTENT DELIVERY DISTRIBUTION CONSUMER

17. MULTIMEDIA SYSTEMS IREK DEFEE THE SERVICE CARRIERS EVOLVED AROUND SPECIFIC TECHNOLOGIES: - PAPER, PRINTING - CELLULOID TAPE,PHOTOGRAPHY - RADIO SIGNALS, ELECTRONIC DISPLAYS

18. MULTIMEDIA SYSTEMS IREK DEFEE THE SERVICE CHAIN IS ORGANIZED AROUND CERTAIN TECHNOLOGY, FOR EXAMPLE PRINTING INDUSTRY INVOLVES PAPER AND PRINT: CONTENT IS WRITTEN BY EDITORS AND WRITERS PRINTING FACTORIES TRANSFER IT ON PAPER PAPER COPIES ARE PHYSICALLY DELIVERED TO CONSUMERS ANOTHER EXAMPLE: TELEVISION INDUSTRY INVOLVES ELECTRONICS: CONTENT IS PRODUCED IN STUDIOS DISTRIBUTION NETWORKS AND TRANSMITTERS DELIVER IT TO CONSUMERS BY RADIO WAVES – TO TV SETS

19. MULTIMEDIA SYSTEMS IREK DEFEE TRADITIONAL MEDIA INDUSTRIES PROVIDE BROADCAST SERVICE INFORMATION IS PRODUCED IN ONE CENTER AND DELIVERED FROM THERE – OFTEN PHYSICALLY EXAMPLE – CD RECORDING INDUSTRY OTHER TYPES OF SERVICES: - RETRIEVAL, ON-DEMAND - COMMUNICATIVE (WWW, INTERNET)

20. MULTIMEDIA SYSTEMS IREK DEFEE TRADITIONAL MEDIA INDUSTRIES WERE STRICTLY SEPARATED -TECHNOLOGIES AND DISTIRBUTION CHANNELS WERE DIFFERENT, FOR EXAMPLE PRINTING AND TELEVISION - DIGITAL TECHNOLOGY IS UNIVERSAL EVERY MEDIA TYPE CAN BE EMBEDDED IN IT AND IT IS NOT TIED TO PHYSICAL MEDIA

21. MULTIMEDIA SYSTEMS IREK DEFEE DIGITAL MEDIA REVOLUTION TV AND RADIO ARE MEDIA WITH NO PHYSICAL CARRIER, ELECTRONIC MEDIA BUT THEY INVOLVE SPECIFIC MEDIA REPRESENTATION (”ANALOG”) DIGITAL REPRESENTATION IS UNIVERSAL, CAN REPRESENT ANYTHING AND DOES NOT DEPEND ON SPECIFIC CARRIER

22. MULTIMEDIA SYSTEMS IREK DEFEE DIGITAL MEDIA INTEGRATES ALL TRADITIONAL MEDIA INDUSTRIES TV -> Digital TV BOOKS -> Digital Books PAPER -> Digital Paper CINEMA -> Digital Cinema + New Media -> Web, Games….

23. MULTIMEDIA SYSTEMS IREK DEFEE ALL MEDIA PRODUCTION WILL BE DIGITAL IN THE FUTURE WILL ALL MEDIA INTERFACES BE DIGITAL? E.G. WILL DIGITAL PAPER COME? THIS WE DON’T KNOW YET...

24. MULTIMEDIA SYSTEMS IREK DEFEE NEW MEDIA = MULTIMEDIA - DIGITAL - MULTIPLE MEDIA TYPES - INTERACTIVE - ON-DEMAND (THAT IS NON-BROADCAST)

25. MULTIMEDIA SYSTEMS IREK DEFEE INFORMATION DELIVERY BREAKING WITH PHYSICAL CARRIERS AND TRANSPORT : - NON-PHYSICAL TRANSPORT - ELECTRONIC - NETWORKED: - WIRED - WIRELESS

26. MULTIMEDIA SYSTEMS IREK DEFEE HOW THIS WILL HAPPEN? BY DEVELOPING MULTIMEDIA SYSTEMS BY ELIMINATING OLD MEDIA BY CREATING NEW MEDIA THE GOAL OF THIS COURSE: TO REVIEW MULTIMEDIA SYSTEMS TECHNOLOGY

27. MULTIMEDIA SYSTEMS IREK DEFEE SOME EXAMPLES WILL FOLLOW....

28. MULTIMEDIA SYSTEMS IREK DEFEE THERE ARE MANY DIGITAL MEDIA DEVICES: -Digital cameras -Camcorders -Music players -Multimedia players -Game consoles

29. MULTIMEDIA SYSTEMS IREK DEFEE TRADITIONAL MOBILE PHONES BECOME MEDIA DEVICES Games Reading Music

30. MULTIMEDIA SYSTEMS IREK DEFEE Digital cameraiPod Portable game player (Playstation) Each of these devices can be connected to the network Or… they can be integrated into a single device… with a mobile phone

31. MULTIMEDIA SYSTEMS IREK DEFEE Universal mobile devices Iphone

32. MULTIMEDIA SYSTEMS IREK DEFEE What is mobile device? camera camcorder TV radio game PDA makeup device? Swiss army knife?

33. MULTIMEDIA SYSTEMS IREK DEFEE NEW TYPES OF DEVICES: Tablet computer Book reader

34. New types of devices Apple iPad MULTIMEDIA SYSTEMS IREK DEFEE It is thin, it has network connection It can replace books and newspapers, Can be used as calendar, for watching videos

35. MULTIMEDIA SYSTEMS IREK DEFEE SIMILAR DEVELOPMENTS ARE ALSO HAPPENING FOR HOME MEDIA, DEVICES WHICH ARE USED IN THE LIVING ROOM HAVE JUST BIGGER SIZE, ESPECIALLY THE DISPLAY HOME MEDIA

36. TV in 2011 is Smart TV +3D MULTIMEDIA SYSTEMS IREK DEFEE New TV sets have Internet built-in connectivity Internet and Web browser Wi-Fi - wireless DLNA - home network support Access to networked content 3D glasses

37. MULTIMEDIA SYSTEMS IREK DEFEE FLAT DISPLAYS They are getting huge…. 80" Diagonal ~2 meters Smart TV

38. MULTIMEDIA SYSTEMS IREK DEFEE GAME CONSOLES ALSO BECOMING MEDIA DEVICES LIKE E.G. MICROSOFT XBOX

39. MULTIMEDIA SYSTEMS IREK DEFEE MICROSOFT KINECT Kinect is a sensor which is attached to XBOX. This sensor measures distance to objects and finds movements Kinect users can interact with content using body movements and gestures

40. MULTIMEDIA SYSTEMS IREK DEFEE WE CAN THINK ABOUT FUTURE MEDIA DEVICES, WHICH STILL MAY COME…. -ELECTRONIC PAPER -ROBOTS -NEW FORMS OF ENTERTAINMENT …. AND PERHAPS MUCH MORE

41. MULTIMEDIA SYSTEMS IREK DEFEE ELECTRONIC PAPER E-INK: check www.eink.com Produced in a roll, like old-fashioned paper, SmartPaper™ is actually two sheets of thin plastic with millions of tiny bichromal beads embedded in between. Each bead is smaller than a grain of sand and has a different color on each half or “side ”. The hemispheres are also charged differently (i.e. positive or negative). SmartPaper™ beads reside in their own cavities within the flexible sheet of material, so that under the influence of a voltage applied to the

42. MULTIMEDIA SYSTEMS IREK DEFEE PERSONAL ROBOTS MAY START APPEARING...

43. MULTIMEDIA SYSTEMS IREK DEFEE Robots can do useful things….

44. THESE ROBOTS MAY LOOK LIK PEOPLE MULTIMEDIA SYSTEMS IREK DEFEE ACTROID – HUMAN-LIKE ROBOT

45. MULTIMEDIA SYSTEMS IREK DEFEE Pet robots too

46. MULTIMEDIA SYSTEMS IREK DEFEE

47. AIBO DOG – PERSONAL ROBOT WITH SENSES

48. IT HAS SENSES: MICROPHONE, CAMERA, TEMPERATURE, DISTANCE, ACCELERATION, BALANCE, TOUCH IT HAS INSTINCTS AND BEHAVIORS

49. Devices integrated in glasses, Images projected on the glasses appear to be hanging in space

50. MULTIMEDIA SYSTEMS IREK DEFEE All these devices can be connected wirelessly and cooperate