2. AGENDA  MTECH Digital – Who We Are.  Kinect – Intro device specs & features  Apply Kinect in Activation & Events  Kinect basic – Capture motion  Kinect advance – Infrared technics  Combine Kinect & VR  Other devices: MyO, Leap Motion (Specs, features)  VR - Intro  AR - Intro

4. OVERVIEW We’re founded and established in 2011, when the digital age became explored in Vietnam. Our vision is aim to the Top Production House with fulfill services. Our core value propositions are: Project performance is the 1 st priority. Always consult the right technics to bring the best solutions. Propose and apply the new/ trends technologies to every single project. With a staff of young, enthusiastic, innovative capacity is abundant and rich experience, MTECH Digital are looking forward to collaborate and support you in the near future!

7. GENERAL DIRECTOR HR & FINANCE (3) ACCOUNT TEAM (5) WEB DEVELOPMENT TEAM (9) FO TEAM (HTML & CREATIVE) BO TEAM INTERACTIVE TEAM (8) MOBILE TEAM (ANDROID & IOS) INTERACTIVE TEAM IT SUPPORT PROJECT MANAGEMENT TEAM (4) PMQC TEAM ORGANIZATION

14. KINECT  BODY TRACKING:  The enhanced fidelity of the depth camera, combined with improvements in the software, have led to a number of body tracking developments.  The latest sensor tracks as many as 6 complete skeletons (compared to two with the original sensor), and 25 joints per person (compared to 20 with the original sensor).

15. KINECT – INTERACTION SPACE  The interaction space is the area in front of the Kinect sensor where the infrared and color sensors have an unblocked view of everything in front of the sensor. If the lighting is not too bright and not too dim, and the objects being tracked are not too reflective, you should get good results tracking human skeletons. While a sensor is often placed in front of and at the level of a user's head, it can be placed in a wide variety of positions.

16. KINECT – SETUP GUIDELINE  The sensor should be positioned 2 – 6 feet (0.6 – 1.8 m) off the floor, with nothing between you and the sensor.  Make sure the sensor is not too far back on the shelf and that there's nothing in front of the sensor (for example, make sure the sensor is not positioned behind glass).  Make sure nothing is preventing the sensor from automatically tilting up or down.  The light on the sensor should be green, which means the sensor is ready to go.

17. KINECT – SETUP GUIDELINE A clear play space  Clear the area between the sensor and the players.  One player: Stand back 6 feet (1.8 m).  Two players: Stand back 8 feet (2.4 m).

18. KINECT – SETUP GUIDELINE Good lighting  Make sure your room has enough light so that your face is clearly visible and evenly lit. Try to minimize side or back lighting, especially from a window.  For best tracking results avoid positioning the sensor or player in direct sunlight.  Some lighting conditions can make it hard for Kinect to identify you or track your movements.  Make sure the room has bright, even lighting.  Make sure the room temperature reach 21 o C  40 o C

19. KINECT – SETUP GUIDELINE Player considerations  Players need to be at least 40 inches tall (1.2 m).  Face the sensor and make sure that nothing is covering your face, such as a hat, your hair, or reflective glasses.  Try to avoid wearing baggy clothing.  Some black clothing dyes may absorb infrared light, making it difficult for Kinect to track you accurately.

20. Apply Kinect in Activation & Events  Motion capture:

21. Apply Kinect in Activation & Events  Motion capture:

22. Case Study  Player shaped to match the available images on screen.  Link: http://remote.mtech.com.vn/bounce/ ShapeKinect.mp4 http://remote.mtech.com.vn/bounce/ ShapeKinect.mp4

23. Apply Kinect in Activation & Events  Live Tracking With the depth cam and heat sensors, your body movements will automatically be recognized and tracked by the system without the need of additional 3D markers or sensor suits.

24. Case Study  Many C2 bottle appear on screen. Players trying to take as much as they can to win the game and get a gift from C2 brand’s.  Link: https://www.youtube.com/watch?v=Fyj zDEohKe8 https://www.youtube.com/watch?v=Fyj zDEohKe8

25. Apply Kinect in Activation & Events  Virtual Accessory Manipulation  Now during body movement, your actions will trigger flowing hair and skirt segments on your character to create authentic- looking results.  You can also make virtual characters hold and manipulate accessories like swinging a sword or a bag during performances.

26. Case Study  Gameplay: detect user’s abdomen & show % hungry, then appear bread icon & take a photo with 3D models.  Link: https://www.youtube.com/watch?v=Z7l dIezZALU https://www.youtube.com/watch?v=Z7l dIezZALU

27. Apply Kinect in Activation & Events  Live Physics Interaction Besides working with virtual characters, you may also set up virtual scenes for characters to preform in. Amazingly, you may even manipulate these characters to touch and interact with smart props that react automatically. If your props are set with physical attributes, then you may create collision effects with sound and visuals that respond when touched or pushed in real-time.

28. Case Study  Player kick the ball into the goal to score. When the real ball hit the wall, immediately appear virtual ball & go ahead into goal.  Link: https://www.youtube.com/watch?v=8T DvqWJVz7c https://www.youtube.com/watch?v=8T DvqWJVz7c

29. Apply Kinect in Activation & Events  Real-time Character Control System allows you to control different shapes and character styles live, so that you can enjoy performing like a monster, cartoon, comic or robot character. You may optionally capture partial body parts and mix them in with other motion data for unique actor performances.

30. Case Study  Player dance with 3D model (a penguin). 3D model will copy all action of player  Link: https://www.youtube.com/watch?v=ed 7fcPE4oW8 https://www.youtube.com/watch?v=ed 7fcPE4oW8

31. Leap Motion – Over view  Leap motion is Gesture-control technology which could make interacting with a computer easier and improve applications like gaming and drawing.  The Leap Motion controller is a small device that is plugged into a computer using a USB cable. The box which holds the controller comes with a long and a short cable.

32. Leap Motion – Explain technology  The controller is about 3 inches long, 1-inch wide, and 1/2-inch thick and has a nonskid rubber bottom. It has three cameras and infrared sensors that detect the motion of ten fingers up to 1/100th of a millimeter and has a 150° range of view.  With detection that precise, it is able to create accurate paintings and drawings on a computer screen. The 150° range of view allows users to move their hands in 3D.  By 3D it means that they are able to use Leap Motion apps to grab and move objects as if in real life. There is an eight cubic feet of space above the controller that is used to control the computer. The controller also moves when you move because it tracks movement at a rate of over 200 frames per second

33. Leap Motion – Example application  https://www.youtube.com/watch?v=XPLEhq7C8rg https://www.youtube.com/watch?v=XPLEhq7C8rg  https://www.youtube.com/watch?v=_VZCOqbKoCg https://www.youtube.com/watch?v=_VZCOqbKoCg

34. Virtual Reality - Overview  Artificial environment is created with software  Immersed and able to interact with 3D worlds  This 3D worlds appear life-sized to the person  The aim is for a natural, free-flowing form of interaction which will result in a memorable experience.  A real environment for training & education or entertainment

35. VR – Explain technology  VR is currently created by head-mounted displays (HMDs) such as the Oculus Rift. HMDs utilize stereoscopic displays and specialized lenses along with motion tracking hardware to give the illusion that the user is physically inside the virtual world.  To create the illusion of depth, a display is placed very close to the users' eyes, covering their entire field of view.  Specialized lenses are placed between the display and our eyes. There lenses allow our eyes to focus on the images on the display, even though the display is only a few inches in front of our faces.

36. VR – Combine with others devices  Other modern examples of narrow VR for gaming include the Wii Remote, the Kinect, and the PlayStation Move/PlayStation Eye, all of which track and send motion input of the players to the game console somewhat accurately. OR

37. VR – Combine with others devices (Kinect)  With VR & Kinect, you can wear VR to experience 3D environment.  You’ll get an experience that allows you to see not only what another player is doing in the VR space, but also to see a virtual representation of yourself.

38. VR – Leap motion  Leap Motion VR is able to track all 10 of your fingers independently with hundredth of a millimeter precision and very low latency.  When attached to a VR, the Leap Motion is able to sense the physical environment in your view.  Its new sensor in development named Dragonfly will capture HD colored imageries in a large field of view. The device has the potential to merge the physical world into the realms of virtual reality.

39. VR – Wii remote/joystick/controller  User wear VR glasses, the virtual will display bike & street view  Player race on the real motorbike, all the actions will happen in the virtual world view Setup sensor in brakes and steering Signal transmission to PC Signal transmission to phone User wear the VR glasses

40. AUGMENTED REALITY – OVER VIEW  Augmented Reality (AR) is a technology enriching the real world with digital information and media, such as 3D models and videos, overlaying in real- time the camera view of your smartphone, tablet, PC or connected VR glasses.

41. WHAT KINDS OF AUGMENTED REALITY? Augmented Reality gathers a wide variety of user experiences. We distinguish 3 main categories of Augmented Reality tools: Augmented Reality 3D viewers, like Augment, allow to place life-size 3D models in your environment with or without the use of trackers. Augmented Reality browsers enrich your camera feed with contextual information. For example, you can point your smartphone at a building to display its history or estimated value. Augmented Reality games create immersive gaming experiences, like shooting games with zombies walking in your own bedroom!

42. WHAT KINDS OF AUGMENTED REALITY?  SMALL SIZE  On smartphones and tablets, Augmented Reality feels like a magic window. Hundreds of Augmented Reality apps are available on iPhone, iPad and Android.  ADVANCE SIZE – LIVE AUGMENTED REALITY  On PC and connected TV, huge screens, Augmented Reality works with camera, which can be quite cumbersome when you have to manipulate a tracker in front of your screen. Bring the virtual into the real life.

43. AR – Archaeology  AR can be used to aid archaeological research, by augmenting archaeological features onto the modern landscape, enabling archaeologists to formulate conclusions about site placement and configuration.  Another application given to AR in this field is the possibility for users to rebuild ruins, buildings, landscapes or even ancient characters as they formerly existed

44. AR – Architecture  AR can aid in visualizing building projects. Computer-generated images of a structure can be superimposed into a real life local view of a property before the physical building is constructed there  AR can also be employed within an architect's work space, rendering into their view animated 3D visualizations of their 2D drawings. Architecture sight-seeing can be enhanced with AR applications allowing users viewing a building's exterior to virtually see through its walls, viewing its interior objects and layout  Link: https://youtu.be/wRdeY0--aF4?t=7https://youtu.be/wRdeY0--aF4?t=7

45. AR – Greeting card  One of the interesting and innovative uses of Augmented Reality is related to greeting cards. They can be implemented with digital content which users are able to discover by viewing the illustrations with certain mobile applications or devices using augmented reality technology. The digital content could be 2D & 3D animations, standard video and 3D objects with which the users can interact

46. AR – Greeting card-MTECH https://youtu.be/tCE7akS0S8I?t=65

47. AR – Commerce  AR can enhance product previews such as allowing a customer to view what's inside a product's packaging without opening it.  AR can also be used as an aid in selecting products from a catalog or through a kiosk.  AR is used to integrate print and video marketing. Printed marketing material can be designed with certain "trigger" images that, when scanned by an AR enabled device using image recognition, activate a video version of the promotional material.  A major difference between Augmented Reality and straight forward image recognition is that you can overlay multiple media at the same time in the view screen, such as social media share buttons, in-page video even audio and 3D objects.  Link: https://youtu.be/NxQZuo6pFUw?t=44https://youtu.be/NxQZuo6pFUw?t=44

48. AR – Construction  With the continual improvements to GPS accuracy, businesses are able to use augmented reality to visualize georeferenced models of construction sites, underground structures, cables and pipes using mobile devices. Augmented reality is applied to present new projects, to solve on-site construction challenges, and to enhance promotional materials  Link: https://youtu.be/d1GC9Gqxi6I?t=51 https://youtu.be/d1GC9Gqxi6I?t=51

49. AR – Education  Augmented reality applications can complement a standard curriculum. Text, graphics, video and audio can be superimposed into a student’s real time environment.  Textbooks, flashcards and other educational reading material can contain embedded “markers” that, when scanned by an AR device, produce supplementary information to the student rendered in a multimedia format.  Students can participate interactively with computer generated simulations of historical events, exploring and learning details of each significant area of the event site. On higher education, there are some applications that can be used.  Link: https://youtu.be/8Zb2spZvHFQ?t=25https://youtu.be/8Zb2spZvHFQ?t=25

50. AR – Gaming  Augmented reality allows gamers to experience digital game play in a real world environment.  Link: https://www.youtube.com/watch ?v=J45TD6FoQOM https://www.youtube.com/watch ?v=J45TD6FoQOM

51. AR – Gaming https://youtu.be/yQCePZ4FE-E?t=25

52. AR – Beauty  In 2014 the company L'Oreal Paris started developing a smartphone and tablet application called "Makeup Genius", which lets users try out make-up and beauty styles utilizing the front-facing camera of the endpoint and its display.  Link: https://www.youtube.com/watch?v =5qpuym4-JDE https://www.youtube.com/watch?v =5qpuym4-JDE

53. AR – Sports & Entertainment  AR has become common in sports telecasting. Sports and entertainment venues are provided with see-through and overlay augmentation through tracked camera feeds for enhanced viewing by the audience.  AR is also used in association with football and other sporting events to show commercial advertisements overlaid onto the view of the playing area.  Link: https://www.youtube.com/watch?v=D0o jxzS1fCw https://www.youtube.com/watch?v=D0o jxzS1fCw

54. THE MYO ARMBAND – OVER VIEW  The Myo armband is the first input device in the world to use the electrical activity of muscles to control technology.

55. FEATURES To read the muscle activity in your forearm, Myo wraps it in eight different blocks, each of which contains a medical-grade EMG sensor. The armband also uses a three-axis gyroscope, three-axis accelerometer, and three-axis magnetometer to sense motion in any direction. Hand gestures detected by proprietary EMG muscle sensors Highly sensitive motion sensor

56. SETUP Muscle activity and motion readings are handled by an onboard ARM Cortex M4 Processor, which communicates with your devices via Bluetooth. For devices that don’t have Bluetooth functionality built in, Myo also comes with a Bluetooth dongle that plugs into any USB port. Bluetooth Smart

57. Case Study  Player wear Myo armbands & move their hands to play game  Link: http://remote.mtech.com.vn/Golden/Sa nofi/SanofiMyo.MOV http://remote.mtech.com.vn/Golden/Sa nofi/SanofiMyo.MOV