5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Unity Windows Holographic Tuning and Intro to Mixed Reality 5/5/2018 1:12 AM B8069 Unity Windows Holographic Tuning and Intro to Mixed Reality Mark Schoennagel Sr. Evangelist, Unity Technologies @Unity3dMarkS © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Who has used one of these? 5/5/2018 1:12 AM Who has used one of these? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

How about one of these? 5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Who here has used Unity? 5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/5/2018 1:12 AM Let’s take a look! © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Special thanks to Zero Mass Energy “Center of Gravity” 5/5/2018 1:12 AM Special thanks to Zero Mass Energy “Center of Gravity” © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Full Support for Windows Mixed Reality! 5/5/2018 1:12 AM Full Support for Windows Mixed Reality! Announced at Unity Vision Summit In-Editor support for all Windows 10 AR and MR devices © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Windows Phone Windows Desktop 5/5/2018 1:12 AM Windows Store © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

91% of all HoloLens titles made with Unity 5/5/2018 1:12 AM 91% of all HoloLens titles made with Unity © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Solving Hard Problems! 5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What does Unity provide to Microsoft MR 5/5/2018 1:12 AM What does Unity provide to Microsoft MR APIs to control all aspects of AR/MR development High and low level components Complete end-to-end build platform Final output to UWP, Universal Windows Platform Direct connect to Visual Studio, Community Edition 2017.now included in all Unity versions The “camera” in Unity is literally your head! © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What APIs are available for AR/MR 5/5/2018 1:12 AM What APIs are available for AR/MR Gaze Gesture Voice Spatial Mapping Spatial Sound Map Persistence World Coordinates Web Camera Support © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Gaze Input void Update() { RaycastHit hitInfo; if (Physics.Raycast( 5/5/2018 1:12 AM Gaze Input void Update() { RaycastHit hitInfo; if (Physics.Raycast( Camera.main.transform.position, Camera.main.transform.forward, out hitInfo, 20.0f, Physics.DefaultRaycastLayers)) // If the Raycast has succeeded and hit a hologram // hitInfo's point represents the position being gazed at // hitInfo's collider GameObject represents the hologram being gazed at } © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Gesture Input void Start () { 5/5/2018 1:12 AM Gesture Input void Start () { //Just need to create it once, so we use the Start recognizer = new GestureRecognizer(); //Specify the gestures we want to capture recognizer.SetRecognizableGestures(GestureSettings.Tap); //Start capturing gestures and subscribe to the event recognizer.TappedEvent += TapEventHandler; recognizer.StartCapturingGestures(); } private void TapEventHandler(TappedEventArgs obj) //Switch the animation state GetComponent<Animator>().SetTrigger("Walk"); © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Voice Input void Start() { keywords.Add(“Run", () => { 5/5/2018 1:12 AM Voice Input void Start() { keywords.Add(“Run", () => { GetComponent<Animator>().SetTrigger("Stop"); }); keywordRecognizer = new KeywordRecognizer(keywords.Keys.ToArray()); // Register a callback for the KeywordRecognizer and start recognizing! keywordRecognizer.OnPhraseRecognized += KeywordRecognizer_OnPhraseRecognized; keywordRecognizer.Start(); } private void KeywordRecognizer_OnPhraseRecognized(PhraseRecognizedEventArgs args) System.Action keywordAction; if (keywords.TryGetValue(args.text, out keywordAction)) keywordAction.Invoke(); } © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/5/2018 1:12 AM Spatial Sound © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Spatial Mapping Real-time mapping of environment 5/5/2018 1:12 AM Spatial Mapping Real-time mapping of environment Full support for physics interactions Continuously enhancing the space Fine tune LOD, Visualize or Occlude © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

The new hardware, Welcome to Mixed Reality 5/5/2018 1:12 AM The new hardware, Welcome to Mixed Reality Easy Setup, no extra software to install © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/5/2018 1:12 AM System Requirements Low system requirements, integrated graphics will work. © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Quick tour of the hardware 5/5/2018 1:12 AM Quick tour of the hardware © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Quick tour of the hardware 5/5/2018 1:12 AM Quick tour of the hardware Inside-out tracking sensor array © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Guardian system Inside-out makes this much easier. MR. 5/5/2018 1:12 AM Guardian system Inside-out makes this much easier. MR. © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Back to the demo! “ADAM” 5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More nerdy stuff… Use Single Pass Instancing in Build Settings 5/5/2018 1:12 AM More nerdy stuff… Use Single Pass Instancing in Build Settings ~35% CPU performance increase User setting for Unity pauses during loss of tracking, Helps reduce nausea Target D3D in Build Settings Gamma color space only! Lots of other custom build settings © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Enable Developer Mode Required for remoting 5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Controllers Plumbing for controller input similar to Rift / Vive 5/5/2018 1:12 AM Controllers Plumbing for controller input similar to Rift / Vive New, common controller toolkit coming © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Active Latent Frame Setting API only, predicts where the head is going Introduces 1 frame of latency Trade off additional latency for improved more stable performance Easier to achieve 60 FPS For AR the difference is not very perceivable so a practical option  © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Focus Point API Changes focus point to reduce jitter. 5/5/2018 1:12 AM Focus Point API Changes focus point to reduce jitter. API is used to set the plane where re-projection is best.  Objects far in either direction will have greater jitter.  App developers can override default 2 Meter plane to work best with their app. © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Now back to Unity! 360 Enhanced Video 5/5/2018 1:12 AM Now back to Unity! 360 Enhanced Video © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/5/2018 1:12 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.