Cortan a World’s most personal digital assistant helps you get things done throughout the day A whole new natural, way of interacting with your PC Available to millions of users across Windows 10 PCs, tablets, and phones Integrated search across device, the Web and personal and professional clouds A new opportunity for partners

Cortana on all your screens

DESKTOP: TAP TO OPEN CORTANA HOME Loading animation

DESKTOP: CORTANA HOME Celebrate the Day examples

9

Call Text Remind Voice Command X Adventure Works Voice Command Definition (VCD) Microsoft Speech Platform Service (cloud) Application Code

Adventure Works Show my trip to San Francisco Show my trip to San Francisco Show [my] trip to {destination} Looking for trip to {destination}

Quick Start Ask me something Show my trip to San Francisco show [my] trip to {destination} Looking for trip to {destination}

Adventure Works Ask me something Show my trip to San Francisco show [my] trip to {destination} Looking for trip to {destination} Adventure Works

Adventure Works Show my trips Show my trip to San Francisco show [my] trip to {destination} Looking for trip to {destination} Show my trip to San Francisco

Show my trip to San Francisco show [my] trip to {destination} Looking for trip to {destination} Show my trip to San Francisco show [my] trip to {destination} Looking for trip to {destination}

Here are your upcoming trips. May 14 th 2015 Las Vegas May 28 th 2015 San Diego Go to Adventure Works August 24 th 2015 Phoenix Content Area App GUI Text App Icon Link to your app App Screen Text-To-Speech (TTS) Content Tile A Here are your upcoming trips.

Call Text Remind Voice Command VCD App Web Service Microsoft Speech Platform Service (cloud) A Go to Adventure Works Here is your trip to London Application Code Which ‘Vegas’ trip do you wanna cancel? Here’s your trip to London

Cancelled this trip. May 14 th 2015 Vegas Tech Conference Go to Adventure Works Cancelling this trip… Cancel May 14 th 2015 Vegas Tech Conference Go to Adventure Works Cancel this trip? Listeni ng… May 14 th 2015 Vegas Tech Conference YesNo Which one do you want to cancel? May 14 th 2015 Vegas Tech Conference May 14 th 2015 Party in Phoenix Listeni ng… A AA A Which ‘Vegas’ trip do you wanna cancel? Vegas Tech Conference Yes Do you wanna cancel ‘Vegas Tech Conference’? Cancelling this trip… I’ve cancelled it. [success-earcon]

Request a disambiguation screen in Cortana Request a confirmation screen in Cortana RequestDisambiguationAsync(VoiceCommandResponse) RequestConfirmationAsync(VoiceCommandResponse) Request an app launch to complete the task RequestAppLaunchAsync(VoiceCommandResponse) Inform Cortana on status of an in-progress task ReportProgressAsync(VoiceCommandResponse) Inform Cortana the task completed successfully ReportSuccessAsync(VoiceCommandResponse) Inform Cortana the task failed to complete ReportFailureAsync(VoiceCommandResponse) To: Use this API:

VoiceCommandResponse { VoiceCommandUserMessage Message; VoiceCommandUserMessage RepeatMessage; List VoiceCommandContentTiles; string AppLaunchArgument; } Icon, Title, Line1, Line2 Which one do you want to add to your trip? Listening… Title Name One Long text lorem ipsum Title Name Two Long text lorem ipsum Title Name Three Long text lorem ipsum Title Name Four Long text lorem ipsum Title Name Five Long text lorem ipsum Go to Adventure Works A Which one do you want?

VoiceCommandContentTile { string Title; string TextLine1; string TextLine2; string TextLine3; Windows.Storage.StorageFile Icon; VoiceCommandContentTileType ContentTileType; string AppLaunchArgument; string AppContext; } Which one do you want to add to your trip? Title Name Text Line One Text Line Two Text Line Three A

Check in at “CoffeShop on 5 th Ave?” Listening… Cancel this trip? Listening… May 14 th 2015 Vegas Tech Conference YesNo A I’ll get MyPlace on that. Search “Check in on MyPlace” MyPlace Looking for your profile… Cancel You’re checked in th Ave Seattle, WA CoffeeShop Go to MyPlace Looking for your profile… Check in on MyPlace Yes Do you want to check in at CoffeeShop on 5 th Ave? You’re checked in. (success-earcon) Check in YesNo

Change budget to $200? Listening… Cancel this trip? Listening… May 14 th 2015 Vegas Tech Conference YesNo A I’ll get MyBudget on that. Search “Change my groceries budget to $200 on MyBudget” MyBudget Looking for Groceries Budget… Cancel Your budget was updated. Go to MyBudget Looking for groceries budget… Change my groceries budget to$200 on MyBudget Yes Change groceries budget to $200? Your budget was updated. (success- earcon) Change budget YesNo $200 Groceries Budget $200 Groceries Budget

Cortana and Speech Platform In-depth Adina Trufinescu Khuram Shahid Session Title Speakers When Thursday 6:30pm (Room 2004) Build with Bing: Use Bing APIs and Tools to Enrich Your Apps and Make Them More Discoverable Andre Furtado Vincent Wehren Friday 9:00am (Room 2022) Hosted Web Apps and Web Platform Innovations Jeff Burtoft Kiril Seksenov Thursday 11:30am (Session 665) Using Azure Search to Build Great Search Experiences in Mobile and Web Apps Pablo Castro Friday 10:30am (Room 3018) AllJoyn: Building Universal Windows Apps that Discover, Connect, and Interact with Other Devices and Cloud Services Using AllJoyn Gavin Gear Brian Rockwell Wednesday 11:30am (Session 623)

Appendix