Presentation is loading. Please wait.

Presentation is loading. Please wait.

MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find.

Published byMorris O’Connor’ Modified over 8 years ago

Similar presentations

Presentation on theme: "MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find."— Presentation transcript:

1

2

3

4

5

6

7

8

9

10

11 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN

12 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN MSDN

13 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN How do I add Voice Commands to my application

14 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN

15 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN Find Install Voice Command Sets

16 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms}

17 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN Search on MSDN

18 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN

19 http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN MSDN MSDN

20 http://schemas.microsoft.com/voicecommands/1.0 MSDN Find Voice Commands Find Windows Phone Search Search {*} Search for {listSearchTerms} Find Find {*} Find {listSearchTerms} Search on MSDN Voice Commands Windows Phone http://schemas.microsoft.com/voicecommands/1.0 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN MSDN Windows Phone 8.0Windows Phone 8.1 Simple Scenarios, Limited AccuracyMore Powerful, Easier, More Accurate

21 MSDN Find Voice Commands Find Windows Phone Search Search {*} Search for {listSearchTerms} Find Find {*} Find {listSearchTerms} Search on MSDN Voice Commands Windows Phone http://schemas.microsoft.com/voicecommands/1.1 MSDN How do I add Voice Commands to my application How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN Windows Phone 8.0Windows Phone 8.1 Simple Scenarios, Limited Accuracy… and enables Natural Language

22 http://schemas.microsoft.com/voicecommands/1.0 MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find {dictatedSearchTerms} Search on MSDN How do I add Voice Commands to my application {dictatedVoiceCommandText} Starting MSDN... MSDN MSDN

23 Windows Phone Silverlight Apps on Windows Phone 8.1 Windows Runtime Apps on Windows Phone 8.1

24 ❶ ❷

25 // Windows Phone Silverlight App, in MainPage.xaml.cs protected override void OnNavigatedTo(System.Windows.Navigation.NavigationEventArgs e) { base.OnNavigatedTo(e); if (e.NavigationMode == System.Windows.Navigation.NavigationMode.New) { string recoText = null; // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("reco", out recoText); string voiceCommandName = null; // Which command was recognized in the VCD.XML file? e.g. "FindText" NavigationContext.QueryString.TryGetValue("voiceCommandName", out voiceCommandName); string searchTerms = null; // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("dictatedSearchTerms", out searchTerms); switch (voiceCommandName) // What command launched the app? { case "FindText": HandleFindText(searchTerms); break; case "nlpCommand": HandleNlpCommand(recoText); break; }

26 // Windows Phone Silverlight App, in MainPage.xaml.cs protected override void OnNavigatedTo(System.Windows.Navigation.NavigationEventArgs e) { base.OnNavigatedTo(e); if (e.NavigationMode == System.Windows.Navigation.NavigationMode.New) { string recoText = null; // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("reco", out recoText); string voiceCommandName = null; // Which command was recognized in the VCD.XML file? e.g. "FindText" NavigationContext.QueryString.TryGetValue("voiceCommandName", out voiceCommandName); string searchTerms = null; // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("dictatedSearchTerms", out searchTerms); switch (voiceCommandName) // What command launched the app? { case "FindText": HandleFindText(searchTerms); break; case "nlpCommand": HandleNlpCommand(recoText); break; } // Windows Phone Silverlight App, in MainPage.xaml.cs protected override void OnNavigatedTo(System.Windows.Navigation.NavigationEventArgs e)

27 // Windows Phone Silverlight App, in MainPage.xaml.cs protected override void OnNavigatedTo(System.Windows.Navigation.NavigationEventArgs e) { base.OnNavigatedTo(e); if (e.NavigationMode == System.Windows.Navigation.NavigationMode.New) { string recoText = null; // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("reco", out recoText); string voiceCommandName = null; // Which command was recognized in the VCD.XML file? e.g. "FindText" NavigationContext.QueryString.TryGetValue("voiceCommandName", out voiceCommandName); string searchTerms = null; // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("dictatedSearchTerms", out searchTerms); switch (voiceCommandName) // What command launched the app? { case "FindText": HandleFindText(searchTerms); break; case "nlpCommand": HandleNlpCommand(recoText); break; } // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" string recoText = null; NavigationContext.QueryString.TryGetValue("reco", out recoText); // Which command was recognized in the VCD.XML file? e.g. "FindText" string voiceCommandName = null; NavigationContext.QueryString.TryGetValue("voiceCommandName", out voiceCommandName); // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" string searchTerms = null; NavigationContext.QueryString.TryGetValue("dictatedSearchTerms", out searchTerms);

28 // Windows Phone Silverlight App, in MainPage.xaml.cs protected override void OnNavigatedTo(System.Windows.Navigation.NavigationEventArgs e) { base.OnNavigatedTo(e); if (e.NavigationMode == System.Windows.Navigation.NavigationMode.New) { string recoText = null; // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("reco", out recoText); string voiceCommandName = null; // Which command was recognized in the VCD.XML file? e.g. "FindText" NavigationContext.QueryString.TryGetValue("voiceCommandName", out voiceCommandName); string searchTerms = null; // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" NavigationContext.QueryString.TryGetValue("dictatedSearchTerms", out searchTerms); switch (voiceCommandName) // What command launched the app? { case "FindText": HandleFindText(searchTerms); break; case "nlpCommand": HandleNlpCommand(recoText); break; } switch (voiceCommandName) // What command launched the app? { case "FindText": HandleFindText(searchTerms); break; case "nlpCommand": HandleNlpCommand(recoText); break; }

29 ❶ ❷ ❸

30

31 // Windows Runtime App on Windows Phone 8.1, inside OnActivated override // in App class if (args.Kind == ActivationKind.VoiceCommand)

32 VoiceCommandActivatedEventArgs vcArgs = (VoiceCommandActivatedEventArgs)args; // What command launched the app? string voiceCommandName = vcArgs.Result.RulePath.First(); // Navigate to right page for the voice command switch (voiceCommandName)

33 // Navigate to right page for the voice command switch (voiceCommandName) { case "FindText": // User said "find" or "search" rootFrame.Navigate(typeof(MSDN.FindText), vcArgs.Result); break; case "nlpCommand": // User said something else rootFrame.Navigate(typeof(MSDN.NlpCommand), vcArgs.Result); break; }

34 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo in FindText.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; if (vcResult!=null) { // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" string recoText = vcResult.Text; // Store the semantics dictionary for later use IReadOnlyDictionary > semantics = vcResult.SemanticInterpretation.Properties; string voiceCommandName = vcResult.RulePath.First(); if (voiceCommandName == "FindText") { // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" if (semantics.ContainsKey("dictatedSearchTerms")) { HandleFindTextWithSearchTerms(semantics["dictatedSearchTerms"][0]); } else { HandleNoSearchTerms(); } // Else handle other voice commands } navigationHelper.OnNavigatedTo(e) }

35 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo In FindText.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; if (vcResult!=null) { // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" string recoText = vcResult.Text; // Store the semantics dictionary for later use IReadOnlyDictionary > semantics = vcResult.SemanticInterpretation.Properties; string voiceCommandName = vcResult.RulePath.First(); if (voiceCommandName == "FindText") { // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" if (semantics.ContainsKey("dictatedSearchTerms")) { HandleFindTextWithSearchTerms(semantics["dictatedSearchTerms"][0]); } else { HandleNoSearchTerms(); } // Else handle other voice commands } navigationHelper.OnNavigatedTo(e) } // Windows Runtime App on Windows Phone 8.1, inside // OnNavigatedTo in FindText.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; if (vcResult!=null) { // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" string recoText = vcResult.Text; // Store the semantics dictionary for later use IReadOnlyDictionary > semantics = vcResult.SemanticInterpretation.Properties; string voiceCommandName = vcResult.RulePath.First();

36 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo In FindText.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; if (vcResult!=null) { // What did the user say? e.g. MSDN, "Find Windows Phone Voice Commands" string recoText = vcResult.Text; // Store the semantics dictionary for later use IReadOnlyDictionary > semantics = vcResult.SemanticInterpretation.Properties; string voiceCommandName = vcResult.RulePath.First(); if (voiceCommandName == "FindText") { // What did the user say, for named phrase topic or list "slots"? e.g. "Windows Phone Voice Commands" if (semantics.ContainsKey("dictatedSearchTerms")) { HandleFindTextWithSearchTerms(semantics["dictatedSearchTerms"][0]); } else { HandleNoSearchTerms(); } // Else handle other voice commands } navigationHelper.OnNavigatedTo(e) } if (voiceCommandName == "FindText") { // What did the user say, for named phrase topic or list "slots"? // e.g. "Windows Phone Voice Commands" if (semantics.ContainsKey("dictatedSearchTerms")) { HandleFindTextWithSearchTerms(semantics["dictatedSearchTerms"][0]); } else { HandleNoSearchTerms(); }

37 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo in NlpCommand.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { base.OnNavigatedTo(e); // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; // Check for null! string commandMode = vcResult.SemanticInterpretation.Properties["commandMode"][0]; if (commandMode == "voice") // Did the user speak or type the command? { SpeakText(audioPlayer, String.Format("MSDN app heard you say {0}", vcResult.Text)); HandleNlpCommand(vcResult); } else if(commandMode=="text") { messageTextBox.Text = string.Format("Working on your request \"{0}\"", vcResult.Text); HandleNlpCommand(vcResult); }

38 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo In NlpCommand.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { base.OnNavigatedTo(e); // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; // Check for null! string commandMode = vcResult.SemanticInterpretation.Properties["commandMode"][0]; if (commandMode == "voice") // Did the user speak or type the command? { SpeakText(audioPlayer, String.Format("MSDN app heard you say {0}", vcResult.Text)); HandleNlpCommand(vcResult); } else if(commandMode=="text") { messageTextBox.Text = string.Format("Working on your request \"{0}\"", vcResult.Text); HandleNlpCommand(vcResult); } // Windows Runtime App on Windows Phone 8.1, in OnNavigatedTo in NlpCommand.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; string commandMode = vcResult.SemanticInterpretation.Properties["commandMode"][0];

39 // Windows Runtime App on Windows Phone 8.1, inside OnNavigatedTo In NlpCommand.xaml.cs protected override void OnNavigatedTo(NavigationEventArgs e) { base.OnNavigatedTo(e); // Get recognition result from parameter passed in frame.Navigate call SpeechRecognitionResult vcResult = e.Parameter as SpeechRecognitionResult; // Check for null! string commandMode = vcResult.SemanticInterpretation.Properties["commandMode"][0]; if (commandMode == "voice") // Did the user speak or type the command? { SpeakText(audioPlayer, String.Format("MSDN app heard you say {0}", vcResult.Text)); HandleNlpCommand(vcResult); } else if(commandMode=="text") { messageTextBox.Text = string.Format("Working on your request \"{0}\"", vcResult.Text); HandleNlpCommand(vcResult); } string commandMode = vcResult.SemanticInterpretation.Properties["commandMode"][0]; if (commandMode == "voice") // Did the user speak or type the command? { SpeakText(audioPlayer, String.Format("MSDN voice heard you say {0}", vcResult.Text)); HandleNlpCommand(vcResult); } else if(commandMode=="text") { msgTextBox.Text= string.Format("Working on your request \"{0}\"", vcResult.Text); HandleNlpCommand(vcResult); }

40

41 private void HandleNlpCommand(string recoText, bool actSilently) { string action = null; string navigateTo = null; string searchFor = null; recoText = recoText.ToLower(); if (recoText.Contains("go to ") || recoText.Contains("goto ") || recoText.Contains("find ") || recoText.Contains("search ") || recoText.Contains("show me ")) { action = "navigate"; if (recoText.Contains("windows phone dev center")) { navigateTo = "http://dev.windowsphone.com"; } else if (recoText.Contains("learn how to ")) { action = "find"; searchFor = recoText.Substring(recoText.IndexOf("learn how to ") + 13); } else { action = "find"; searchFor = recoText; } switch (action) { case "find": //...

42 private void HandleNlpCommand(string recoText, bool actSilently) { string action = null; string navigateTo = null; string searchFor = null; recoText = recoText.ToLower(); if (recoText.Contains("go to ") || recoText.Contains("goto ") || recoText.Contains("find ") || recoText.Contains("search ") || recoText.Contains("show me ")) { action = "navigate"; if (recoText.Contains("windows phone dev center")) { navigateTo = "http://dev.windowsphone.com"; } else if (recoText.Contains("learn how to ")) { action = "find"; searchFor = recoText.Substring(recoText.IndexOf("learn how to ") + 13); } else { action = "find"; searchFor = recoText; } switch (action) { case "find": //... if (recoText.Contains("go to ") || recoText.Contains("goto ") || recoText.Contains("find ") || recoText.Contains("search ") || recoText.Contains("show me ")) { action = "navigate"; if (recoText.Contains("windows phone dev center")) { navigateTo = "http://dev.windowsphone.com"; }

43 private void HandleNlpCommand(string recoText, bool actSilently) { string action = null; string navigateTo = null; string searchFor = null; recoText = recoText.ToLower(); if (recoText.Contains("go to ") || recoText.Contains("goto ") || recoText.Contains("find ") || recoText.Contains("search ") || recoText.Contains("show me ")) { action = "navigate"; if (recoText.Contains("windows phone dev center")) { navigateTo = "http://dev.windowsphone.com"; } else if (recoText.Contains("learn how to ")) { action = "find"; searchFor = recoText.Substring(recoText.IndexOf("learn how to ") + 13); } else { action = "find"; searchFor = recoText; } switch (action) { case "find": //... else if (recoText.Contains("learn how to ")) { action = "find"; searchFor = recoText.Substring(recoText.IndexOf("learn how to ") + 13); }

44 private void HandleNlpCommand(string recoText, bool actSilently) { string action = null; string navigateTo = null; string searchFor = null; recoText = recoText.ToLower(); if (recoText.Contains("go to ") || recoText.Contains("goto ") || recoText.Contains("find ") || recoText.Contains("search ") || recoText.Contains("show me ")) { action = "navigate"; if (recoText.Contains("windows phone dev center")) { navigateTo = "http://dev.windowsphone.com"; } else if (recoText.Contains("learn how to ")) { action = "find"; searchFor = recoText.Substring(recoText.IndexOf("learn how to ") + 13); } else { action = "find"; searchFor = recoText; } switch (action) { case "find": //... else { action = "find"; searchFor = recoText; }

45

46 // Windows Phone Silverlight App // Synthesis private async void SpeakText(string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); await synthesizer.SpeakTextAsync(textToSpeak); } // Recognition private async Task RecognizeSpeech() { SpeechRecognizerUI recognizer = new SpeechRecognizerUI(); // One of three Grammar types available recognizer.Recognizer.Grammars.AddGrammarFromPredefinedType( "key1", SpeechPredefinedGrammar.WebSearch); await recognizer.Recognizer.PreloadGrammarsAsync(); // Optional but recommended // Put up UI and recognize user's utterance SpeechRecognitionUIResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or result.RecognitionResult.Semantics

47 // Windows Phone Silverlight App // Synthesis private async void SpeakText(string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); await synthesizer.SpeakTextAsync(textToSpeak); } // Recognition private async Task RecognizeSpeech() { SpeechRecognizerUI recognizer = new SpeechRecognizerUI(); // One of three Grammar types available recognizer.Recognizer.Grammars.AddGrammarFromPredefinedType( "key1", SpeechPredefinedGrammar.WebSearch); await recognizer.Recognizer.PreloadGrammarsAsync(); // Optional but recommended // Put up UI and recognize user's utterance SpeechRecognitionUIResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or result.RecognitionResult.Semantics // Synthesis private async void SpeakText(string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); await synthesizer.SpeakTextAsync(textToSpeak); }

48 // Windows Phone Silverlight App // Synthesis private async void SpeakText(string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); await synthesizer.SpeakTextAsync(textToSpeak); } // Recognition private async Task RecognizeSpeech() { SpeechRecognizerUI recognizer = new SpeechRecognizerUI(); // One of three Grammar types available recognizer.Recognizer.Grammars.AddGrammarFromPredefinedType( "key1", SpeechPredefinedGrammar.WebSearch); await recognizer.Recognizer.PreloadGrammarsAsync(); // Optional but recommended // Put up UI and recognize user's utterance SpeechRecognitionUIResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or result.RecognitionResult.Semantics // Recognition private async Task RecognizeSpeech() { SpeechRecognizerUI recognizer = new SpeechRecognizerUI(); // One of three Grammar types available recognizer.Recognizer.Grammars.AddGrammarFromPredefinedType( "key1", SpeechPredefinedGrammar.WebSearch); // Optional but recommended await recognizer.Recognizer.PreloadGrammarsAsync();

49 // Windows Phone Silverlight App // Synthesis private async void SpeakText(string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); await synthesizer.SpeakTextAsync(textToSpeak); } // Recognition private async Task RecognizeSpeech() { SpeechRecognizerUI recognizer = new SpeechRecognizerUI(); // One of three Grammar types available recognizer.Recognizer.Grammars.AddGrammarFromPredefinedType( "key1", SpeechPredefinedGrammar.WebSearch); await recognizer.Recognizer.PreloadGrammarsAsync(); // Optional but recommended // Put up UI and recognize user's utterance SpeechRecognitionUIResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or result.RecognitionResult.Semantics // Put up UI and recognize user's utterance SpeechRecognitionUIResult result = await recognizer.RecognizeWithUIAsync(); return result;

50 // Windows Phone Store App // Synthesis // C# code behind // Function to speak a text string private async void SpeakText(MediaElement audioPlayer, string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); SpeechSynthesisStream ttsStream = await synthesizer.SynthesizeTextToStreamAsync(textToSpeak); audioPlayer.SetSource(ttsStream, ""); // This starts the player because AutoPlay="True" }

51 // Windows Phone Store App // Synthesis // C# code behind // Function to speak a text string private async void SpeakText(MediaElement audioPlayer, string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); SpeechSynthesisStream ttsStream = await synthesizer.SynthesizeTextToStreamAsync(textToSpeak); audioPlayer.SetSource(ttsStream, ""); // This starts the player because AutoPlay="True" } // Synthesis

52 // Windows Phone Store App // Synthesis // C# code behind // Function to speak a text string private async void SpeakText(MediaElement audioPlayer, string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); SpeechSynthesisStream ttsStream = await synthesizer.SynthesizeTextToStreamAsync(textToSpeak); audioPlayer.SetSource(ttsStream, ""); // This starts the player because AutoPlay="True" } // C# code behind // Function to speak a text string private async void SpeakText(MediaElement audioPlayer, string textToSpeak) { SpeechSynthesizer synthesizer = new SpeechSynthesizer(); SpeechSynthesisStream ttsStream = await synthesizer.SynthesizeTextToStreamAsync(textToSpeak); audioPlayer.SetSource(ttsStream, ""); // This starts the player because AutoPlay="True" }

53 // Windows Phone Store App // Recognition private async Task RecognizeSpeech() { SpeechRecognizer recognizer = new SpeechRecognizer(); // One of three Constraint types available SpeechRecognitionTopicConstraint topicConstraint = new SpeechRecognitionTopicConstraint(SpeechRecognitionScenario.WebSearch, "MSDN"); recognizer.Constraints.Add(topicConstraint); await recognizer.CompileConstraintsAsync(); // Required // Put up UI and recognize user's utterance SpeechRecognitionResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or // result.RecognitionResult.SemanticInterpretation

54 // Windows Phone Store App // Recognition private async Task RecognizeSpeech() { SpeechRecognizer recognizer = new SpeechRecognizer(); // One of three Constraint types available SpeechRecognitionTopicConstraint topicConstraint = new SpeechRecognitionTopicConstraint(SpeechRecognitionScenario.WebSearch, "MSDN"); recognizer.Constraints.Add(topicConstraint); await recognizer.CompileConstraintsAsync(); // Required // Put up UI and recognize user's utterance SpeechRecognitionResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or // result.RecognitionResult.SemanticInterpretation SpeechRecognizer recognizer = new SpeechRecognizer(); // One of three Constraint types available SpeechRecognitionTopicConstraint topicConstraint = new SpeechRecognitionTopicConstraint( SpeechRecognitionScenario.WebSearch, "MSDN"); recognizer.Constraints.Add(topicConstraint); await recognizer.CompileConstraintsAsync(); // Required

55 // Windows Phone Store App // Recognition private async Task RecognizeSpeech() { SpeechRecognizer recognizer = new SpeechRecognizer(); // One of three Constraint types available SpeechRecognitionTopicConstraint topicConstraint = new SpeechRecognitionTopicConstraint(SpeechRecognitionScenario.WebSearch, "MSDN"); recognizer.Constraints.Add(topicConstraint); await recognizer.CompileConstraintsAsync(); // Required // Put up UI and recognize user's utterance SpeechRecognitionResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or // result.RecognitionResult.SemanticInterpretation // Put up UI and recognize user's utterance SpeechRecognitionResult result = await recognizer.RecognizeWithUIAsync(); return result; } // Calling code uses result.RecognitionResult.Text or // result.RecognitionResult.SemanticInterpretation

56

57 ❶ ❷

58 ❶ ❷ ❸ ❹ ❺ ❻

59 ❶ ❷

60

61

62

63

64

Download ppt "MSDN How do I add Voice Commands to my application Find Install Voice Command Sets Search Search for {dictatedSearchTerms} Find Find."

Similar presentations

.NET Core Libraries Common Language Runtime CodeGen Garbage Collector Security Model Exception Handling Loader & Binder Profiling & Debugging APIs Entity.

.NET Core Libraries Common Language Runtime CodeGen Garbage Collector Security Model Exception Handling Loader & Binder Profiling & Debugging APIs Entity.
Cosc 5/4730 Android Services. What is a service? From android developer web pages: Most confusion about the Service class actually revolves around what.

Cosc 5/4730 Android Services. What is a service? From android developer web pages: Most confusion about the Service class actually revolves around what.
Developing for Windows 8/WinRT Session 4 Fundamentals Kevin Stumpf.

Developing for Windows 8/WinRT Session 4 Fundamentals Kevin Stumpf.
1 Nuance Mobile Developer Program Case Studies. NMDP Case Study – Amazon Price Check Price Comparison app for the iPhone Allows shoppers to locate the.

1 Nuance Mobile Developer Program Case Studies. NMDP Case Study – Amazon Price Check Price Comparison app for the iPhone Allows shoppers to locate the.
CS 4800 By Brandon Andrews.  Specifications  Goals  Applications  Design Steps  Testing.

CS 4800 By Brandon Andrews.  Specifications  Goals  Applications  Design Steps  Testing.
Build 2015 4/16/2017 © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION.

Build /16/2017 © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION.
Introduction to VXML. What is VXML? Voice Extensible Markup Language Used in telephone-based speech applications voice browsing of the web.

Introduction to VXML. What is VXML? Voice Extensible Markup Language Used in telephone-based speech applications voice browsing of the web.
Charles Petzold www.charlespetzold.com Navigation.

Charles Petzold Navigation.
Dragon Naturally Speaking Tutorial What is Dragon Naturally Speaking? Dragon is a dictation software, students can dictate a paper rather than type it.

Dragon Naturally Speaking Tutorial What is Dragon Naturally Speaking? Dragon is a dictation software, students can dictate a paper rather than type it.
30 April 2014 Building Apps for Windows Phone 8.1 Jump Start WinRT Apps & Silverlight.

30 April 2014 Building Apps for Windows Phone 8.1 Jump Start WinRT Apps & Silverlight.
Introducing Xamarin 2.0 Introducing Xamarin 2.0 Michael Hutchinson

Introducing Xamarin 2.0 Introducing Xamarin 2.0 Michael Hutchinson
Recognizes: Magic Memo, show me memo number three. Magic Memo, show memo one. Magic Memo, display memo number two. Magic Memo, display memo.

Recognizes: Magic Memo, show me memo number three. Magic Memo, show memo one. Magic Memo, display memo number two. Magic Memo, display memo.
Managed Code Generics Language Integrated Query Dynamic + Language Parity C# 5.0 + VB 11.0 Windows Runtime + Asynchrony C# 1.0 + VB 7.0 C# 2.0 + VB.

Managed Code Generics Language Integrated Query Dynamic + Language Parity C# VB 11.0 Windows Runtime + Asynchrony C# VB 7.0 C# VB.
Should Intelligent Agents Listen and Speak to Us? James A. Larson Larson Technical Services

Should Intelligent Agents Listen and Speak to Us? James A. Larson Larson Technical Services
PHP : Hypertext Preprocessor

PHP : Hypertext Preprocessor
Introducing Visual Studio ® LightSwitch™ Andrew Coates Microsoft DEV201 #auteched #dev201.

Introducing Visual Studio ® LightSwitch™ Andrew Coates Microsoft DEV201 #auteched #dev201.
Introduction to Silverlight. Slide 2 What is Silverlight? It’s part of a Microsoft Web platform called Rich Internet Applications (RIA) There is a service.

Introduction to Silverlight. Slide 2 What is Silverlight? It’s part of a Microsoft Web platform called Rich Internet Applications (RIA) There is a service.
Liang, Introduction to Java Programming, Eighth Edition, (c) 2011 Pearson Education, Inc. All rights reserved. 0132130807 1 Concurrency in Android with.

Liang, Introduction to Java Programming, Eighth Edition, (c) 2011 Pearson Education, Inc. All rights reserved Concurrency in Android with.
Designing metro style apps for Windows 8 A walkthrough some UI / UX best practices Lanny Geffen, Creative Director, Digiflare.

Designing metro style apps for Windows 8 A walkthrough some UI / UX best practices Lanny Geffen, Creative Director, Digiflare.
Rujchai Ung-arunyawee Department of Computer Engineering Khon Kaen University.

Rujchai Ung-arunyawee Department of Computer Engineering Khon Kaen University.

Similar presentations

Ads by Google