1. November 4th, 1996ICAD Industry Panel1 Audio Taken Seriously; The present and future of audio at Microsoft Ken Greenebaum kgreene@microsoft.com Internet Platforms and tools Division Microsoft Corporation

2. November 4th, 1996ICAD Industry Panel2 Slides, other materials online: http://www.research.microsoft.com/research/graph ics/kgreene/icad

3. November 4th, 1996ICAD Industry Panel3 Overview ù Today ùSolid media foundations (DirectX, ActiveMovie) ù Soon ùAdvanced media (ActiveAnimation, Whisper/Whistler) ù Tomorrow ùConversational interfaces

4. November 4th, 1996ICAD Industry Panel4 Today: DirectSound http://www.microsoft.com/mediadev/audio/iaud.htm ù Streaming audio ù Reasonable latency ù Input (soon) ù Device independence ù Multiple app’s audio mix ù DSound3D ù DSound3D

5. November 4th, 1996ICAD Industry Panel5 Today: Active Movie ù Graph based media architecture ù Movie playback ù Movie record (soon!) ù Open filter API ù Audio plugin technology

6. November 4th, 1996ICAD Industry Panel6 Today: Netshow http://www.microsoft.com/netshow/ ù Streaming network audio/video ù Multicast audio using RTP (real-time protocol) ù ASF file format, conversion, editing tools ù NT server

7. November 4th, 1996ICAD Industry Panel7 Today: Interactive Music Today: Interactive Music (Formerly BlueRibbon’s AudioActive) ù Intelligent interactive music ù Composes/Delivers music ù Based on expert system ù Human composer ‘authors’ templates ù Music always sounds fresh and original ù Look for it: PowerPoint ‘97, MSN Riff

8. November 4th, 1996ICAD Industry Panel8 Soon: DirectMusic Soon: DirectMusic Contact: craighs@microsoft.com ù Consistent Playback of MIDI Music ù Internet support for Music ù DLS downloadable sample sets ù Optional software MIDI synth ù Internet MIDI jamming?

9. November 4th, 1996ICAD Industry Panel9 Soon: “Appelles” ù Expect an announcement soon! ù Animation Description Language ù Functional Paradigm ù Media Integration ù Implicit Time ù Language Integration (Java) ù Enable sophisticated Web animation

10. November 4th, 1996ICAD Industry Panel10 Appelles Audio Capabilities: ù All audio types orthogonal ù Parametric Synthesis ù MIDI ù Audio Active Music Synthesis ù Streaming audio ù PCM Audio ù 3D Spatialized sound embedded in geometry

11. November 4th, 1996ICAD Industry Panel11 Soon: “Talisman” Audio http://www.microsoft.com/hwdev/devdes/talisman.htm/ ù Hardware acceleration of: ùDSound/DSound3D ùEcho Cancellation ùActive Movie filter accelerator ù32bit mixer ùDLS compatible synthesizer ùMODEM/Telephony

12. November 4th, 1996ICAD Industry Panel12 Soon: “Whisper” http://www.research.microsoft.com/research/srg/ ù Windows Highly Intelligent Speech Recognizer ù Based on SphinxII ù Continuous speech recognition ù Speaker independent ù Context-free grammar decoding

13. November 4th, 1996ICAD Industry Panel13 Soon: “Whistler” http://www.research.microsoft.com/research/srg/ ù Trainable Text to Speech Synthesizer ù Training from human speech; maintains: ùNatural prosody ùCharacteristics of original human ù Emotional control ù Uses NLP technology to parse text

14. November 4th, 1996ICAD Industry Panel14 Tomorrow: Conversational Interfaces ù Motivation: ùGiven choice people communicate with speech ùPeople prefer natural language over ‘command languages’ ùanthropomorphism unavoidable w/spoken interaction

15. November 4th, 1996ICAD Industry Panel15 Persona Project http://www.research.microsoft.com/ui/persona/home.htm/ ù Conversational Assistant as UI ùSpoken conversation (voice recognition/synth) ùNatural Language (in limited domains) ùAssistant w/Rich visual presence ùSimulates verbal and non-verbal cues

16. November 4th, 1996ICAD Industry Panel16 Here’s Peedy and Gene:

17. November 4th, 1996ICAD Industry Panel17 Conclusion: ù Microsoft is: ù Taking media very seriously ùOffering a solid foundation today ùDesigning the future