User Interface in the Digital Decade Kai-Fu Lee Corporate Vice President Microsoft Corporation.

Slides:

Advertisements

Similar presentations

Sebastiaan Eldritch-Böersen, IT Support Specialist ~ Assistive Technologies and Yvonne Ward, Support Officer.

Advertisements

From Voice on the Net to Real Time Communications Jawad Khaki Vice President Windows Networking & Communications Microsoft Corporation.

4.03 IT PowerPoint Objective 4.03—Understand Information Technology activities and careers.

Context-Aware User Interfaces. Gent, 21 maart 2005 Context-Aware User Interfaces Context-Aware User Interfaces is a requirement for all defined scenarios.

Chapter 5 Input and Output. What Is Input? What is input? p. 166 Fig. 5-1 Next  Input device is any hardware component used to enter data or instructions.

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

XISL language XISL= eXtensible Interaction Sheet Language or XISL=eXtensible Interaction Scenario Language.

Project 1 Introduction to HTML.

Windows Presetation Foundation (WPF) 1. Introduction.

What is.NET?. The Clients of.NET a) A new generation of connected application b) Microsoft.NET Framework managed execution c) Allows PCs and other smart.

Class 6 LBSC 690 Information Technology Human Computer Interaction and Usability.

1-1 Presentation Tips Click the mouse to advance the slides Click the hyperlink to directly advance to the slide associated with the link; click Return.

Information Technology, the Internet, and You © 2013 The McGraw-Hill Companies, Inc. All rights reserved.Computing Essentials 2013.

MUSCLE Multimodal e-team related activity Technical University of Crete Speech Processing and Dialog Systems Group Presenter: Prof. Alex Potamianos Technical.

Competencies (Page 1 of 2)

1st Project Introduction to HTML.

McGraw-Hill/Irwin Copyright © 2008 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 1 Information Technology, The Internet, and You.

COMPUTER CONCEPTS Unit A: Computer and Internet Basics 1.

CHAPTER 2 Input & Output Prepared by: Mrs.sara salih 1.

Computer and Internet Basics.

4.03 IT PowerPoint Objective 4.03—Understand Information Technology activities and careers.

HTML 1 Introduction to HTML. 2 Objectives Describe the Internet and its associated key terms Describe the World Wide Web and its associated key terms.

Chapter ONE Introduction to HTML.

Alternative Input Devices. Digital Camcorder View recordings on a regular TV or copy them to VHS tape Send MPEG video clips by way of to a mobile.

 At the end of this class, students are able to  Describe definition of input devices clearly  List out the examples of input devices  Describe.

Operating Systems Chapter 4.

 Explain the role of an operating system and list the main operating systems used on today’s computers  Define and describe a user interface and a graphical.

The Computer Input devices Output devices Input/output devices VR Memory Processing Dix et al chapter 2.

Introduction to Computers

Instructor: Li Ma Department of Computer Science Texas Southern University, Houston August, 2011.

Seamless Computing Opportunities & Challenges for China Kai-Fu Lee Corporate Vice President Microsoft Corporation.

Assistive Technology Russell Grayson EDUC 504 Summer 2006.

Overview of SQL Server Alka Arora.

Speaking to Computers Alex Acero Manager, Speech Research Group Microsoft Research Feb 14 th 2003.

Integrating Educational Technology into the Curriculum

Computer Concepts – Illustrated 8 th edition Unit A: Computer and Internet Basics.

Speech User Interfaces Katherine Everitt CSE 490 JL Section Wednesday, Oct 27.

11.10 Human Computer Interface www. ICT-Teacher.com.

SOFTWARE A mechanical engineer, an electrical engineer and a software engineer are travelling in an old Fiat 500 when all of the sudden the car backfires.

HTML, XHTML, and CSS Sixth Edition Chapter 1 Introduction to HTML, XHTML, and CSS.

McGraw-Hill Technology Education © 2006 by the McGraw-Hill Companies, Inc. All rights reserved. 11 CHAPTER INFORMATION TECHNOLOGY, THE INTERNET, AND YOU.

1-1 Presentation Tips Click the mouse to advance the slides Click the hyperlink to directly advance to the slide associated with the link; click Return.

IT Introduction to Information Technology CHAPTER 01.

Towards a Natural User Interface Kai-Fu Lee Corporate Vice President Natural Interactive Services Division Microsoft Corporation.

McGraw-Hill Career Education© 2008 by the McGraw-Hill Companies, Inc. All Rights Reserved. Microsoft Office 2007 Introduction to Computer Essentials.

Voice User Interface

1 CREATING A RESEARCH PAPER (25 June 2010) Objectives: To create a Research Paper using MLA Documentation style.

E.g.: MS-DOS interface. DIR C: /W /A:D will list all the directories in the root directory of drive C in wide list format. Disadvantage is that commands.

Conversational Computers: Always 10 Years Away? Kai-Fu Lee Corporate Vice President Microsoft Corporation.

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Assalamu’alaikum wr. wb Name: Suciyati Class: 6D Courses: Media and ICT for Teaching.

McGraw-Hill Technology Education © 2006 by the McGraw-Hill Companies, Inc. All rights reserved. 11 CHAPTER INFORMATION TECHNOLOGY, THE INTERNET, AND YOU.

An Overview of Microsoft.NET Todd M. Gagorik Technical Architect Microsoft Corporation.

© Paradigm Publishing, Inc. 4-1 Chapter 4 System Software Chapter 4 System Software.

Conceptual Design Dr. Dania Bilal IS588 Spring 2008.

COMPUTER MAIN PARTS SANTIAGO OCAMPO MEJIA. HARDWARE  Or materials set of physical elements of a computer or a computer system.

HTML Concepts and Techniques Fifth Edition Chapter 1 Introduction to HTML.

Presentation Title 1 1/27/2016 Lucent Technologies - Proprietary Voice Interface On Wireless Applications Protocol A PDA Implementation Sherif Abdou Qiru.

Digital Literacy Lesson 2. Hardware Hardware: the physical components of a computer. Includes input devices, processing devices, storage devices, and.

Chapter 1 Introduction to HTML, XHTML, and CSS HTML5 & CSS 7 th Edition.

Graphical User Interfaces (GUI’s ). & Command-Line Interfaces.

W3C Multimodal Interaction Activities Deborah A. Dahl August 9, 2006.

History of Windows Operating System. Windows 1.0 Debuted in 1985 First version of Windows that was set up to use bitmap displays and mouse pointing devices.

11.10 Human Computer Interface

Project 1 Introduction to HTML.

Untold Stories of Touch, Gesture, & NUI

OPERATING SYSTEMS.

Accessibility in Microsoft

Human and Computer Interaction (H.C.I.) &Communication Skills

Presentation transcript:

User Interface in the Digital Decade Kai-Fu Lee Corporate Vice President Microsoft Corporation

Graphical User Interface User Interface Evolution Command line 1985 PC 1990 GUI Multiple Windows Menus 1995 Internet Hyperlinks Search Engines

Graphical User Interface What you see is what you get GUI Interaction Low learning curve. Low learning curve. Great for frequent actions. Great for frequent actions. Difficult for rich domains Difficult for rich domains GUI Interaction Low learning curve. Low learning curve. Great for frequent actions. Great for frequent actions. Difficult for rich domains Difficult for rich domains Technology Advances Bitmap display. Bitmap display. Mouse. Mouse. HTTP / HTML. HTTP / HTML. Technology Advances Bitmap display. Bitmap display. Mouse. Mouse. HTTP / HTML. HTTP / HTML. Enables

Graphical User Interface Natural User Interface User Interface Evolution Command line 1985 PC 1990 GUI Multiple Windows Menus 1995 Internet Hyperlinks Search Engines Digital Decade XML Web Services Smart devices Natural Language Multimodal (speech, ink…) Personal Assistant

Natural User Interface Do what I mean NUI Interaction Natural. Natural. Scalable. Scalable. Expressive. Expressive. NUI Interaction Natural. Natural. Scalable. Scalable. Expressive. Expressive. Technology Advances Smart devices. Smart devices. XML. XML. Web services. Web services. Technology Advances Smart devices. Smart devices. XML. XML. Web services. Web services. Enables “A transforming capability [that allows] you to speak to your computer and it will understand what you're saying in context.” -- Gordon Moore, 2002

Super-Moore’s Law Enable human-level speech recognition (SR): Leveraging Moore’s Law + more data + research. Predictable 10% error reduction or more per year. Human-level performance possible in years. Also enable natural language, Bayesian learning…. Tasks SR error rate Human error rate SR-Human Gap Free style transcription 30%4%19 years Alphabet letters5%1%15 years Read newspaper transcription 3%0.9%11 years

Microsoft’s Practical NUI Plan Start with natural entry points: Speech for telephony. Typing for search and help. Provide simple, evolutionary UI for end-users. Users will perceive NUI as “better search”. Search/help needs to complement GUI. Build on.NET: Visual Studio for development..NET frameworks, XML, web services.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Buy 100 shares of Microsoft.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Buy Microsoft stock.

High InternetTV Phone PDA Ease of text input (keyboard/pen) Ease of GUI (screen/Pointer) Low High PC TabletPC ScreenPhone ScreenPhone PDA TabletPC Car Car InternetTV Smart Devices Needs NUI (speech)

Phone PC ScreenPhone PDATabletPCCar InternetTV A Roadmap for Speech Ease of text input (keyboard/pen) Ease of GUI (screen/Pointer) High High Low Speech-OnlyTelephony Dictation MultimodalCommand/Control

Speech Demonstrations.NET Speech Platform for Telephony Support telephony speech from web application. Reduces cost of phone call from $2 to $0.10. Uses.NET Framework and Visual Studio. Supports multimodal UI using SALT. Beta in June; RC in October. Tablet PC Speech Speech dictations is faster than handwriting. Supports multimodal UI.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Find from John about the budget.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal My printer is stuck.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Print 10,000 copies in Kinko’s Beijing.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal What time does Bill Gates’ talk end?

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Send flowers to my wife on her birthday

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal Hold all calls unless it’s urgent.

A Roadmap Towards NUI Vision TTS SR Dialog Telephony speech Search Help Tasks Q&A Text only Delegation & Pro-Active Federation Agents Planning Multi-Modal I want to plan a vacation to Europe.

Structured Storage needs NUI Find from John about the Budget SELECT DocumentName FROM LocalFileSystem, LocalMailSystem, LocalDocuments WHERE Author contains “John” and Subject contains LSP_Expand(“Budget”) ORDER BY ModifiedDate, CreateDate My printer is stuck SELECT DocumentName FROMLocalFileSystem, LocalHardware, HardwareVendorSupport WHERE Vendor=‘HP’ and Model=‘DeskJet 550” and Body contains LSP_Expand(“jam”) ORDERED BY Context, LearnedBehavior. Show me the new Dell notebook SELECT DocumentName FROM WebSearch, UserHeuristics WHERE Vendor=‘Dell’ and Category=‘laptops’ and Age<60 Make the letters on my screen bigger SELECT TaskNames FROM LocalTasks, OSTasks, USerHeuristics WHERE Name contains ‘Video Resolution’ ORDER by Context, LearnedBehavior Play Britney SELECT MediaName FROM LocalFileSystem, WebMediaProviders WHERE Name contains ‘Britney’ OR Name contains ‘Spears’ ORDER BY CurrentDirectoryBias, LearnedBehavior, Name, Context

Natural language demonstrations Smart search & help. Users don’t know where to go or what to type. Companies don’t know what’s on users’ minds. We want to close that gap. Q&A for “any question”. Unstructured  structured tool is needed. Combines statistical and natural language.

Conclusion Natural UI is needed for the Digital Decade: Scalable, natural UI for smart devices. Retrieval of information from structured storage. UI to connected web services. Natural UI will arrive as an evolution: Telephony speech, search, help are the first applications. But in 10 years, Natural UI will be viewed as the largest revolution since Graphical UI.

© 2001 Microsoft Corporation. All rights reserved.