1. Rethinking Search in the era of new devices and services Rethinking Search in the era of new devices and services SREE HARI NAGARALU | DEC 19, 2012 DEC 19, 2012 FIRE – 2012 hari@bing.com

2. Agenda Information Retrieval (Search) Integrated Devices & Services Emerging Trends with Digital Experiences Intelligence Fabric and Challenges ahead for Search

3. Information Retrieval (Search) User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user

4. Search Browser connects to the world and Search runs in a browser Web of documents has grown humongously large Search became the gateway to the world wide web Browser Computer SERVICE DEVICE

5. Paradigm Shifts

6. Devices integrated with Services iPod -- iTunes iPhone, iPad – Full Browser, Passbook, Siri Kindle -- Media Book Services Android -- Google Play, Google Now Xbox Kinect – Games and Media services Windows 8 – Skydrive, Office, Bing, Skype Device Hardware OS Cloud Innovation across boundaries between device hardware to OS to cloud services

7. Digitization of our entire society Web growing at rapid pace Beyond written documents All Entities (People, Places, Organisations, Things) are getting digital representation All relationships between entities getting digitized Every interaction is getting digitized

8. Governing Information Structures Topical Structures Human thoughts, human language Written and expressed content, Interactions with each other Billions of documents created everyday Social Architecture Human Relationships Geo-spatial Dimension Connecting to Physical dimension Digitizing entire planet – every physical location, every road, every building, etc Example Scenario: My Friend, Prasanjit, has captured a few pictures of this event, tagged all the faces in the pictures and uploaded them to the FIRE homepage with the comment FIRE-2012 pictures. My wife wants to look at some pictures of mine from the recent Kolkata visit. 1.How should the information get represented? 2.How should she formulate the query?

9. Digital experiences - Emerging Trends Appification of the web Early stage of app evolution Rich Interactions/Experiences to the users Bing Travel App Information List of Actions associated Web Document Apps OS/hardware capabilities Focused on the task Has Local context Single entry point Server-side control

10. For opening a particular document type, you can open in any of the associated programs For exploring a particular entity, you can explore it with any of the associated apps File Name: A.htm File Type: HTML File Associate Programs: Entity Name: Skyfall Entity Type: Movie Associate Apps: Two Apps: BookMyShow PVR Cinemas

11. Digital experiences - Emerging Trends Appification of the web Early stage of app evolution Rich Interactions/Experiences to the users Focus shifting from FILE to ENTITY Need a service that can tell which apps are suited for what entities. Even further, for which actions on the entities. Win8 People App Contact Info aggregated from multiple identities List of Actions associated

12. Hyderabad- Kolkata trip Flight Booking Cab Booking Hotel Selection Know more Explore Kolkata Explore ISI Something to read Download some books Task Completion is the KEY

13. Digital experiences - Emerging Trends Interconnections between Apps thru Entities Web of Apps and Services is evolving Task/Action Links are evolving e.g. 1: Task: Share on Social Network Choice of Apps are shown e.g. 2: Task: Transfer Money Apps: ICICI Bank App, HDFC Bank App,... Web Document 1 Web Document 2 App 1 App 2 App 3 Hyperlink What do we call these links?

14. Digital experiences – Emerging Trends NUI / Natural human interactions Touch, gestures, voice, … E.g. Microsoft Kinect, Apples Siri Device Capabilities coupled with seamless Cloud connectivity

15. New generation of digital experiences – Devices & Services Device-side Understand all forms of human language written language, spoken language, body language Understanding image, motion Sensors to be fully aware of Context Server-side/Cloud-side Cloud infrastructure Big Data / Machine Learning Still early stages of devices and services Intelligence Fabric Anything we do, anywhere we are, the devices, the cloud services, the model that understands the situation and is able to predict, anticipate.

16. Information Retrieval (Search) User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user Paradigm Shifts Integrated Devices & Services Digitisation of our Society Information Structures evolving Appification of the web Natural User Interfaces Powerful Devices Cheap Cloud Services Intelligence Fabric

17. Does form-factor of the devices play any role in the ranking? User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user

18. Does layout and ranking of results have any correlation? User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user

19. How to estimate information gain result collection is not homogenous? User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user a

20. Ranking across different content types? User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user a

21. Does User need to input text based query always? User has Information needs User enters a query in input box Retrieval of results in a collection of objects For web, a collection could be of documents, images, audio, video Information about objects represented internally by using metadata Top Ranking objects are displayed to the user Scenario: Lets say my device has information about my scanned boarding pass and I am sitting in a wrong gate in the airport. Do even I know? Should my device wait for me to ask about it?

22. Thank You & Happy New Year SREE HARI NAGARALU | hari@bing.com