CONCLUSIONS & CONTRIBUTIONS Ground-truth dataset, simulated search tasks environment Multiple everyday applications (MS Word, MS PowerPoint, Mozilla Browser)

Slides:



Advertisements
Similar presentations
Data Mining and the Web Susan Dumais Microsoft Research KDD97 Panel - Aug 17, 1997.
Advertisements

Susan R. Easterbrooks Georgia State University
CONTRIBUTIONS Ground-truth dataset Simulated search tasks environment Multiple everyday applications (MS Word, MS PowerPoint, Mozilla Browser) Implicit.
TDG Project Web-based Learning for Building & Construction Laboratory and Site Works Vincent Siu & Albert Cheung Department of Building & Construction.
Information Retrieval: Human-Computer Interfaces and Information Access Process.
Predicting Text Quality for Scientific Articles Annie Louis University of Pennsylvania Advisor: Ani Nenkova.
Designing Software for Personal Music Management and Access Frank Shipman & Konstantinos Meintanis Department of Computer Science Texas A&M University.
Spatial Hypertext for Digital Library Providers and Patrons Frank Shipman Department of Computer Science & Center for the Study of Digital Libraries Texas.
Information Retrieval: Human-Computer Interfaces and Information Access Process.
Information Access Douglas W. Oard College of Information Studies and Institute for Advanced Computer Studies Design Understanding.
Recognizing User Interest and Document Value from Reading and Organizing Activities in Document Triage Rajiv Badi, Soonil Bae, J. Michael Moore, Konstantinos.
Managing Software Projects in Spatial Hypertext : Experiences in Dogfooding Frank Shipman Department of Computer Science & Center for the Study of Digital.
Important Task in Patents Retrieval Recall is an Important Factor Given Query Patent -> the Task is to Search all Related Patents Patents have Complex.
Projects in the Intelligent User Interfaces Group Frank Shipman Associate Director, Center for the Study of Digital Libraries.
Personalized Ontologies for Web Search and Caching Susan Gauch Information and Telecommunications Technology Center Electrical Engineering and Computer.
EVIDENCE BASED WRITING LEARN HOW TO WRITE A DETAILED RESPONSE TO A CONSTRUCTIVE RESPONSE QUESTION!! 5 th Grade ReadingMs. Nelson EDU 643Instructional.
Web Design Process CMPT 281. Outline How do we know good sites from bad sites? Web design process Class design exercise.
 A set of objectives or student learning outcomes for a course or a set of courses.  Specifies the set of concepts and skills that the student must.
The 2nd International Conference of e-Learning and Distance Education, 21 to 23 February 2011, Riyadh, Saudi Arabia Prof. Dr. Torky Sultan Faculty of Computers.
Unit 2: Engineering Design Process
Personalization of the Digital Library Experience: Progress and Prospects Nicholas J. Belkin Rutgers University, USA
CONCLUSION & FUTURE WORK Normally, users perform triage tasks using multiple applications in concert: a search engine interface presents lists of potentially.
Department of Informatics, UC Irvine SDCL Collaboration Laboratory Software Design and sdcl.ics.uci.edu 1 Informatics 121 Software Design I Lecture 12.
Using Hyperlink structure information for web search.
UOS 1 Ontology Based Personalized Search Zhang Tao The University of Seoul.
Presented by: Apeksha Khabia Guided by: Dr. M. B. Chandak
Personal Information Management Vitor R. Carvalho : Personalized Information Retrieval Carnegie Mellon University February 8 th 2005.
Hao Wu Nov Outline Introduction Related Work Experiment Methods Results Conclusions & Next Steps.
Implicit Acquisition of Context for Personalization of Information Retrieval Systems Chang Liu, Nicholas J. Belkin School of Communication and Information.
Markup and Validation Agents in Vijjana – A Pragmatic model for Self- Organizing, Collaborative, Domain- Centric Knowledge Networks S. Devalapalli, R.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
Personalized Search Xiao Liu
CONCLUSION & FUTURE WORK Given a new user with an information gathering task consisting of document IDs and respective term vectors, this can be compared.
Research Paper Recommender System Monica D ă g ă diţ ă.
Information commitments, evaluative standards and information searching strategies in web-based learning evnironments Ying-Tien Wu & Chin-Chung Tsai Institute.
CONCLUSION & FUTURE WORK Normally, users perform search tasks using multiple applications in concert: a search engine interface presents lists of potentially.
인지구조기반 마이닝 소프트컴퓨팅 연구실 박사 2 학기 박 한 샘 2006 지식기반시스템 응용.
 Examine two basic sources for implicit relevance feedback on the segment level for search personalization. Eye tracking Display time.
Personalized Interaction With Semantic Information Portals Eric Schwarzkopf DFKI
BACKGROUND The Web is a global information resource Web users that seek information vary, culturally and ethnically Users of different cultural backgrounds.
Evaluation of (Search) Results How do we know if our results are any good? Evaluating a search engine  Benchmarks  Precision and recall Results summaries:
Qi Guo Emory University Ryen White, Susan Dumais, Jue Wang, Blake Anderson Microsoft Presented by Tetsuya Sakai, Microsoft Research.
Working Memory and Learning Underlying Website Structure
COLLABORATIVE SEARCH TECHNIQUES Submitted By: Shikha Singla MIT-872-2K11 M.Tech(2 nd Sem) Information Technology.
EXPLORING PROCESS OF DOING DATA SCIENCE VIA AN ETHNOGRAPHIC STUDY OF A MEDIA ADVERTISING COMPANY J.SALTZ, I.SHAMSHURIN 2015 IEEE INTERNATIONAL CONFERENCE.
BACKGROUND The Web is a global information resource Web users that seek information vary, culturally and ethnically Users of different cultural backgrounds.
Augmenting (personal) IR Readings Review Evaluation Papers returned & discussed Papers and Projects checkin time.
Identifying “Best Bet” Web Search Results by Mining Past User Behavior Author: Eugene Agichtein, Zijian Zheng (Microsoft Research) Source: KDD2006 Reporter:
Research Word has a broad spectrum of meanings –“Research this topic on ….” –“Years of research has produced a new ….”
Date: 2013/9/25 Author: Mikhail Ageev, Dmitry Lagun, Eugene Agichtein Source: SIGIR’13 Advisor: Jia-ling Koh Speaker: Chen-Yu Huang Improving Search Result.
LineUp: Visual Analysis of Multi- Attribute Rankings Samuel Gratzl, Alexander Lex, Nils Gehlenborg, Hanspeter Pfister, and Marc Streit.
Predicting Short-Term Interests Using Activity-Based Search Context CIKM’10 Advisor: Jia Ling, Koh Speaker: Yu Cheng, Hsieh.
UOS Personalized Search Zhang Tao 장도. Zhang Tao Data Mining Contents Overview 1 The Outride Approach 2 The outride Personalized Search System 3 Testing.
Unified Relevance Feedback for Multi-Application User Interest Modeling Sampath Jayarathna PhD Candidate Computer Science & Engineering.
Acknowledgements : This research is supported by NSF grant INTRODUCTION MULTI LAYER PERCEPTRONS (MLP) DATA SET FOR TRAINING Learning weights using.
Recognizing Document Value from Reading and Organizing Activities in Document Triage Rajiv Badi, Soonil Bae, J. Michael Moore, Konstantinos Meintanis,
Search Engines: Ready, Set, Search! Jennifer Hey-Lewis Kenwood Academy, Chicago Public Schools IIT Research Mentor: Dr. Wai Gen Yee This material is based.
5. Methodology Compare the performance of XCS with an implementation of C4.5, a decision tree algorithm called J48, on the reminder generation task. Exemplar.
UNIVERSITY UTARA MALAYSIA COLLEGE OF ARTS & SCIENCES.
CONCLUSIONS & CONTRIBUTIONS Ground-truth dataset, simulated search tasks environment Implicit feedback, semi-explicit feedback (annotations), explicit.
WHIM- Spring ‘10 By:-Enza Desai. What is HCIR? Study of IR techniques that brings human intelligence into search process. Coined by Gary Marchionini.
Center for Assessment and Improvement of Learning
Connecting Interface Metaphors to Support Creation of Path-based Collections Unmil P. Karadkar, Andruid Kerne, Richard Furuta, Luis Francisco-Revilla,
Applying Key Phrase Extraction to aid Invalidity Search
Athabasca University School of Computing and Information Science
Data Warehousing and Data Mining
PPT1: Basics of software engineering
Indented Tree or Graph? A Usability Study of Ontology Visualization Techniques in the Context of Class Mapping Evaluation 本体可视化技术在类型匹配评估中的可用性研究 Qingxia.
Technical Writing (AEEE299)
ACM Digital Repository Classification Results
Presentation transcript:

CONCLUSIONS & CONTRIBUTIONS Ground-truth dataset, simulated search tasks environment Multiple everyday applications (MS Word, MS PowerPoint, Mozilla Browser) Implicit feedback, semi-explicit feedback (annotations), explicit feedback (paragraph relevance score, page relevance score, page readability score) 31 Students (24 male, 7 female) Figure 3. Feature Weight Generation, (a)WKNN, (b) MLP Acknowledgements : This research is supported by NSF grant “You might also like…” from Everyday Applications to Recommendations Sampath Jayarathna, Atish Patra and Frank Shipman Computer Science & Engineering, Texas A&M University – College Station “You might also like…” from Everyday Applications to Recommendations Sampath Jayarathna, Atish Patra and Frank Shipman Computer Science & Engineering, Texas A&M University – College Station ABSTRACT How can we build more valuable models of a user’s interests based on their prior activities? What are the tradeoffs between alternative approaches to recommending documents and document components based on a combination of implicit and explicit feedback across multiple applications? we explore novel user interest modeling techniques in order to generate document recommendations to support users during open-ended information gathering tasks. Our work is unique by making use of a combination of implicit, semi-explicit, and explicit feedback in the context of users’ interactions with multiple applications, coupled with an analysis of the characteristics and content of the documents they are interacting with. Figure 1. Basic IR Cycle and IPM Recommendations 1.Unified feedback across multiple applications will result in more accurate and more rapid assessment of documents than available through either implicit or explicit feedback alone. 2.Unified feedback across multiple applications can be used to more accurately and rapidly determine when a user's interest has changed. BACKGROUND Explicit feedback: users explicitly mark relevant and irrelevant documents Implicit feedback: system attempts to infer user intentions based on observable behavior Unified feedback: implicit ratings can be combined with existing explicit ratings to form a hybrid system to predict user satisfaction Figure 2. IPM System Architecture All participants were placed in the role of a researcher who had to read 32 web pages (4 tasks, 8 web pages per task) and prepare a short report in MS Word and a presentation in MS PPT on a specific task. During the reading of the selected web pages, they had to annotate paragraphs they seems interesting from the given webpage and assign ratings to them using the WebAnnotate tool. Once they completed reading each page, they had to provide a readability score and relevance score for the completed web pages. DATASET AND RESULTS Our major contributions in this work can be summarized as: 1.A unified user interest model Classification of documents into different user interests based on combined (implicit + semi-explicit) user expressions 2.Multiple everyday-applications model Examine how inferred models of user interest from different applications may be used in building multi-application environments HYPOTHESIS USER STUDY Model Page-Level RMSE Task-1Task-2Task-3Task-4 baseline-LDA Semi-Explicit Unified REFERENCES 1.Jayarathna, S, A. Patra, and F. Shipman (2013). "Mining user interest from search tasks and annotations." Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. ACM. 2.Bae, S. I. and F. Shipman (2008). Balancing human and system visualization during document triage, Texas A & M University.