+ Models of Search Behavior Diane Kelly, University of North Carolina, USA NII Shonan Meeting Seminar 020 Whole-Session Evaluation of IIR Systems October.

Slides:



Advertisements
Similar presentations
Struggling or Exploring? Disambiguating Long Search Sessions
Advertisements

Developing and Evaluating a Query Recommendation Feature to Assist Users with Online Information Seeking & Retrieval With graduate students: Karl Gyllstrom,
Results: 1.Most positive scores related to retrieval precision were much lower than the ideal maximum, even though the queries contained very specific.
Information Retrieval: Human-Computer Interfaces and Information Access Process.
Dialogue – Driven Intranet Search Suma Adindla School of Computer Science & Electronic Engineering 8th LANGUAGE & COMPUTATION DAY 2009.
Toward Collaboration Between Information Seeking and Information Retrieval Carol Kuhlthau Professor II School of Communication, Information and Library.
Retrieval Evaluation. Brief Review Evaluation of implementations in computer science often is in terms of time and space complexity. With large document.
Re-ranking Documents Segments To Improve Access To Relevant Content in Information Retrieval Gary Madden Applied Computational Linguistics Dublin City.
User - thesaurus interaction in a web- based database: an evaluation of users’ search term selection behaviour Ali Asghar Shiri and Crawford Revie Department.
Retrieval Evaluation: Precision and Recall. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity.
Modern Information Retrieval Chapter 1 Introduction.
Experimental Components for the Evaluation of Interactive Information Retrieval Systems Pia Borlund Dawn Filan 3/30/04 610:551.
Retrieval Evaluation. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity. With large document.
An investigation of query expansion terms Gheorghe Muresan Rutgers University, School of Communication, Information and Library Science 4 Huntington St.,
Personalizing the Digital Library Experience Nicholas J. Belkin, Jacek Gwizdka, Xiangmin Zhang SCILS, Rutgers University
INFO Human Information Behavior (HIB) What is information behavior? What is “information”?
Web Search – Summer Term 2006 II. Information Retrieval (Basics Cont.) (c) Wolfgang Hürst, Albert-Ludwigs-University.
Operating Systems Day 1. Booting a Computer 1.Switch on the UPS electricity supply - green light electricity failure - red light charging – orange light.
In Situ Evaluation of Entity Ranking and Opinion Summarization using Kavita Ganesan & ChengXiang Zhai University of Urbana Champaign
Usability Evaluation of Digital Libraries Stacey Greenaway Submitted to University of Wolverhampton module Dec 15 th 2006.
Temporal Event Map Construction For Event Search Qing Li Department of Computer Science City University of Hong Kong.
Personalization of the Digital Library Experience: Progress and Prospects Nicholas J. Belkin Rutgers University, USA
Information Seeking in Electronic Environments Marchionini, G. (1995). Information Seeking in Electronic Environments. Cambridge Press. Kathleen Padova.
Visual User Interfaces David Rashty. “Grasping the whole is a gigantic theme. Arguably, intellectual history’s most important. Ant-vision is humanity’s.
Personalized Information Retrieval in Context David Vallet Universidad Autónoma de Madrid, Escuela Politécnica Superior,Spain.
Research methods for HCI, HCC Judy Kay CHAI: Computer Human Adapted Interaction School of Information Technologies.
Human Information Interaction & Retrieval Diane Kelly University of North Carolina at Chapel Hill, USA European Summer School on Information Retrieval.
OCLC Research OCLC Online Computer Library Center Research & New Technologies Interest Group 24 October 2005 DeweyBrowser & Curiouser Diane Vizine-Goetz.
Hao Wu Nov Outline Introduction Related Work Experiment Methods Results Conclusions & Next Steps.
1 Information Retrieval Acknowledgements: Dr Mounia Lalmas (QMW) Dr Joemon Jose (Glasgow)
SBD: Activity Design CS HCI Chris North Usability Engineering - Chapter 3.
Effects of Popularity and Quality on the Usage of Query Suggestions during Information Search Can users be induced to take bad query suggestions because.
Lecture 2 Jan 13, 2010 Social Search. What is Social Search? Social Information Access –a stream of research that explores methods for organizing users’
Lecture 3 / Chapter 3 User Needs and Behavior Bob Griffin - IMD290 Information Architecture.
Lecture 2 Jan 15, 2008 Social Search. What is Social Search? Social Information Access –a stream of research that explores methods for organizing users’
Ben Carterette Paul Clough Evangelos Kanoulas Mark Sanderson.
Modern Information Retrieval Presented by Miss Prattana Chanpolto Faculty of Information Technology.
CloudRoom: A Conceptual Model for Managing Data in Space and Time Lucia Terrenghi, Thomas Lang, Martin Richartz Vodafone GROUP R&D Kátia Serralheiro Human-Computer.
Microsoft PowerPoint For Beginners. Learning Objective By the end of this session you should be able to create and navigate a PowerPoint slideshow that.
Jane Reid, AMSc IRIC, QMUL, 30/10/01 1 Information seeking Information-seeking models Search strategies Search tactics.
Performance Measures. Why to Conduct Performance Evaluation? 2 n Evaluation is the key to building effective & efficient IR (information retrieval) systems.
Information Fluency in the Digital Generation Charles Dziuban University of Central Florida.
Information Retrieval
ResultMaps: Search Result Visualization for Hierarchical Information Spaces Danielle H. Lee.
SBD: Activity Design Chris North cs3724: HCI. Problem scenarios summative evaluation Information scenarios claims about current practice analysis of stakeholders,
Yan Zhang University of North Carolina, Chapel Hill Introduction Research goals  Help build systems that are able to provide.
Evaluation INST 734 Module 5 Doug Oard. Agenda Evaluation fundamentals Test collections: evaluating sets Test collections: evaluating rankings Interleaving.
Acceso a la información mediante exploración de sintagmas Anselmo Peñas, Julio Gonzalo y Felisa Verdejo Dpto. Lenguajes y Sistemas Informáticos UNED III.
Augmenting (personal) IR Readings Review Evaluation Papers returned & discussed Papers and Projects checkin time.
The Loquacious ( 愛說話 ) User: A Document-Independent Source of Terms for Query Expansion Diane Kelly et al. University of North Carolina at Chapel Hill.
The Development of a search engine & Comparison according to algorithms Sung-soo Kim The final report.
ASSOCIATIVE BROWSING Evaluating 1 Jin Y. Kim / W. Bruce Croft / David Smith by Simulation.
We are Gathered Here Together: Why? Introduction to the NII Workshop on Whole-Session Evaluation of Interactive Information Retrieval Systems Whole-Session.
Subject Access and Users: Insights & Inspirations from Marcia J. Bates Presented at the Historical Perspective SIG session, 2005 ALISE, Boston, Mass. By.
Visiting human errors in IR systems from decision making perspective
Projects in the areas of: Multimedia processing (speech, image, video)
Augmenting (personal) IR
Search Pages and Results
Exploratory Search Beyond the Query–Response Paradigm
INFO 414 Information Behavior
Tiers vs. Layers.
PLOS 2007 Wrap-Up Fourth Workshop on Programming Languages and Operating Systems Skamania Lodge, Stevenson, WA October 18, 2007.
Exploratory search: New name for an old hat?
ONLINE EDUCATION RESOURCES FOR GEOLOGY
Fall 2018, COMP 562 Poster Session
Exploratory Search Framework for Web Data Sources
Welcome to PLOS 2007! Fourth Workshop on Programming Languages and Operating Systems Skamania Lodge, Stevenson, WA October 18, 2007.
Information Seeking Models
Interactive Information Retrieval
Presentation transcript:

+ Models of Search Behavior Diane Kelly, University of North Carolina, USA NII Shonan Meeting Seminar 020 Whole-Session Evaluation of IIR Systems October 09, 2012

+ Classic Model 2

+ Q3Q2Q1Q4Q5 Bates, M. J. (1989). Design of browsing and berrypicking for the online search interface. Online Review, 13, Berrypicking Model 3

+ Perfect Set Q1 One Ideal Query Vs. Q1Q2Q3Q4Q5 Time 4 Berrypicking Model

+ Orienteering Q1Q2Q3 Fishing and AnchoringFishing with No Bait Q1Q2Q3 5 Hertzum, M. & Frokjaer, E. (1996). Browsing and querying in online documentation: A study of user interfaces and the interaction process. ACM Transactions on Computer-Human Interaction (ToCHI), 3(2),136–161.

+ Other Models Variations on the Same Theme Q1 A Q1 B Q1 C Q1 D Genuine Failures Q1Q2Q3 6 Interleaving Q1 A Q1 B Q2 A Q3 C

+ Session-level Mixed Models Q1Q2Q3Q4Q5Q6 7 [E][F 1 ] [FUF 1 ][F 2 ][F 3 ][FUF 3 ] Q7 Vakkari, P. (2010). Exploratory searching as conceptual exploration. Proceedings of the Fourth Human Computer Information Retrieval Workshop, New Brunswick, NJ,

+ Multi-Session Mixed Models 8 Q1Q2Q3Q4Q5Q6Q7Q8Q9Q10Q11Q12 Session 1Session 2Session 3 [E] [F 1 ] [FUF 2 ][F 3 ] [FUF 3 ][F 1 ][F 2 ][F 3 ][F 2 ][FUF 1 ]