Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and.

Slides:



Advertisements
Similar presentations
Performance in Decentralized Filesharing Networks Theodore Hong Freenet Project.
Advertisements

Topical TrustRank: Using Topicality to Combat Web Spam Baoning Wu, Vinay Goel and Brian D. Davison Lehigh University, USA.
Jeopardy Q 1 Q 6 Q 11 Q 16 Q 21 Q 2 Q 7 Q 12 Q 17 Q 22 Q 3 Q 8 Q 13
Mark Levene, An Introduction to Search Engines and Web Navigation © Pearson Education Limited 2005 Slide 4.1 Chapter 4 : Searching the Web The mechanics.
1 Topic Distributions over Links on Web Jie Tang 1, Jing Zhang 1, Jeffrey Xu Yu 2, Zi Yang 1, Keke Cai 3, Rui Ma 3, Li Zhang 3, and Zhong Su 3 1 Tsinghua.
Context-Sensitive Query Auto-Completion AUTHORS:NAAMA KRAUS AND ZIV BAR-YOSSEF DATE OF PUBLICATION:NOVEMBER 2010 SPEAKER:RISHU GUPTA 1.
A Human-Centered Computing Framework to Enable Personalized News Video Recommendation (Oh Jun-hyuk)
Introduction Distance-based Adaptable Similarity Search
Learning to Recommend Questions Based on User Ratings Ke Sun, Yunbo Cao, Xinying Song, Young-In Song, Xiaolong Wang and Chin-Yew Lin. In Proceeding of.
Data Mining and Machine Learning Lab eTrust: Understanding Trust Evolution in an Online World Jiliang Tang, Huiji Gao and Huan Liu Computer Science and.
A Vector Space Model for Automatic Indexing
Application of Ensemble Models in Web Ranking
Crawling, Ranking and Indexing. Organizing the Web The Web is big. Really big. –Over 3 billion pages, just in the indexable Web The Web is dynamic Problems:
22 May 2006 Wu, Goel and Davison Models of Trust for the Web (MTW) WWW2006 Workshop L EHIGH U NIVERSITY.
Dialogue – Driven Intranet Search Suma Adindla School of Computer Science & Electronic Engineering 8th LANGUAGE & COMPUTATION DAY 2009.
Explorations in Tag Suggestion and Query Expansion Jian Wang and Brian D. Davison Lehigh University, USA SSM 2008 (Workshop on Search in Social Media)
Expertise Networks in Online Communities: Structure and Algorithms Jun Zhang Mark S. Ackerman Lada Adamic University of Michigan WWW 2007, May 8–12, 2007,
Interfaces for Selecting and Understanding Collections.
6/16/20151 Recent Results in Automatic Web Resource Discovery Soumen Chakrabartiv Presentation by Cui Tao.
Retrieval Evaluation: Precision and Recall. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity.
Semantic (Language) Models: Robustness, Structure & Beyond Thomas Hofmann Department of Computer Science Brown University Chief Scientist.
What is the Internet? The Internet is a computer network connecting millions of computers all over the world It has no central control - works through.
1 CS 430 / INFO 430 Information Retrieval Lecture 24 Usability 2.
Topic-Sensitive PageRank Taher H. Haveliwala. PageRank Importance is propagated A global ranking vector is pre-computed.
Retrieval Evaluation. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity. With large document.
An investigation of query expansion terms Gheorghe Muresan Rutgers University, School of Communication, Information and Library Science 4 Huntington St.,
Information Retrieval
Undue Influence: Eliminating the Impact of Link Plagiarism on Web Search Rankings Baoning Wu and Brian D. Davison Lehigh University Symposium on Applied.
Huizhong Doan, Yonbo Cao, Chin-Yew Lin and Yong Yu Shanghai Jiao Tong University & MSRA ACL /7/91Rick Liu.
Motivation When searching for information on the WWW, user perform a query to a search engine. The engine return, as the query’s result, a list of Web.
Quality-aware Collaborative Question Answering: Methods and Evaluation Maggy Anastasia Suryanto, Ee-Peng Lim Singapore Management University Aixin Sun.
Λ14 Διαδικτυακά Κοινωνικά Δίκτυα και Μέσα
SIGIR’09 Boston 1 Entropy-biased Models for Query Representation on the Click Graph Hongbo Deng, Irwin King and Michael R. Lyu Department of Computer Science.
Personalization in Local Search Personalization of Content Ranking in the Context of Local Search Philip O’Brien, Xiao Luo, Tony Abou-Assaleh, Weizheng.
Aardvark Anatomy of a Large-Scale Social Search Engine.
Web Search. Structure of the Web n The Web is a complex network (graph) of nodes & links that has the appearance of a self-organizing structure  The.
1 University of Qom Information Retrieval Course Web Search (Link Analysis) Based on:
 Search Engine Search Engine  Steps to Search for webpages pertaining to a specific information Steps to Search for webpages pertaining to a specific.
When Experts Agree: Using Non-Affiliated Experts To Rank Popular Topics Meital Aizen.
Personalized Search Cheng Cheng (cc2999) Department of Computer Science Columbia University A Large Scale Evaluation and Analysis of Personalized Search.
1 Discovering Authorities in Question Answer Communities by Using Link Analysis Pawel Jurczyk, Eugene Agichtein (CIKM 2007)
A Classification-based Approach to Question Answering in Discussion Boards Liangjie Hong and Brian D. Davison Computer Science and Engineering Lehigh University.
Improving Web Search Results Using Affinity Graph Benyu Zhang, Hua Li, Yi Liu, Lei Ji, Wensi Xi, Weiguo Fan, Zheng Chen, Wei-Ying Ma Microsoft Research.
21/11/20151Gianluca Demartini Ranking Clusters for Web Search Gianluca Demartini Paul–Alexandru Chirita Ingo Brunkhorst Wolfgang Nejdl L3S Info Lunch Hannover,
Ranking Link-based Ranking (2° generation) Reading 21.
CSE 450 – Web Mining Seminar Professor Brian D. Davison Fall 2005 A Presentation on When Experts Agree: Using Non-Affiliated Experts to Rank Popular Topics.
1 1 COMP5331: Knowledge Discovery and Data Mining Acknowledgement: Slides modified based on the slides provided by Lawrence Page, Sergey Brin, Rajeev Motwani.
Liangjie Hong and Brian D. Davison Department of Computer Science and Engineering Lehigh University SIGIR 2009.
A Classification-based Approach to Question Answering in Discussion Boards Liangjie Hong, Brian D. Davison Lehigh University (SIGIR ’ 09) Speaker: Cho,
Hongbo Deng, Michael R. Lyu and Irwin King
“In the beginning -- before Google -- a darkness was upon the land.” Joel Achenbach Washington Post.
Intelligent Database Systems Lab Presenter: CHANG, SHIH-JIE Authors: Longzhuang Li, Yi Shang, Wei Zhang 2002.ACM. Improvement of HITS-based Algorithms.
ASSOCIATIVE BROWSING Evaluating 1 Jinyoung Kim / W. Bruce Croft / David Smith for Personal Information.
1 13/05/07 1/20 LIST – DTSI – Interfaces, Cognitics and Virtual Reality Unit The INFILE project: a crosslingual filtering systems evaluation campaign Romaric.
Venue Recommendation: Submitting your Paper with Style Zaihan Yang and Brian D. Davison Department of Computer Science and Engineering, Lehigh University.
11 A Classification-based Approach to Question Routing in Community Question Answering Tom Chao Zhou 1, Michael R. Lyu 1, Irwin King 1,2 1 The Chinese.
CSE 450 – Web Mining Seminar Professor Brian D. Davison Fall 2005 A PRESENTATION on What is this Page Known for? Computing Web Page Reputations D. Rafiei.
Leveraging Knowledge Bases for Contextual Entity Exploration Categories Date:2015/09/17 Author:Joonseok Lee, Ariel Fuxman, Bo Zhao, Yuanhua Lv Source:KDD'15.
Block-level Link Analysis Presented by Lan Nie 11/08/2005, Lehigh University.
1 Random Walks on the Click Graph Nick Craswell and Martin Szummer Microsoft Research Cambridge SIGIR 2007.
Navigation Aided Retrieval Shashank Pandit & Christopher Olston Carnegie Mellon & Yahoo.
Context-Sensitive IR using Implicit Feedback Xuehua Shen, Bin Tan, ChengXiang Zhai Department of Computer Science University of Illinois, Urbana-Champaign.
1 CS 430 / INFO 430: Information Retrieval Lecture 20 Web Search 2.
Query Type Classification for Web Document Retrieval In-Ho Kang, GilChang Kim KAIST SIGIR 2003.
Xiang Li,1 Lili Mou,1 Rui Yan,2 Ming Zhang1
DATA MINING Introductory and Advanced Topics Part III – Web Mining
HITS Hypertext-Induced Topic Selection
A Comparative Study of Link Analysis Algorithms
A Classification-based Approach to Question Routing in Community Question Answering Tom Chao Zhou 22, Feb, 2010 Department of Computer.
Query Type Classification for Web Document Retrieval
Presentation transcript:

Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and Engineering Lehigh University Bethlehem, PA USA

Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009

Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries

Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance

Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance user interactions!

Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance user interactions! 23 millions resolved questions!

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August – 10 of 17, 702

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Resolved

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Earth Science & Geology Physics

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Problems

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 same or similar questions different category different time Problems

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Problems Read Read them all? Trust Trust them all?

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers content user reputation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers content user reputationuser reputation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 HITS-like scheme User Answerer Questioner

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 HITS-like scheme User questioner - hub answerer - authority

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User random jump ?

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User probability of interaction

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics Profile User Profile

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics User

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics α -> stay 1- α -> jump topic User

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump User

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics User α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Other heuristics Z-score Linear combination

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Dataset & Evaluation Yahoo Answers! 14,122 questions + 45,814 answers 12,731 users Strict & Relaxed MRR, MAP BM25 + User Reputation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Strict Evaluation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Relaxed Evaluation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Relaxed Evaluation

Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 user reputation helps retrieval topic modeling makes sense but… question answering link direction Conclusion

SIN August 2009 Thank you! Questions? Contact Info: Liangjie Hong WUME Laboratory Computer Science and Engineering Lehigh University Bethlehem, PA USA Liangjie Hong, Zaihan Yang and Brian D. Davison