Presentation is loading. Please wait.

Presentation is loading. Please wait.

Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and.

Similar presentations


Presentation on theme: "Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and."— Presentation transcript:

1 Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and Engineering Lehigh University Bethlehem, PA USA

2 Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009

3 Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries

4 Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance

5 Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance user interactions!

6 Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009 natural language vs. short queries best answers vs. relevance user interactions! 23 millions resolved questions!

7 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009

8 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 1 – 10 of 17, 702

9 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Resolved

10 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Earth Science & Geology Physics

11 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Problems

12 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 same or similar questions different category different time Problems

13 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Problems Read Read them all? Trust Trust them all?

14 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers

15 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers content user reputation

16 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Finding high quality answers content user reputationuser reputation

17 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 HITS-like scheme User Answerer Questioner

18 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 HITS-like scheme User questioner - hub answerer - authority

19 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User

20 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User random jump ?

21 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User

22 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 PageRank-like scheme User probability of interaction

23 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics Profile User Profile

24 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics User

25 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics α -> stay 1- α -> jump topic User

26 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump User

27 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Incorporating topics User α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump

28 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Other heuristics Z-score Linear combination

29 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Dataset & Evaluation Yahoo Answers! 14,122 questions + 45,814 answers 12,731 users Strict & Relaxed Precision@1, MRR, Precision@10, MAP BM25 + User Reputation

30 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Strict Evaluation

31 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Relaxed Evaluation

32 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 Relaxed Evaluation

33 Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009 user reputation helps retrieval topic modeling makes sense but… question answering link direction Conclusion

34 SIN August 2009 Thank you! Questions? Contact Info: Liangjie Hong hongliangjie@lehigh.edu WUME Laboratory Computer Science and Engineering Lehigh University Bethlehem, PA 18015 USA Liangjie Hong, Zaihan Yang and Brian D. Davison


Download ppt "Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and."

Similar presentations


Ads by Google