1. 1 Opinion Integration and Summarization ChengXiang (“Cheng”) Zhai Department of Computer Science Graduate School of Library & Information Science Institute for Genomic Biology Department of Statistics University of Illinois, Urbana-Champaign Joint work with Qiaozhu Mei (U. Mich), Yue Lu (UIUC), Hyun Duk Kim (UIUC)

2. Effective Information Sharing 2 Information Sharing Network Decision=? Information Need Summary ? Information Nuggets

3. Opinion Integration & Summarization 3 Information Nuggets Opinion Integration Sentiment Analysis Contradictory Opinion Analysis [Lu & Zhai 08] [Mei et al. 07] [Kim & Zhai 09]

4. 4 1. Opinion Integration [Lu & Zhai WWW 08] cute… tiny…..thicker.. last many hrs die out soon could afford it still expensive Design Battery Price.. Topic: iPod Expert review with aspects Scattered opinions Integrated Summary Design Battery Price Design Battery Price iTunes … easy to use… warranty …better to extend.. SimilarSupplementary Input Output

5. 5 Sample Integration Result: iPhone Review articleSimilar opinionsSupplementary opinions You can make emergency calls, but you can't use any other functions… N/A[10] … methods for unlocking the iPhone have emerged on the Internet in the past few weeks, although they involve tinkering with the iPhone hardware… rated battery life of 8 hours talk time, 24 hours of music playback, 7 hours of video playback, and 6 hours on Internet use. [19] iPhone will Feature Up to 8 Hours of Talk Time, 6 Hours of Internet Use, 7 Hours of Video Playback or 24 Hours of Audio Playback [7] Playing relatively high bitrate VGA H.264 videos, our iPhone lasted almost exactly 9 freaking hours of continuous playback with cell and WiFi on (but Bluetooth off).

6. 6 Extra Aspects from Blogs supportSupplementary opinions on extra aspects 15You may have heard of iASign … an iPhone Dev Wiki tool that allows you to activate your phone without going through the iTunes rigamarole. 13Cisco has owned the trademark on the name "iPhone" since 2000, when it acquired InfoGear Technology Corp., which originally registered the name. 13With the imminent availability of Apple's uber cool iPhone, a look at 10 things current smartphones like the Nokia N95 have been able to do for a while and that the iPhone can't currently match...

7. 7 Blog Coverage of Review Aspects 7

8. 8 2. Multi-Faceted Sentiment Summary [Mei et al. WWW 07] query=“Da Vinci Code” NeutralPositiveNegative Facet 1: Movie... Ron Howards selection of Tom Hanks to play Robert Langdon. Tom Hanks stars in the movie,who can be mad at that? But the movie might get delayed, and even killed off if he loses. Directed by: Ron Howard Writing credits: Akiva Goldsman... Tom Hanks, who is my favorite movie star act the leading role. protesting... will lose your faith by... watching the movie. After watching the movie I went online and some research on... Anybody is interested in it?... so sick of people making such a big deal about a FICTION book and movie. Facet 2: Book I remembered when i first read the book, I finished the book in two days. Awesome book.... so sick of people making such a big deal about a FICTION book and movie. I’m reading “Da Vinci Code” now. … So still a good book to past time. This controversy book cause lots conflict in west society.

9. 9 Separate Theme Sentiment Dynamics “book” “religious belief”

10. 10 Probabilistic Topic-Sentiment Model kk 11 22 B Facet  1 Facet  k Facet  2 … Background B Choose a facet (subtopic)  i battery 0.3 life 0.2.. nano 0.1 release 0.05 screen 0.02.. apple 0.2 microsoft 0.1 compete 0.05.. Is 0.05 the 0.04 a 0.03.. … love 0.2 awesome 0.05 good 0.01.. suck 0.07 hate 0.06 stupid 0.02.. P N P F NP F N P F N battery love hate the

11. 11 3. Summarization of Contradictory Opinions [Kim & Zhai CIKM 09] NeutralPositiveNegative Facet 1: Movie... Ron Howards selection of Tom Hanks to play Robert Langdon. Tom Hanks stars in the movie,who can be mad at that? But the movie might get delayed, and even killed off if he loses. Directed by: Ron Howard Writing credits: Akiva Goldsman... Tom Hanks, who is my favorite movie star act the leading role. protesting... will lose your faith by... watching the movie. After watching the movie I went online and some research on... Anybody is interested in it?... so sick of people making such a big deal about a FICTION book and movie. Facet 2: Book I remembered when i first read the book, I finished the book in two days. Awesome book.... so sick of people making such a big deal about a FICTION book and movie. I’m reading “Da Vinci Code” now. … So still a good book to past time. This controversy book cause lots conflict in west society. How can we help analysts digest and interpret contradictory opinioons?

12. Contrastive Opinion Summarization 12 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4

13. Contrastive Opinion Summarization 13 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 u1u1 u2u2 ukuk … v1v1 v2v2 vkvk … Contrastive Opinion Summary

14. Problem Formulation 14 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 u1u1 u2u2 ukuk … U v1v1 v2v2 vkvk … V Contrastiveness Representativeness

15. Problem Formulation 15 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 u1u1 u2u2 ukuk … U v1v1 v2v2 vkvk … V Contrastiveness Representativeness

16. Summarization as Optimization 1. Define an appropriate content similarity function Ф 2. Define an appropriate contrastive similarity function ψ 3. Solve the optimization problem efficiently. 16

17. Sample Results NoPositiveNegative 1oh... and file transfers are fast & easy. you need the software to actually transfer files 2i noticed that the micro adjustment knob and collet are well made and work well too. the adjustment knob seemed ok, but when lowering the router, i have to practically pull it down while turning the knob. 3the navigation is nice enough, but scrolling and searching through thousands of tracks, hundreds of albums or artists, or even dozens of genres is not conducive to save driving difficult navigation - i wo n’t necessarily say " difficult,“ but i do n’t enjoy the scrollwheel to navigate. 4i imagine if i left my player untouched (no backlight) it could play for considerably more than 12 hours at a low volume level. there are 2 things that need fixing first is the battery life. it will run for 6 hrs without problems with medium usage of the buttons. 17

18. Sample Result NoPositiveNegative 1oh... and file transfers are fast & easy. you need the software to actually transfer files 2i noticed that the micro adjustment knob and collet are well made and work well too. the adjustment knob seemed ok, but when lowering the router, i have to practically pull it down while turning the knob. 3the navigation is nice enough, but scrolling and searching through thousands of tracks, hundreds of albums or artists, or even dozens of genres is not conducive to save driving difficult navigation - i wo n’t necessarily say " difficult,“ but i do n’t enjoy the scrollwheel to navigate. 4i imagine if i left my player untouched (no backlight) it could play for considerably more than 12 hours at a low volume level. there are 2 things that need fixing first is the battery life. it will run for 6 hrs without problems with medium usage of the buttons. 18 Different polarities of opinions made from different perspectives.

19. Sample Result NoPositiveNegative 1oh... and file transfers are fast & easy. you need the software to actually transfer files 2i noticed that the micro adjustment knob and collet are well made and work well too. the adjustment knob seemed ok, but when lowering the router, i have to practically pull it down while turning the knob. 3the navigation is nice enough, but scrolling and searching through thousands of tracks, hundreds of albums or artists, or even dozens of genres is not conducive to save driving difficult navigation - i wo n’t necessarily say " difficult,“ but i do n’t enjoy the scrollwheel to navigate. 4i imagine if i left my player untouched (no backlight) it could play for considerably more than 12 hours at a low volume level. there are 2 things that need fixing first is the battery life. it will run for 6 hrs without problems with medium usage of the buttons. 19 Positive vs. negative Not much disagreement

20. Sample Result NoPositiveNegative 1oh... and file transfers are fast & easy. you need the software to actually transfer files 2i noticed that the micro adjustment knob and collet are well made and work well too. the adjustment knob seemed ok, but when lowering the router, i have to practically pull it down while turning the knob. 3the navigation is nice enough, but scrolling and searching through thousands of tracks, hundreds of albums or artists, or even dozens of genres is not conducive to save driving difficult navigation - i wo n’t necessarily say " difficult,“ but i do n’t enjoy the scrollwheel to navigate. 4i imagine if i left my player untouched (no backlight) it could play for considerably more than 12 hours at a low volume level. there are 2 things that need fixing first is the battery life. it will run for 6 hrs without problems with medium usage of the buttons. 20 Judgments revealing detailed conditions

21. Summary 21 Information Nuggets Opinion Integration Sentiment Analysis Contradictory Opinion Analysis [Lu & Zhai 08] [Mei et al. 07] [Kim & Zhai 09]

22. Future Plan Incorporate trustworthiness of sources in opinion integration Analyze opinions in context and discover topic communities Suggest opportunities for information sharing “Soft” policy of information sharing 22

23. 23 References Opinion integration: [WWW 08] Y. Lu and C. Zhai. Opinion integration through semi-supervised topic modeling. In WWW ’08: Proceeding of the 17th international conference on World Wide Web, pages 121–130, New York, NY, USA, 2008. Sentiment analysis: [WWW 07] Q. Mei, X. Ling, M. Wondra, H. Su, and C. Zhai. Topic sentiment mixture: modeling facets and opinions in weblogs. In WWW ’07: Proceedings of the 16th international conference on World Wide Web, pages 171–180, New York, NY, USA, 2007. Contradictory opinion summarization: [CIKM 09] H. Kim, C. Zhai, Generating Comparative Summaries of Contradictory Opinions in Text, In Proceedings of CIKM 2009, to appear.

24. Questions/Comments/ Suggestions? 24 http://apps.facebook.com/news_letters/

25. 1. Content Similarity Function : term similarity function 25 Sentence 1 Sentence 2 great short has Itbatterytime batterylifeIsn’tThe

26. 1. Content Similarity Function : term similarity function 26 Sentence 1 Sentence 2 great short has Itbatterytime batterylifeIsn’tThe

27. 1. Content Similarity Function : term similarity function 27 Sentence 1 Sentence 2 great short has Itbatterytime batterylifeIsn’tThe

28. 2. Contrastive Similarity Function : term similarity function 28 Sentence 1 Sentence 2 great short has Itbatterytime batterylifeIsn’tThe

29. 3. Approximation Algorithms 29 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 Combinations

30. Strategy 1: Representativeness-First 30 x1x1 x4x4 xnxn … x3x3 X x2x2 x7x7 y1y1 y2y2 ymym … y4y4 Y y6y6 Find k cluster,

31. 31 x1x1 x4x4 xnxn … x3x3 X x2x2 x7x7 y1y1 y2y2 ymym … y4y4 Y y6y6 Find k cluster,  Find contrastive pairs u1u1 u2u2 ukuk … U v1v1 v2v2 vkvk … V Strategy 1: Representativeness-First

32. Strategy 2: Contrastiveness-First 32 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4

33. Strategy 2: Contrastiveness-First 33 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 Find contrastive pair, x1x1 xnxn x7x7 x3x3 y2y2 y4y4 y1y1 ymym … … x8x8 y5y5

34. Strategy 2: Contrastiveness-First 34 x1x1 x2x2 xnxn … x3x3 X x4x4 x5x5 y1y1 y2y2 ymym … y3y3 Y y4y4 Find contrastive pair,  Select representative pairs x1x1 xnxn x7x7 x3x3 y2y2 y4y4 y1y1 ymym … … x8x8 y5y5 k

35. Rep-First Outperforms Contrast-First 35

36. Contrastive Similarity Heuristic Works 36 Opt. Method PrecisionAspect Coverage RFCFRFCF WO0.5030.5370.7370.804 WO+all words0.4840.5310.7370.798 SEM0.5000.5400.763 SEM+all words0.4700.5070.7180.686 Removing sentiment words is beneficial