1. LECTURE 16: (EVEN MORE) OPEN QUESTIONS IN VISUAL ANALYTICS December 9, 2015 SDS 235 Visual Analytics

2. Announcements Final Project Reception: Monday 6pm in Ford Atrium Confirmed attendees: MassMutual, WFWM, JRI, MITLL, various faculty scouting PhD students... Weekend Workshop Poll Winner: D3 Tutorial Final Project Write-ups: Due 22 December by 4:59pm (submit by email to jcrouser@smith.edu)

3. Details on Final Project Write-ups 1/2 Abstract and introduction: what is the big question your system answers? Who is it helping? Description of your data: what it looks like, where it came from, and how you collected it / enriched it A discussion of the visualization techniques you chose, and why they make sense for your application An evaluation of your system (this can be a self-evaluation, an expert critique, a user study: just justify the choice) Any future directions you would like to explore

4. Details on Final Project Write-ups 2/2 #chi4good: ACM Conference on Human Factors in Computing Systems – May 7-12 in San Jose, CAchi4good Deadline for Late-Breaking Work: 13 January 2016 Workshop on Exploring Social Justice, Design, and HCI (co-located with CHI’16)Exploring Social Justice, Design, and HCI Deadline for Submission: 8 January 2016 CAUSE/APA Undergrad Stats Class Project CompetitionUndergrad Stats Class Project Competition Deadline for Submission: 31 May 2016 …and many others! (see www.wikicfp.com for more)www.wikicfp.com

5. Discussion What do we know about Visual Analytics?

6. Discussion What are we still learning?

7. Lesson 1: Perception Matters Which of the following scatterplots shows a stronger correlation? Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.

8. Lesson 1: Perception Matters Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.

9. Lesson 1: Perception Matters Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.

10. Lesson 1: Perception Matters Harrison, Lane, et al. "Ranking visualizations of correlation using weber's law." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1943-1952.

11. Open Question: How Much? Kay, Matthew, and Jeffrey Heer. "Beyond Weber's Law: A Second Look at Ranking Visualizations of Correlation." Visualization and Computer Graphics, IEEE Transactions on 22.1 (2016): 469-478.

12. Lesson 2: Individual Differences Matter Brown, Eli T., et al. "Finding waldo: Learning about users from their interactions." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1663-1672.

13. Lesson 2: Individual Differences Matter Brown, Eli T., et al. "Finding waldo: Learning about users from their interactions." Visualization and Computer Graphics, IEEE Transactions on 20.12 (2014): 1663-1672.

14. Open Question: When and How? Ottley, Alvitta, Huahai Yang, and Remco Chang. "Personality as a Predictor of User Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations." Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015.

15. Open Question: When and How? Ottley, Alvitta, Huahai Yang, and Remco Chang. "Personality as a Predictor of User Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations." Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015.

16. Lesson 3: Improving Memorability Bateman, Scott, et al. "Useful junk?: the effects of visual embellishment on comprehension and memorability of charts." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2010.

17. Lesson 3: Improving Memorability Borkin, Michelle, et al. "What makes a visualization memorable?." Visualization and Computer Graphics, IEEE Transactions on 19.12 (2013): 2306-2315.

18. Open Question: Does Memorability Matter? “Visualizations don’t need to be designed for memorability – they need to be designed for comprehension. For most visualizations, the comprehension that they provide need only last until the decision that it informs is made. Usually, that is only a matter of seconds. When the comprehension has lasting value, it should be stored in memory, not the visualization.” “Information Visualization Research as Pseudo-Science.” Stephen Few, Perceptual Edge. Visual Business Intelligence Newsletter, October/November/December 2015

19. Lesson 4: Complementary Strengths Crouser, R. Jordan, and Remco Chang. "An affordance-based framework for human computation and human-computer collaboration." Visualization and Computer Graphics, IEEE Transactions on 18.12 (2012): 2859-2868.

20. Open Question: How Do We Measure It? Crouser, R. Jordan, Alvitta Ottley, and Remco Chang. "Balancing Human and Machine Contributions in Human Computation Systems." Handbook of Human Computation. Springer New York, 2013. 615-623.

21. Open Question: How Do We Measure It?

24. Closing Thoughts?