1. The Event Quartet: How Visual Analytics Works for Temporal Data Ben Shneiderman Founding Director ( ), Human-Computer Interaction Lab Professor, Department of Computer Science Member, Institute for Advanced Computer Studies

2. Information Visualization: Data Types
InfoViz SciViz.
1-D Linear Document Lens, SeeSoft, Info Mural
2-D Map GIS, ArcView, PageMaker, Medical imagery
3-D World CAD, Medical, Molecules, Architecture
Multi-Var Spotfire, Tableau, Qliktech, Visual Insight
Temporal EventFlow, TimeSearcher, Palantir, DataMontage
Tree Cone/Cam/Hyperbolic, SpaceTree, Treemap
Network Pajek, UCINet, NodeXL, Gephi, Tom Sawyer
Text TagClouds, Wordle, Google Ngram Viewer
flowingdata.com visualcomplexity.com eagereyes.org infovis.org visualisingdata.com perceptualedge.com
infovis-wiki.net thedailyviz.com

3. Anscombe’s Quartet 1 2 3 4 x y
10.0
8.04
9.14
7.46
8.0
6.58
6.95
8.14
6.77
5.76
13.0
7.58
8.74
12.74
7.71
9.0
8.81
8.77
7.11
8.84
11.0
8.33
9.26
7.81
8.47
14.0
9.96
8.10
7.04
6.0
7.24
6.13
6.08
5.25
4.0
4.26
3.10
5.39
19.0
12.50
12.0
10.84
9.13
8.15
5.56
7.0
4.82
7.26
6.42
7.91
5.0
5.68
4.74
5.73
6.89

4. Anscombe’s Quartet Property Value 1 2 3 4 x y 10.0 8.04 9.14 7.46 8.0
6.58
6.95
8.14
6.77
5.76
13.0
7.58
8.74
12.74
7.71
9.0
8.81
8.77
7.11
8.84
11.0
8.33
9.26
7.81
8.47
14.0
9.96
8.10
7.04
6.0
7.24
6.13
6.08
5.25
4.0
4.26
3.10
5.39
19.0
12.50
12.0
10.84
9.13
8.15
5.56
7.0
4.82
7.26
6.42
7.91
5.0
5.68
4.74
5.73
6.89
Property
Value
Mean of x 
9.0
Variance of x
11.0
Mean of y 
7.5
Variance of y 
4.12
Correlation
0.816
Linear regression
y = x

5. Anscombe’s Quartet

6. EHRs: Temporal data Numerical Events Stock: Microsoft
04/26/ :
04/26/ :
04/26/ :
04/26/ :
04/26/ :
Numerical time series, for example stock price over time, is a series of time and numerical value, in this case, the stock price.
Temporal categorical data, for example the patients transfer data, a series of time and categorical value.
Explain patient transfer
A valued pair of time and category is called an event.
Throughout this presentation, triangles are used to represent events while colors are used to show the category

7. EHRs: Temporal data Numerical Events Categorical Events
Stock: Microsoft
Patient ID:
04/26/ :
04/26/ :
04/26/ :
04/26/ :
04/26/ :
12/02/ :26 Arrival
12/02/ :36 Emergency 12/02/ :44 ICU
12/05/ :07 Floor
12/14/ :19 Exit
Numerical time series, for example stock price over time, is a series of time and numerical value, in this case, the stock price.
Temporal categorical data, for example the patients transfer data, a series of time and categorical value.
Explain patient transfer
A valued pair of time and category is called an event.
Throughout this presentation, triangles are used to represent events while colors are used to show the category
Time
Arrival
Emergency
ICU
Floor
Exit

8. Event Quartet: 1 Record ID Event Timestamp Alpha Green 8/7/2016 12:39
8/8/ :35
8/9/ :39
8/10/ :37
8/11/ :47
8/12/ :31
8/13/ :34
8/14/ :29
8/15/ :29
8/17/ :34
8/18/ :33
8/19/ :29

9. Regular with one missing: Daily school attendance with one absence
Event Quartet: 1
Record ID
Event
Timestamp
Alpha
Green
8/7/ :39
8/8/ :35
8/9/ :39
8/10/ :37
8/11/ :47
8/12/ :31
8/13/ :34
8/14/ :29
8/15/ :29
8/17/ :34
8/18/ :33
8/19/ :29
Regular with one missing: Daily school attendance with one absence

10. Event Quartet: 2 Record ID Event Timestamp Alpha Orange 8/8/2016 12:00
8/9/ :00
8/10/ :00
8/11/ :00
8/12/ :00
8/15/ :00
8/16/ :00
8/17/ :00
8/18/ :00
8/19/ :00
8/22/ :00
8/23/ :00

11. Event Quartet: 2
Record ID
Event
Timestamp
Alpha
Orange
8/8/ :00
8/9/ :00
8/10/ :00
8/11/ :00
8/12/ :00
8/15/ :00
8/16/ :00
8/17/ :00
8/18/ :00
8/19/ :00
8/22/ :00
8/23/ :00
Cyclic: Regular pattern, e.g. high activity on website during weekdays, but not on weekends

12. Event Quartet: 3 Record ID Event Timestamp Alpha Purple 8/8/2016 12:39
8/8/ :35
8/8/ :39
8/8/ :37
8/9/ :47
8/9/ :31
8/10/ :34
8/12/ :29
8/14/2016 3:44
8/18/ :33
8/26/ :29
9/7/2016 7:03

13. Slowdown: Fewer events per unit time, e.g. earthquake aftershocks
Event Quartet: 3
Record ID
Event
Timestamp
Alpha
Purple
8/8/ :39
8/8/ :35
8/8/ :39
8/8/ :37
8/9/ :47
8/9/ :31
8/10/ :34
8/12/ :29
8/14/2016 3:44
8/18/ :33
8/26/ :29
9/7/2016 7:03
Slowdown: Fewer events per unit time, e.g. earthquake aftershocks

14. Event Quartet: 4 Record ID Event Timestamp Alpha Gray 8/8/2016 12:39
8/9/ :35
8/10/ :39
8/10/ :57
8/10/ :27
8/10/ :31
8/13/ :34
8/14/ :29
8/16/2016 3:44
8/16/2016 4:33
8/16/2016 7:29
8/18/2016 7:03

15. Event Quartet: 4
Record ID
Event
Timestamp
Alpha
Gray
8/8/ :39
8/9/ :35
8/10/ :39
8/10/ :57
8/10/ :27
8/10/ :31
8/13/ :34
8/14/ :29
8/16/2016 3:44
8/16/2016 4:33
8/16/2016 7:29
8/18/2016 7:03
Irregular pattern: Occasional clusters and random events, e.g. tweets on a given hashtag

16. Event Quartet: Multiple Event Types
Record ID
Event
Timestamp
Alpha
Orange
8/7/ :29
Green
8/7/ :35
Brown
8/7/ :37
8/8/ :37
8/8/ :42
8/9/ :31
8/9/ :34
8/9/ :29
8/10/ :29
8/10/ :34
8/11/ :33
8/11/ :29

17. Event Quartet: Multiple Event Types
Record ID
Event
Timestamp
Alpha
Orange
8/7/ :29
Green
8/7/ :35
Brown
8/7/ :37
8/8/ :37
8/8/ :42
8/9/ :31
8/9/ :34
8/9/ :29
8/10/ :29
8/10/ :34
8/11/ :33
8/11/ :29
Regular pattern with exceptions: Orange, green & brown events, e.g. breakfast, lunch, & dinner with two missed meals

18. Event Quartet: Multiple Event Types

19. Multiple Records, Single Event Types

20. Multiple Records, Multiple Event Types

21. LifeLines2 (David Wang) LifeFlow (Krist Wongsuphasawat)
Thanks!
Catherine Plaisant
LifeLines
LifeLines2 (David Wang)
LifeFlow (Krist Wongsuphasawat)
EventFlow (Megan Monroe, Chris Imbriano)
 Sana Malik, Fan Du, etc.
CoCo (Sana Malik)
EventAction & PeerFinder (Fan Du)
Sponsors: NIH, Oracle, CHIB, Adobe, Leidos

22. hcil.umd.edu/eventflow
@benbendc
hcil.umd.edu/eventflow