MyRoR: From sensors to stories Dana Pavel University of Essex 17 March

Main goals Create systems that provide better support for self-reflection and self-understanding Involve the user in all aspects: data collection, interpretation, correlation and visualization 2

From sensors to stories Current self-monitoring systems used for lifestyle management do not offer enough insight into why something happened; they mainly focus on recording what happened. For that, we need more diverse information, more meaningful correlations and... We need better visualizations capable to capture such diverse information 3

4 Environmental noise level Battery level (phone) Signal strength (phone) Devices around (BT, WLAN- based) Location (GPS, cell ID, country code, WLAN based) URLs visited ECG/Heart rate 3-axis accelerom eter Event button (user pressed) data Calendar event Keystrokes Application context Time Mental context (interest, focus, etc.) Availability context (people or resource) Physical context (position, direction, distance, speed, proximity) Temporal context (absolute, relative, duration) Activity context Emotional context Social context (communicati on, identity)

5

Visualizations in self-monitoring systems 6

7 Daily story Visualizations for information collected and derived stored in the personal database Information collected on demand from remote servers Calendar-based interface

Story creation with Scratch/BYOB 8

9

10

Detailed visualizations 11

User evaluations Online survey available at: User experiments ongoing focusing on: 1. What information is perceived as more useful 2. What correlations are perceived as more useful 3. How do people want to interact with the system 4. Personalized story creation 5. Explore WHY people consider certain events meaningful (based on the event button) 12

Thank you! 13 Contact info: PAL project:

Background 14

MyRoR System Scenario 15

Information modelling 16

17 Environmental noise level Battery level (phone) Signal strength (phone) Devices around (BT, WLAN-based) Location (GPS, cell ID, country code, WLAN based) URLs visited ECG/Heart rate 3-axis accelerometer Event button (user pressed) data Calendar event Keystrokes Application context (open/active/closed) Timestamps Topic (subject/ content) Sender/ receiver Topic (subject/cont ent) Participants Location Start/end time Mental context (interest, focus, etc.) Availability context (people or resource) Crowdness (number of people/devices around) Physical context (position, direction, distance, speed, proximity) Temporal context (absolute, relative, duration) Activity context Emotional context Information processing Social context (communication, identity)

Scratch elements 18 Scripts can run in parallel, testing various conditions and using Scratch elements to create the story

Story creation 19 Behaviour scripts are created for each sprite