Presentation is loading. Please wait.

Presentation is loading. Please wait.

EXPERIENCE SAMPLING VASSILIS JAVED KHAN PANOS MARKOPOULOS THE METHOD AND ITS TOOLS.

Similar presentations


Presentation on theme: "EXPERIENCE SAMPLING VASSILIS JAVED KHAN PANOS MARKOPOULOS THE METHOD AND ITS TOOLS."— Presentation transcript:

1 EXPERIENCE SAMPLING VASSILIS JAVED KHAN PANOS MARKOPOULOS THE METHOD AND ITS TOOLS

2 INDUSTRIAL DESIGN DEPARTMENT INDEX ESM: definition, uses & tools Why is there a need for another ES tool? ESRM & Reconexp Our plans for developing a better ES tool

3 INDUSTRIAL DESIGN DEPARTMENT ESM HISTORY Early 1970s pagers were introduced University of Chicago wanted to study flow experiences What were the most enjoyable moments of participants day

4 INDUSTRIAL DESIGN DEPARTMENT ESM DEFINITION A method to solicit respondents answers at random moments of the day [Hektner J.M., Schmidt J.A., Csikszentmihalyi M.,, Experience Sampling Method, Measuring the quality of everyday life, 2007, SAGE, ISBN ] ESM is a survey method, i.e. a way to collect self-reported data from participants that is executed over sustained periods of time Computerized ESM

5 INDUSTRIAL DESIGN DEPARTMENT WHERE/HOW ESM IS USED? Psychology & Social psychology Feelings of people Activities and what makes them happy Medical Assessing the burden of different illnesses The health consequences of stress Political For evaluating policies HCI, UX & design Assessing the experience of a service or a product Eliciting requirements for a service or a product

6 INDUSTRIAL DESIGN DEPARTMENT ON MY WAY TO LEIDEN…

7 INDUSTRIAL DESIGN DEPARTMENT ON MY WAY TO LEIDEN… How accurate? How easy?

8 INDUSTRIAL DESIGN DEPARTMENT

9 INDUSTRIAL DESIGN DEPARTMENT

10 INDUSTRIAL DESIGN DEPARTMENT

11 INDUSTRIAL DESIGN DEPARTMENT DRAWBACKS & BENEFITS OF ESM –Self-selection bias –Nonresponse and selective nonresponse –Obtrusive –High cost of implementation +Extremely rich data over time (subjective +objective data)

12 INDUSTRIAL DESIGN DEPARTMENT RELATED TOOLS GENERIC Academia MyExperience DPUIS PMAT ESP PsychLab Commercial Entyware by Techneos CUSTOM (for a single study)

13 INDUSTRIAL DESIGN DEPARTMENT MyExperience (beta) FEATURES XML Questionnaire development Availability of several sensors (GPS, device usage information) Supports photo, video and audio capture Plug-in architecture Windows Mobile devices

14 INDUSTRIAL DESIGN DEPARTMENT MyExperience XML example

15 INDUSTRIAL DESIGN DEPARTMENT FUTURE ES TOOL Why another tool? Conditions are right: truly affordable Shortcomings of previous tools New methodological developments

16 INDUSTRIAL DESIGN DEPARTMENT CONDITIONS ARE RIGHT: More people have powerful devices Globally, research house Ovum expects million smartphones to ship this year, up 23% on 2008 and about 15% of the worldwide mobile phone market in 2009 [reuters.com]

17 INDUSTRIAL DESIGN DEPARTMENT CONDITIONS ARE RIGHT: Internet on mobile devices is now affordable

18 INDUSTRIAL DESIGN DEPARTMENT PREVIOUS TOOLS SHORTCOMINGS Difficult to install Too technical to execute Little support Need of expensive devices

19 INDUSTRIAL DESIGN DEPARTMENT NEW METHODOLOGICAL DEVELOPMENTS Providing feedback to participants improves their motivation [Hsieh, G., Li, I., Dey, A., Forlizzi, J., and Hudson, S. E Using visualizations to increase compliance in experience sampling. UbiComp '08] Reconstruction of sampling day [Khan, V.J., Markopoulos, P., Eggen, B., de Ruyter, B., IJsselsteijn, W.A. (2008) Reconexp: A way to reduce the data loss of the Experiencing Sampling Method, MobileHCI '08] Defining inconvenient times [Isomursu, M., Tähti, M., Väinämö, S., and Kuutti, K Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int. J. Hum.-Comput. Stud. 65, 4 (Apr. 2007), ]

20 INDUSTRIAL DESIGN DEPARTMENT RECONEXP STUDY: OUR EXPERIENCE RECON STRUCTING EXP ERIENCE A first tool supporting the ESRM method

21 INDUSTRIAL DESIGN DEPARTMENT GOAL Investigate communication needs of busy parents (under context) What information are busy parents willing to automatically exchange with each other during a typical day of theirs?

22 INDUSTRIAL DESIGN DEPARTMENT

23 INDUSTRIAL DESIGN DEPARTMENT

24 INDUSTRIAL DESIGN DEPARTMENT

25 INDUSTRIAL DESIGN DEPARTMENT

26 INDUSTRIAL DESIGN DEPARTMENT METHOD EXPERIENCE SAMPLING + DAY RECONSTRUCTION

27 INDUSTRIAL DESIGN DEPARTMENT DAY RECONSTRUCTION

28 INDUSTRIAL DESIGN DEPARTMENT RESULTS Busy parents are willing to automatically exchange information which will help them to: Infer the availability of partner Feel reassured about the well being of family members Help coordinate tasks in the evening

29 INDUSTRIAL DESIGN DEPARTMENT Frequency of chosen information statements

30 INDUSTRIAL DESIGN DEPARTMENT SITUATIONAL DATA ANALYSIS

31 INDUSTRIAL DESIGN DEPARTMENT SITUATIONAL DATA ANALYSIS

32 INDUSTRIAL DESIGN DEPARTMENT RECONEXP SUMMARY Supports personalization of available answers Supports feedback to participants Supports filling out unanswered queries

33 INDUSTRIAL DESIGN DEPARTMENT WHAT WOULD NEXT ES TOOL LOOK LIKE?

34 INDUSTRIAL DESIGN DEPARTMENT TOOL COMPONENTS Questionnaire Developer Event triggering editor Choice of presentation medium (mobile | pc) Real time feedback to participants Data analysis & Visualization tools Notification manager (participant and researcher) Methodology wizard Experience granularity Participants state of mind-based triggering of queries Emphasis is on mobile studies

35 INDUSTRIAL DESIGN DEPARTMENT INTERESTING? ESRM.ID.TUE.NL

36 INDUSTRIAL DESIGN DEPARTMENT ESRM Experience Sampling and Reconstruction Method A method combining ESM with DRM

37 INDUSTRIAL DESIGN DEPARTMENT DAY RECONSTRUCTION DRM respondents first revive memories of the previous day by constructing a diary consisting of a sequence of episodes. Then they describe each episode by answering questions about the situation and about the feelings that they experienced, as in experience sampling. [Kahneman, Daniel, Alan B. Krueger, David A. Schkade, Norbert Schwarz and Arthur A. Stone A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method. Science. 306:5702, pp. 1776–780.] Shortcomings: data for one day, requires one-to-one access with participant

38 INDUSTRIAL DESIGN DEPARTMENT PLATFORM? Windows Mobile Blackberry iPhone Palm Nokia

39 INDUSTRIAL DESIGN DEPARTMENT CRITERIA Market share Development tools Cost Form factor

40 INDUSTRIAL DESIGN DEPARTMENT


Download ppt "EXPERIENCE SAMPLING VASSILIS JAVED KHAN PANOS MARKOPOULOS THE METHOD AND ITS TOOLS."

Similar presentations


Ads by Google