Observation & Think-Aloud Protocol Qualitative Research.

Slides:



Advertisements
Similar presentations
Conducting Focus Groups
Advertisements

Conducting Focus groups ACE seminar teaching session By Susan Mlangwa.
User Experience Design Making things for people..
How do you know if your brochure is effective with the targeted audience? Usability research: explores how users interact with a product such as a brochure.
Experiential Learning Cycle
* is a cluster of specific instructional strategies that involve students working collaboratively to reach common goals;
6.811 / PPAT: Principles and Practice of Assistive Technology Wednesday, 16 October 2013 Prof. Rob Miller Today: User Testing.
The Behaviors of Coaching A Roadmap to Teacher Reflection Liz Norton SAM Conference 2013.
Observing Users Paul Bogen, LaShon Johnson, Jehoon Park.
Proposed plan for the summative evaluation of a Technology Enhanced Learning Project Dean Petters, Statement of the research question Participants Method.
© De Montfort University, 2001 Questionnaires contain closed questions (attitude scales) and open questions pre- and post questionnaires obtain ratings.
Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research group School of Information.
Energy Information Administration Usability Testing Colleen Blessing.
Observation, Focus Groups, and Other Qualitative Measures
Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.
Connecting Literature with the California Science Standards Strategic Science Teaching Grade One – Earth Science 1 SST 1st/Earth Science.
Facilitating Focus Groups Insert date Insert presenters.
Copyright © 2014 by The University of Kansas Conducting Focus Groups.
Damian Gordon.  Summary and Relevance of topic paper  Definition of Usability Testing ◦ Formal vs. Informal methods of testing  Testing Basics ◦ Five.
DATA ANALYSIS IN QUALITATIVE RESEARCH Review - DATA COLLECTION METHODS= before I analyze, I must collect 1. usually data is collected by the use of two,
Interviews By Darelle van Greunen.
User Interface Evaluation Usability Inquiry Methods
Market Research Techniques for Libraries An Infopeople Workshop Presented by Joan Frye Williams
Conducting an Interview
COSIA 2010 Communicating Ocean Sciences to Informal Audiences WEEK 12: Assessments & Reflections.
Gathering User Data IS 588 Dr. Dania Bilal Spring 2008.
Protocols for Mathematics Performance Tasks PD Protocol: Preparing for the Performance Task Classroom Protocol: Scaffolding Performance Tasks PD Protocol:
Chapter 12 Observing Users Li, Jia Li, Wei. Outline What and when to observe Approaches to observation How to observe How to collect data Indirect observation.
This slide presentation is Confidential and Proprietary to ProtoTest LLC.
Educational Action Research Todd Twyman Summer 2011 Week 2.
©2010 John Wiley and Sons Chapter 6 Research Methods in Human-Computer Interaction Chapter 6- Diaries.
Qualitative Research Interviews March 25, What Are Qualitative Interviews? “…attempts to understand the world from the subjects' point of view,
Content-Area Writing Chapter 10 Writing for Tests and Assessments Darcey Helmick EIWP 2013.
Evaluating Teacher Training changing classroom practices Richard Lambert, Ph.D.
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
COMP5047 Pervasive Computing: 2012 Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research.
Case Study Presented by: Becky, Christy, Jolee, and Veronica.
ELA Common Core State Standards. Hunt Institute Videos  GLI&feature=mfu_in_order&list=UL.
User Interface Design & Usability for the Web Card Sorting You should now have a basic idea as to content requirements, functional requirements and user.
Interactive Revision Strategies Steve Pendleton Yvonne Kind Warwickshire LA.
Qualitative Observation User Study - Guerrilla Practical WORKshop by Dominika Potuzakova.
Patron Self-Sufficiency Teaching Patrons How to Fish Presented by Jenny Thurman and Eva Webster.
Chapter 23 Deciding how to collect data. UIDE Chapter 23 Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions –Automatic Logging.
Reflective Thinking. Reflective thinking Critical thinking and reflective thinking are often used synonymously. However, where critical thinking is used.
Workshop, dialogue-how to start?. THEME/ HOW TO INITIATE A DIALOGUE? HOW TO REACT IN A DIALOGUE?
Communicating with Your Boss Be a Leader… ISO-405-PD-EV-1202-V1.0.
Searching and Using Electronic Literature III. Research Design.
Steps in Planning a Usability Test Determine Who We Want To Test Determine What We Want to Test Determine Our Test Metrics Write or Choose our Scenario.
Sports Market Research. Know Your Customer How do businesses know their customers needs and wants?  Ask them/talking to customers  Surveys  Questionnaires.
Evaluation / Usability. ImplementDesignAnalysisEvaluateDevelop ADDIE.
CONDUCTING FOCUS GROUPS TRACY ARWARI, PH.D., ED.D. STUDENT SUCCESS OFFICER.
Virtually unknown: web conferences as a tool for teacher development Caroline Moore [Tony Fisher & Eric Baber]
School of Engineering and Information and Communication Technology KIT305/607 Mobile Application Development Week 7: Usability (think-alouds) Dr. Rainer.
User Interface Evaluation
Interviews & focus groups
Establishing an Active Classroom
What is it? This is our recommendation of how to spend each hour when revising. Why? Students can engage in ineffective revision which can limit their.
Interviews & focus groups
1.
HINT: It is not the subject of your essay
Chapter 23 Deciding how to collect data
Finding Trends with Visualizations
Rakhymzhanova Bayan, Center of Excellence, Kazakhstan
Building Context for the Narrative: The Abolition Movement
RESEARCH TOOLS OR INSTRUMENTS
Interviews & focus groups
A quick guide to understanding and conducting a usability study.
Interviews & focus groups
Empirical Evaluation Data Collection: Techniques, methods, tricks Objective data IRB Clarification All research done outside the class (i.e., with non-class.
Human-Computer Interaction: Overview of User Studies
Presentation transcript:

Observation & Think-Aloud Protocol Qualitative Research

Quantitative research tells us “what” Qualitative can help us explain “why” and “how” What are our patrons thinking & feeling- what do they like or not like and why? How can we better understand their experiences?

Think-Aloud

Possible Topics for Think-Aloud Information-seeking behavior Research strategies Usability/navigation Information Interaction Human-Computer Interaction

Think-Aloud Involve subject in actual or pre-determined tasks Subject engages in task: explains what they are doing and why What they are thinking How they feel Researcher observes process/actions and takes notes Prompt subject to verbalize

Observation & Think-Aloud AdvantagesChallenges Captures short term memory Immediate feedback Opportunities for clarification Low-tech requirements Depends on subject’s ability to verbalize while working Actions and reactions might be affected by the process itself Recruitment of subjects

Planning for Research Define the problem or research question What do you want to know What do you want to learn Develop a set of questions to answer Design activities for subjects Pre-test Recruit subjects Give-aways Prizes Class credit

Facilities Doesn’t require fancy technology! Computer, researcher (or two), and subject Usability Lab Screen-capture technology Eye-capture technology Transaction Log Video and audio taping Two-way mirror

Engaging in the Research Allow subject leeway- try not to guide Prompt subject to talk as necessary Ask clarifying questions Take copious notes Separate observation from analysis/interpretation Debrief immediately afterward

Taking Notes

Analysis of Data Read, re-read, and read again Look for patterns and themes Compare coding (inter-coder analysis) Revisit research questions Can you draw conclusions from your results? Next steps…

Questions? Activity Thank you!!!