Getting In Focus a focus group primer for libraries by Jan Figurski for OLA Superconference 2005.

Slides:



Advertisements
Similar presentations
Chapter 14: Usability testing and field studies
Advertisements

Focusing an Evaluation Ben Silliman, Youth Development Specialist NC 4-H Youth Development.
Working with an Outside Agency to Conduct a Community Survey Burlington Public Librarys Experience Burlington Public Library Melanie SouthernOLA Session.
The National Center on Addiction and Substance Abuse at Columbia University ®
Program Evaluation. Overview and Discussion of: Objectives of evaluation Process evaluation Outcome evaluation Indicators & Measures Small group discussions.
Hidden and misunderstood? Experiences of disability support for learners in post-16 education.
How to Apply for an Interlibrary Cooperation Grant from the Alaska State Library March 23, 2013 Alaska Library Association Conference Valdez.
Anonymous Services, Hard to Reach Participants, and Issues around Outcome Evaluation Centre for Community Based Research United Way of Peel Region Roundtable.
Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
Focus Groups Are… Directed group discussions about topics of interest The group is usually not naturally- occurring Usually strangers recruited by the.
Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.
What is Primary Research and How do I get Started?
Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
The Landscape of Educational Research
An Introduction to Focus Groups Peter Harper. Focus Groups are Group Interviews Focus group interviews are characterised by: having a clear focus involving.
Research Plan: Using Data to Create Impactful Pride Campaigns
Second Legislated Review of Community Treatment Orders Ministry of Health and Long-Term Care November 9, 2012.
Changes in Library Usage, Usability, & User Support Denise A. Troll Distinguished Fellow, Digital Library Federation Associate University Librarian, Carnegie.
Kresge Business Administration Library 1 EVALUATING VIDEO TUTORIALS: Measuring Excellence And Outcomes Sally Ziph Instruction Coordinator Kresge Business.
Topics: Interviewing Question Type Interviewing techniques
Focus Groups for the Health Workforce Retention Study.
Business research methods: data sources
Management 11e John Schermerhorn
PPA 502 – Program Evaluation Lecture 4a – Qualitative Data Collection.
Collecting Basic Evaluation Information Chapter Six cont…
Efsa LEARNING PROGRAMME Module 4 - Session 4.5a Non - Probability Sampling Methods.
UOFYE Assessment Retreat
1 Evaluation. 2 Evaluating The Organization Effective evaluation begins at the organizational level. It starts with a strategic plan that has been carefully.
Good Customer Service Needs Good People Management.
Orientation Project Implementation Reporting & Sustainability Testing Efficacy To Ensure Applicability and Impact Module 3, Unit 3, Sub-Unit 1, Session.
Qualitative Research Methods
Information and planning that make the difference.
WHAT IS “CLASS”? A BRIEF ORIENTATION TO THE CLASS METHODOLOGY.
Library User Studies Hsin-liang Chen SLIS, Indiana University.
Questionnaires and Interviews
Data Analysis for Evaluation Eric Graig, Ph.D.. Slide 2 Innovation Network, Inc. Purpose of this Training To increase your skills in analysis and interpretation.
Introduction Methodology Results This study aims to explore the current progress of using different types of software with various autism conditions. One.
Literature Review and Parts of Proposal
Step 6: Implementing Change. Implementing Change Our Roadmap.
Research methodology Data Collection tools and Techniques.
Do it pro bono. Strategic Scorecard Service Grant The Strategy Management Practice is presented by Wells Fargo. The design of the Strategic Scorecard Service.
Qualitative Analysis Information Studies Division Research Workshop Elisabeth Logan.
From Recruitment to Evaluation: How to Build and Maintain an Exceptional Board Matt Kouri | President and Executive Director TEXAS ASSOCIATION OF COMMUNITY.
MAC Fall Symposium: Learning What You Want to Know and Implementing Change Elizabeth Yakel, Ph.D. October 22, 2010.
Incorporating an Evaluation Plan into Program Design: Using Qualitative Data Connie Baird Thomas, PhD Linda H. Southward, PhD Colleen McKee, MS Social.
Using Needs Assessment to Build A Strong Case for Funding Anna Li SERVE, Inc.
The Process of Conducting Research
Usability, the User Experience & Interface Design: The Role of Reference July 30, 2013.
EXPLORATORY RESEARCH INITIAL RESEARCH CONDUCTED TO CLARIFY AND DEFINE THE NATURE OF A PROBLEM DOES NOT PROVIDE CONCLUSIVE EVIDENCE SUBSEQUENT RESEARCH.
Conducting Usability Tests 4 Step Process. Step 1 – Plan and Prep Step 2 – Find Participants Step 3 – Conduct the Session Step 4 – Analyze Data and Make.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
NATIONAL MENTAL HEALTH SERVICES COLLABORATIVE Report of Independent Evaluation Presentation – 7 th February 2012 NATIONAL MENTAL HEALTH SERVICES COLLABORATIVE.
Learning Focused Observations BEST Leadership Roundtable February 1 st, 2012.
PRIMARY MARKET RESEARCH Rehabilitation Engineering Research Center on Technology Transfer Training Module #4.
Evaluation Proposal Defense Observations and Suggestions Yibeltal Kiflie August 2009.
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Eleven Watching And Listening: Qualitative Research For In-depth Understanding.
Marketing Research Approaches. Research Approaches Observational Research Ethnographic Research Survey Research Experimental Research.
Evaluation and Designing
Strategic Research. Holiday Inn Express Stays Smart What research results led to an upgrade of all Holiday Inn Express bathrooms? How did their agency,
Making your resources accessible to more learners.
CM220 College Composition II Friday, January 29, Unit 1: Introduction to Effective Academic and Professional Writing Unit 1 Lori Martindale, Instructor.
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
ENHANCING THE PATIENT EXPERIENCE THROUGH VOLUNTEER SERVICES Presented By: Jennifer Thayer, SPHR, SHRM-SCP.
Week 2: Interviews. Definition and Types  What is an interview? Conversation with a purpose  Types of interviews 1. Unstructured 2. Structured 3. Focus.
{ Focus Groups An Assessment Tool in Student Affairs Image Retrieved from:
So You Think You’ve Made a Change? Developing Indicators and Selecting Measurement Tools Chad Higgins, Ph.D. Allison Nichols, Ed.D.
Developing a proposal Dónal O’Mathúna, PhD Senior Lecturer in Ethics, Decision-Making & Evidence
1 International Institute of Business Analysis Vision: The world's leading association for Business Analysis professionals” Mission: To develop and maintain.
IENG 451 / 452 Voice of the Customer: Collecting VOC information
IENG 451 / 452 Voice of the Customer: Analysis (KANO, CTQ)
Presentation transcript:

Getting In Focus a focus group primer for libraries by Jan Figurski for OLA Superconference 2005

Objectives Provide an introduction to focus group methodology Describe how libraries can benefit from using focus groups Provide resources for further study

Focus groups are a form of structured interview that utilizes communication between participants to generate data. - Kitzinger (1995) involves group interaction in discussion generates qualitative data used to create insight and understanding

History 1950s – Communication studies in film and television. 1960s – Marketing and commercial product development. 1980s – Social, behavioural & health sciences. 1990s – Library applications

Library studies using focus groups 1990 – –

Focus Group Survey No. of libraries responding: 176 No. of libraries using FG: 43(24%) No. of libraries not using FG:133(76%) Havent used FG but intend to:103(77%) - Glitz (1995)

Observations from the Literature Libraries well-suited to benefit from focus groups Focus groups underutilized in libraries

Focus group studies used for: evaluating services & collections performing needs assessments setting financial or program priorities determining user satisfaction strategic planning; clarifying goals and values developing and evaluating web and catalog interfaces developing and evaluating user education or reference services understanding user communities understanding staff needs in organizational change designing new facilities testing survey research design ; clarifying survey results

Having conducted [hundreds] of focus groups in all kinds of libraries and institutions – public libraries, school boards, university libraries, hospital and health libraries, government libraries – I am now a great believer in the power of focus groups and feel that they are under-used. - Cavill (2002)

Focus Group Methodology Planning: identify problem, clarify purpose, plan ahead. Recruitment: who, what criteria, how many, what incentives Moderating & Conducting: logistics, roles, topics/questions Analysis: data, data, data, debriefing reporting

Planning Define the purpose and outcomes of project Identify staffing resources required Develop timelines Develop budget Develop recruitment plan Establish and book locations, dates, times, equipment, catering Identify roles, and draft questions Determine analysis plan, and reporting requirements

Recruitment Define target population and its segments Identify the composition of each group Develop eligibility and exclusion criteria Develop screening and invitation scripts for direct or indirect contact Make initial contacts Determine procedures for follow up

When to use smaller groups: high level of involvement with topic by participants participants are experts purpose is to get detailed stories topic is complex, controversial, emotional When to use larger groups: lower level of involvement with topic goal is to hear numerous suggestions/points of view

How Many Groups? Until you achieve theoretical saturation Understanding a diverse populations ideas on a complex topic will involve more groups Caution against using only one group

Moderating & Conducting Location Moderator role Question development

Funnel Approach Top of funnel: 1 or 2 broad, open-ended questions Middle: 3 or 4 central topics Bottom: 4 to 6 specific questions End: 1 summary question

Focus Group Flow Setup Participants arrive Welcome and introduction Opening questions: 1. When you think about using library materials, what is the first thing you do? 2. How do you go about getting the information you need?

Focus Group Flow Topical questions: 3. Think back to the last time you found material that you were looking for. What do you think made your approach successful, and what if anything, made it difficult? 4. Think back to the last time you were unable to locate the material you were looking for. What do you think were the reasons you were unsuccessful?

Focus Group Flow Specific questions: 5. What types of materials do you use most (list types) and how do you find them? 6. What is your experience in finding materials on the library shelves? 7. What are your experiences with the checkout, renewal and return procedures of the library? 8. What has been your experience with using (name of online catalog) or the librarys web site to access electronic resources? 9. What do you do if you are unable to find something that you expect to be in the library?

Focus Group Flow Ending questions: 10. All things considered, what do you think are the most important things the library can do to make materials and information easier to retrieve? 11. What one change to improve the reliability of the library would you make? Closure Debrief

Analysis Organize session notes, tapes, transcripts, and debriefing notes Analyze and code data to determine key findings Organize the findings to match the format of the final report Prepare final report for presentation

Sample Quotes and Coding My training session, the librarian got called away after half an hour and didnt complete it. My orientation was given by a person who was the only person at the desk. All I did was watch them answer questions. Yeah, I hate it when Im the only one on the desk. I hate it when the system is being backed up and you cant get access to anything. How can you keep up with all the new systems? Im uncomfortable dealing with people who have disabilities. We just dont have the tools to give them much help. You spend all this time teaching them, and then they dont follow your advice anyway.

Time Spent Analyzing Data >>>> transcript based – tape based – notes based – memory based

Use focus groups when: - your goal is to listen and learn - you can explore through conversation - you can obtain knowledge by listening - your purpose is to identify problems - your purpose is to plan for programs, surveys or quality initiatives - your purpose is to improve program implementation - your purpose is to assess program outcome - you need a friendly, respectful research method

Avoid focus groups when: - your purpose is selling, educating, or negotiating - you cannot hold a focused discussion because of the breadth of the topic or the size of the group - you need strong predictors of behaviour - the participants cannot really speak to the topic (e.g. non-users) - you need statistical data (from: The Focus Group Kit, Morgan et al, 1998)