1. Qualitative SOTL Research Methods Brad Wuetherick, GMCTE Krista Trinder, ES&D, Medicine

2. Overview Today, we will explore: Characteristics of Qualitative Research (and the usefulness of the binary Qual. vs. Quant.) Different methods/tools used in Qualitative Research Different research methodologies Ensuring trustworthiness of qualitative research

3. Introduction Key Definitions: Methodologies – how we know the world or gain knowledge of it (expression of ontology and epistemology) Ontology – our most basic beliefs of the nature of reality (and what it means to be human) Epistemology – understanding of knowledge, what counts as knowledge, and on what basis we can make knowledge claims Methods – the practical tools for collecting and analyzing data

4. Educational Philosophy Personal educational philosophy impacts the ease with which people access different research paradigms Which description best describes your approach? (See handout)

5. Characteristics of Qualitative Research Quantitative-Qualitative distinction – is it a useful binary? All qualitative data can be interpreted quantitatively; all quantitative research requires qualitative judgment Both quant. and qual. research can be used in service of any paradigm (tools can often be used interchangeably)

6. Characteristics of Qualitative Research Naturalistic/interpretive –Study phenomena in natural settings –Meanings participants bring to phenomena Context-bound, lived experiences No fixed external reality Individuals’ values involved (researcher and participant) Relies on the collection of detailed data

7. Methods of Qualitative Research Interviews Focus Groups Observations Textual Analysis …

8. Interviews Types of Interviews – structured, semi- structured, unstructured Advantages: –Provides direct access to the social experience of the participants –data are rich both in terms of details and descriptions –flexibility – can be adjusted to each participant and evolved over time –Allows probing of participant answers to verify our understandings and explore unexpected issues

9. Interviews Disadvantages: –Data collection (and transcription) is time consuming –Results are not generalizable –Some interactions don’t work well –Potential inconsistencies between interviewers make comparisons hard –Social desirability, conformity, and power relations can ‘bias’ responses

10. Focus Groups Advantages: –Similar to interviews –Participants can develop opinions/thoughts by listening to others –Rapidity in gathering various opinions (5-10 participants normally) Disadvantages: –Group dynamic can be detrimental –Artificial setting –Leader’s attitude may affect dynamic –Excessive influence exerted by certain participants

11. Characteristics of a Good Interviewer/Facilitator Knowledgeable (familiar with the topic) Structuring (outlines procedure of interview) Clear (asks simple, easy, and short questions) Gentle (tolerant, sensitive and patient) Steering (able to control course of conversation to avoid digressions) Remembers (retains the subject information from interviewee) Interprets (provides interpretation of what is said for clarification)

12. Observations Types: –complete participant (non-disclosed) –participant observer (disclosed, peer) –non-participant observer (disclosed, non- peer) Establishing rapport: –Be unobtrusive –Be honest

13. Observations Levels of Observations: –Descriptive; Focused; Selective Based on Fieldnotes: –Descriptive – who is present; what are their roles; what is happening; when; how long; where; why; how is it organized; etc. –Reflective – reflections on analysis and method; points of clarification; reflections on observer’s frame of mind

14. Textual Analysis Participant writing (Journals, Autobiography) Historical Documents Websites Policy Documents Newspapers Letters …

15. Methodologies Phenomenology Grounded Theory Narrative Inquiry Ethnography Case Study Auto-Ethnography Phenomenography … (and the list goes on)

16. Phenomenology “The study of lived experience” Purpose – to uncover the meaning (essence) of a phenomenon, as it presents itself to conscious thought, through the lived experience of participants Requires researcher to suspend (as much as possible) pre-conceived notions of the reality of participants’ experiences and understand what the lived experience means to the participant Usually relies on multiple interviews/focus groups with key informants (and possibly observations)

17. Grounded Theory “The development of theory grounded in the data” Purpose – to develop a practical theory (explanations of a phenomenon) based (or grounded) in the data Different in that researchers hope the theories might be generalized to other settings Usually relies on interviews, which are analyzed (through constant comparison) to inform further waves of data collection and analysis, which eventually forms a theory

18. Narrative Inquiry “Using narrative to understand lived experience” Purpose – if we understand the world narratively, as we do, then it makes sense to study the world narratively Narrative is not embedded in the nature of phenomena, but rather is a heuristic device (a metaphor) useful for understanding phenomena – “Narrative is stories lived and told” Usually relies on interviews structured around story and reflection on lived experience (could be on reflective journals, autobiographies, etc.)

19. Ethnography “Science of writing about/describing cultural or social groups” Purpose – to discover the essence of a culture and its unique complexities Involves description and interpretation of the interaction of others in the context of a cultural/social group Usually relies on observation, interviews with key informants, and richly detailed descriptions

20. Trustworthiness Essentially means validity and reliability for qualitative analysis/data Sample questions that need to be addressed: –Do data and results reflect reality (ie. participants’ perspective)? –Can the findings be applied to other settings? –Are results consistent with data collected? –Given the data, would others concur with the findings? –Is the researcher a dependable instrument? –Was research conducted in an ethical manner?

21. Trustworthiness Methods for ensuring trustworthiness: –Triangulation –Member checks –Peer review –Researcher’s position –Prolonged and varied field experiences –Maximum variation –Audit trail –Thick descriptions

22. Choose Your Method See handout – “Considerations for Assessing Qualitative Research” Work independently Exchange thoughts and ideas: consult Leave at your own discretion Thank you! See you on October 28 (for more fun to do with Quantitative Methods)!