1. Module 6: QUAL, QUANT, & MM Research Questions EDRE 5674: Introduction to Mixed Methods

2. Differences between a Purpose Statement and Research Questions Purpose statements are broad, overarching statements about the purpose of a study. In MM, except for in the embedded design where one type of method is acknowledged to be dominant, they should be written in such a way as to be method neutral. In a MM study, high quality studies have 3 research questions: A QUAL, a QUANT, and a mixed question. These are not method neutral. EDRE 5674: Intro to Mixed Methods Research 2

3. Purposes of Research Questions Derive from and extend the study’s purpose. Set boundaries for a study; narrow the focus. Provide a framework for organizing the results. EDRE 5674: Intro to Mixed Methods Research 3

4. Two Different Viewpoints about RQ Dictate the methods (Viewpoint 1 described in Plano Clark & Badiee). Provide a dynamic link or hub between the study’s purpose, guiding theories and beliefs, methods, and results (Viewpoint 2 described in Plano Clark & Badiee). EDRE 5674: Intro to Mixed Methods Research 4

5. Three Different Strategies for Writing MM Research Questions Approach 1: By Method 1.QUANT (confirmatory) 2.QUAL (exploratory) 3.Mixed (integrate QUAL and QUANT during analysis) Approach 2: By Type 1.What Questions 2.How or Why Questions Approach 3: By Phase or Strand of Data Collection 1.Phase 1 2.Phase 2 3.Phase 3 EDRE 5674: Intro to Mixed Methods Research 5

6. Three Kinds of Research Questions Fit the Definition of Scientifically Based Research* 1.DESCRIPTIVE RQ (often QUAN) : What is going on? What happened? What are the outcomes? 2.CAUSAL RQ (generally QUAL): Why did this happen? 3.PROCESS RQ (generally QUAL): How did it happen? *From: Margaret Eisenhart and Lisa Towne, “Contestation and Change in National Policy on ‘Scientifically Based’ Education Research.” Educational Researcher, Oct. 2003, pp. 31-38. EDRE 5674: Intro to Mixed Methods Research 6

7. RQ from the Ivankova & Stick (2006) Article by PHASE Organized by phases: RQ1: (QUAN/Survey) What variables from a quantitative survey serve as predictors to students’ persistence in the program? RQ2: (QUAL) What does an in-depth exploration of four cases add to our understanding of internal and external factors that are critical to persistence in the program? EDRE 5674: Intro to Mixed Methods Research 7

8. Pagano et al. 2002 Concurrent Design 1.PHASE 1: Data collection – both QUAL and QUANT 2.PHASE 2; Data analysis – identify themes in QUAL 3.PHASE 3: Data analysis – mixing – in all research questions EDRE 5674: Intro to Mixed Methods Research 8

9. RQ by Phase: Pagano et al (2002) RQ Rewritten RQ1 (MIXING): What is the correlation between the QUANT parenting scales and the themes identified inductively in the open ended part of the survey? (Table 1) RQ2 (MIXING): Is there a significant difference by race of the parent in the teaching themes identified? (Table 2) RQ3 (MIXING). Do demographic characteristics predict the QUAL themes? EDRE 5674: Intro to Mixed Methods Research 9

10. Evaluation Research: Examples of RQ by Type RQ 1: Was the intervention/strategy effective? (e.g. What are the outcomes?) – What are the characteristics of the group of people who received the most benefit from the intervention? RQ 2: What are patients’ views about why or how an intervention was or was not effective ? (e.g. process questions) EDRE 5674: Intro to Mixed Methods Research 10

11. Ways to Evaluate the Quality of a Set of MM Research Questions 1.Language. Appropriate methodological language (“signal terms” ) is used. 2. Conceptual clarity. The method for collecting data at each phase is clear. The central phenomenon is clearly identified. 3. Congruence. The questions are clearly linked. They generally pursue different aspects of the same phenomenon. 4. Integration. The questions explicitly identify how the QUAL and QUANT will be mixed during analysis. EDRE 5674: Intro to Mixed Methods Research 11

12. QUAL/QUANT Language QUANT language – Predict – Determine – Impact, affect – Significant – Hypothesis – Relationship between QUAL language – Discover – Perceive, perceptions – Explore – Identify EDRE 5674: Intro to Mixed Methods Research 12

13. Examples of Language Mismatches Supposedly QUAL question: What is the effect of parents on student’s career aspirations? How do parents influence student’s career aspirations? Better way to write the QUAL questions: – What do students say influence their career aspirations? EDRE 5674: Intro to Mixed Methods Research 13

14. Assignment To pick one organizational approach (by method, type, or phase) and write the first draft of three research questions for your proposal that keeps the quality standards in mind. EDRE 5674: Intro to Mixed Methods Research 14