Chapter 4: Distinguishing Mixed Methods Designs Purpose: To distinguish mixed methods studies by design features like timing and priority.

An Introduction to Fully Integrated Mixed Method Research Goals of the Chapter Present a classification system that distinguishes basic types of mixed method studies. Identify priority as a key feature that distinguishes mixed method studies. Review a widely used notation system that represents timing and priority. 4. Describe the design features of an exemplary publication. 5. Review design features of QUAL, QUANT, and equal priority studies. An Introduction to Fully Integrated Mixed Method Research

The Meaning of the Word Design Design – A thoughtfully constructed link between the purposes of of a research study and the strategies used to implement it. An Introduction to Fully Integrated Mixed Method Research

Key Features that Distinguish Mixed Method Design: Priority & Timing PRIORITY – conventionally defined to distinguish three types of studies: those where the most weight or attention is given to (a) the QUANT phase, (b) the QUAL phase, or (c) where the phases are given equal priority. A fourth priority: mixed priority is introduced in this chapter. TIMING – conventionally been conceived primarily in terms of two-phase studies. refers to the timing of data collection and whether data from the first phase is required in a subsequent phase. Research is conventionally conceived as occurring in four phases: (1) design, (2) data collection, (3) data analysis, and (4) drawing of conclusions. An Introduction to Fully Integrated Mixed Method Research

Key Features that Distinguish Design: TIMING Concurrent – QUAL and QUANT data are collected simultaneously or independently. Sequential – the research is conducted in two phases with the data collection in the second phase linked in some way on the first phase. Multi-phase – the research is conducted in more than two phases with some interdependence between the phases. EXAMPLES of a concurrent design: A survey with both close-ended (QUANT) questions and open-ended (QUAL) questions. EXAMPLES of a sequential design: Focus groups are conducted in the first phase in order to develop and administer a survey in the second phase. EXAMPLES of a multi-phase design: Survey data is collected from different types of groups, analyzed for key factors which are then used to collect and analyze data to construct detailed case studies. An Introduction to Fully Integrated Mixed Method Research

Timing- Distinguishing Two-Phase Studies EXPLANATORY – first phase is quantitative; second qualitative EXPLORATORY- first phase is qualitative; second phase quantitative QUANT QUAL QUAL QUANT An Introduction to Fully Integrated Mixed Method Research

Second Design Feature: Priority The most weight or attention is giving to QUANT phase QUAL phase Both phases given equal weight We consider a fourth priority in the next chapter. An Introduction to Fully Integrated Mixed Method Research

The Morse Notation System Insert Table 4.2 Morse Notation System In the Morse notation system, priority is designated by capitalization; sequential timing by an arrow; concurrent time by a plus sign An Introduction to Fully Integrated Mixed Method Research

An Introduction to Fully Integrated Mixed Method Research Evidence of a Quantitative Priority from Content Analyses of Eight Studies This pie chart summarizes results from Table 4.3 An Introduction to Fully Integrated Mixed Method Research

Explaining the Prevalence of a QUANT Priority Some mixed methods designs, like the development design (for instrument development) are inherently QUANT. Most studies that involve Random Control Trials (RCTs) are inherently QUANT. QUANT studies are easier to publish and to get funded. Random control trials are rare in education. They involve the random assignment of subject to a treatment group and generally include a no-treatment group. An Introduction to Fully Integrated Mixed Method Research

Priority as a Key Feature of Mixed Method Designs An Introduction to Fully Integrated Mixed Methods Research

Why is Priority Important Provides a common unit of analysis to compare mixed methods articles. With timing, a features that is frequently used to distinguish designs. Points to relevant evaluation criteria. Contributes to the ability to trace a conclusion to the source of data (or analytical procedure). An Introduction to Fully Integrated Mixed Methods Research

Signs of Priority that Reflect an Overriding Logic* *Title *Reflexive statements about paradigm *Purpose statement *Space allocated to QUAL and QUANT in the results and/or the discussion/conclusions sections. Predominance of methodological language. Weight of QUAL, QUANT, mixing in the final conclusions. The first four items in the list come from: Creswell, Shope, Plano Clark, & Green (2006). Creswell, J. W., Shope, R., Plano Clark, V. L., & Green, D. O. (2006). How interpretive qualitative research extends mixed methods research. Research in Schools, 13 (1), 1-11. The fifth item recognizes an additional type of priority: mixed An Introduction to Fully Integrated Mixed Methods Research

Mixed Method Studies with Unequal Priority- Characteristics Phase Design Characteristics DESIGN PHASE: Purpose Statement & Research Questions Presence of only one type of research question (QUAL or QUANT) Over-riding purpose that points to QUAL or QUANT dominance INFERENCE PHASE: Meta-inference Major conclusions drawn from either QUANT or QUAL; no meta- inferences INFERENCE PHASE: Discussion and Conclusion Section More space devoted to either QUAL or QUANT An Introduction to Fully Integrated Mixed Methods Research

Mixed Method Studies with a QUAL Priority Phase Design Characteristics DESIGN PHASE: Purpose Statement & Research Questions Focus on the perceptions of participants; strong exploratory phase INFERENCE PHASE: Meta-inference Conclusions derive mostly from QUAL analysis. INFERENCE PHASE: Discussion and Conclusion Section More space is devoted to the QUAL findings. *When not explicitly stated by authors An Introduction to Fully Integrated Mixed Methods Research

Mixed Method Studies with a QUANT Priority Phase Design Characteristics DESIGN PHASE: Purpose Statement & Research Questions Designed to test theory (confirmatory); interested in the relationship between variables and prediction INFERENCE PHASE: Meta-inference Conclusions derive largely from analysis of QUANT data. INFERENCE PHASE: Discussion and Conclusion Section More space is devoted to the QUANT results. *When not explicitly stated by authors An Introduction to Fully Integrated Mixed Methods Research

Indicators of Equal Priority Phase Design Characteristics DESIGN PHASE: Purpose Statement & Research Questions Both QUAL and QUANT research questions INFERENCE PHASE: Meta-inference Conclusions derive from both QUAL and QUANT analysis INFERENCE PHASE: Discussion and Conclusion Section Separate sections address the QUAL and QUANT. May be no mixing. This is not the same thing as MIXED PRIORITY. An Introduction to Fully Integrated Mixed Methods Research

An Introduction to Fully Integrated Mixed Method Research Design Features of the Exemplary Publication (i.e. Catallo, Ciliska, & MacMillan., 2013) Design Feature Rationale/Purpose Complementarity Priority Equal Timing of Data Collection Separate, Sequential Timing of Data Analysis QUANT QUAL Qual/Quant Mixing Fully Integrated- Mixing at all Stages Catallo, C., J., S. M., Ciliska, D., & MacMillan, H. L. (2013). Mixing a grounded theory approach with a randomized controlled trial related to intimate partner violence: What challenges arise for mixed methods research? Nursing Research and Practice, 1-12. doi:10.1155/2013/798213 An Introduction to Fully Integrated Mixed Method Research

Exemplar – The Meta Inference Signals Equal Priority QUANT Conclusion: Women who experienced the most intimate partner violence were least like to disclose it to emergency personnel. QUAL Conclusion: The reluctance to disclose was associated with the fear of stigma. META INFERENCE: Women who experienced the most intimate partner violence were least likely to disclose it to emergency room personnel because of the fear of stigmatization. Catallo, C., J., S. M., Ciliska, D., & MacMillan, H. L. (2013). Mixing a grounded theory approach with a randomized controlled trial related to intimate partner violence: What challenges arise for mixed methods research? Nursing Research and Practice, 1-12. doi:10.1155/2013/798213 This meta inference links the QUAL and QUANT results. An Introduction to Fully Integrated Mixed Method Research

A Fourth Possible Priority: Some Indicators of a Mixed Priority Design Characteristics DESIGN PHASE: Purpose Statement & Research Questions Contains QUAL, QUANT, and a mixing research questions. INFERENCE PHASE: Meta-inference Conclusions derive primarily from analysis that blends or mixed QUAL and QUANT data. INFERENCE PHASE: Discussion and Conclusion Section There is a separate section in the results devoted to mixing. In this chapter, the discussion has been consistent with previous literature in the focus on three types of priority (QUAL, QUANT, or EQUAL). In the next chapter, we consider the addition of a fourth type of priority: MIXED PRIORITY. An Introduction to Fully Integrated Mixed Methods Research

An Introduction to Fully Integrated Mixed Method Research Review Questions Which mixed method priority (QUAL, QUANT, or EQUAL) is most prevalent? In the traditional notation system, how is priority represented? In the traditional notation system, how is timing represented? How is timing described in studies where QUAL and QUANT data are collected at the same time? How is timing described in studies where QUAL and QUANT data are collected in two different phases? ANSWERS 1. Mixed method priority that is most prevalent: QUANT 2. How priority is represented: with capitalization 3. How is timing represented: with either an arrow or comma 4. The name of the timing when QUAL and QUANT data are collected simultaneously: concurrent 5. The name of timing when QUAL and QUANT data are collected in two different phases: sequential An Introduction to Fully Integrated Mixed Method Research

An Introduction to Fully Integrated Mixed Method Research Next Chapter We shift in the next chapter to the first of three chapters about mixing. In Chapter 5, the focus is mixing at sampling and during data collection. Jenny Blass, 2016 An Introduction to Fully Integrated Mixed Method Research