Cods 12 11
Cods 12 11
A b s t r ac t
Aim and objective: Describe the basics of the mixed-method type of research.
Background: Traditionally, the research has been quantitative in nature which provided measures for the parameter of interest. This was
followed by the era of qualitative research which helped in a detailed understanding of a phenomenon. This is especially important in healthcare
research as it also gives an account of the individual interaction with their environment which is a significant contributor to health. Around the
1970s, the concept of combining both these approaches was used in social sciences. Recently, this mixed-method approach was integrated
into health research and educators. However, there has been a continuing debate on the basic nature of this research design. Thus, a complete
understanding of this type of research is important.
Review results: Various authors described various purposes of the mixed-method approach. The main ones being triangulation, complementarity,
development, initiation, and expansion. Theoretical drives, timings, and point of integration are the three factors that need to be considered for
the development of studies using this design. Throughout times, different classifications for mixed-method studies have evolved, however, the
most accepted one, based on the utility and internal consistency is the classification by Creswell and Clarke. They describe four major designs
for mixed-method research as triangulation design, embedded design, explanatory design, and exploratory design. The application, principle,
variants, strengths, challenges, and examples of each have been described extensively in this article.
Conclusion and clinical significance: Mixed-method approach is a valuable research type as it capitalizes on the strength of both qualitative
and quantitative research. It is of significance in health research as it gives a broader range of perspectives to the complex phenomena studied.
Thus, proper knowledge of the basics is required to accurately combine and interpret findings of the qualitative and quantitative aspects. This
article is a contribution to this basic understanding of mixed-method research.
Keywords: Explanatory, Integration, Mixed-method, Qualitative, Quantitative.
CODS Journal of Dentistry (2020): 10.5005/jp-journals-10063-0065
B ac kg r o u n d 1,3
Department of Periodontics, School of Dentistry, Faculty of Medicine
Evolution of Mixed-method Approach and Dentistry, University of Alberta, Canada
2
Quantitative research was the only known research design in the Department of Pediatric Dentistry, School of Dentistry, Faculty of
19th century and was, therefore, most used.1 Quantitative data Medicine and Dentistry, University of Alberta, Canada
provide a measurement orientation in which data can be collected Corresponding Author: Disha Nagpal, Department of Periodontics,
from numerous individuals and assessed trends across large School of Dentistry, Faculty of Medicine and Dentistry, University of
Alberta, Canada, Phone: +1 204-899-4459, e-mail: dnagpal@ualberta.
geographic regions.2 At the turn of the 20th century, the theory of
ca
qualitative analysis came into being.1 Qualitative research provides
comprehensive details recorded in the participants’ voices and How to cite this article: Nagpal D, Kornerup I, Gibson MP. Mixed-
method Research: A Basic Understanding. CODS J Dent 2020;12(1):
contextualizes the contexts in which they have experiences and the
11–16.
meanings of their experiences.2 Between 1900 and 1950, there was
Source of support: Nil
a primary historical moment as described by Denzin and Lincoln
(2005) for qualitative research. It was then shortly after this era, that Conflict of interest: None
the concept was introduced of mixing the two approaches.1,3 Jick
(1979) first proposed the idea of combining methods as a way of
finding convergence between qualitative and quantitative methods This term is defined by Tashakkori and Creswell as “research
within the social sciences.4,5 Since the 1960s, research into mixed in which the investigator collects and analyzes data, integrates
methods has become more popular in many disciplines including the findings, and draws inferences using both qualitative and
health sciences and education.1 quantitative approaches or methods in a single study or a program
of inquiry”.7
R e v i e w R e s u lts and D i s c u s s i o n Mixed-method vs Multimethod
What is Mixed-method Research? Mixed-method research is kin of multimethod research which
Mixed-method research is the form of study in which a researcher combines either only numerous qualitative approaches or
contains elements of qualitative and quantitative research various quantitative approaches.8 Multimethod design involves
methods (e.g., using both qualitative and quantitative viewpoints, implementing two or more research methods in one project, each
a compilation of data, analysis, critical thinking techniques) for clear performed precisely and complete in itself. Then, the results are
understanding and substantiation functions.6 triangulated into a complete whole.9
© The Author(s). 2020 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://
creativecommons.org/licenses/by-nc/4.0/), which permits unrestricted use, distribution, and non-commercial reproduction in any medium, provided you give
appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons
Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Mixed-method Research: A Basic Understanding
Various integration points have been described by various • Multiphase design—In a research program that examines a total
authors. expected plan, more than two phases or both sequential and
For instance, Morse and Niehaus16 identified two possible concurrent strands are integrated over some time.
integration stages: at the level of the results and the level of the
Creswell and Clark emphasized that while there is a multitude of
analysis.
types as defined by many leading authors’ research, it is important
In the former, the second portion’s outcomes were applied to
to note that there are a variety of features and many names used
and merged into the first element. To promote this process, it is
by different authors. This leads to the conclusion that these
possible to use a joint show reporting all of the quantitative and
classifications have more similarities than variations.18
qualitative outcomes and a consolidated statement. However, in
Thus, because of these similarities, Creswell and Clark presented
the latter, the first analytical phase of a qualitative portion follows
a practical and internally consistent classification that had four
a second analytical phase in which the topics found in the first
major mixed-method designs, with variants within each type. These
analytical phase are quantified.
are the triangulation design, the embedded design, the explanatory
Other investigators like Teddlie and Tashakkori distinguished four
design, and the exploratory design.18
different stages of an investigation: the conceptualization stage, the
These are explained below in details under common
methodological experimental stage (data collection), the analytical
subheadings:
experimental stage (data analysis), and the inferential stage.17
By these authors, throughout all four stages, merging is feasible.
Nonetheless, to distinguish those ways of mixing, the four possible Triangulation Design
integration points employed by these writers are still too crude. Use
Experiential mixing can take various forms, such as using cognitive This concept is used to compare statistical findings in quantitative
interviews to refine a questionnaire (tool development) or choosing terms directly with qualitative findings or to verify or extend
people for an interview based on the results of the questionnaire quantitative results with qualitative data. Morse described that this
(sampling).17 could be used to acquire additional separate data on the related
A few of the basic ways to integrate the different elements are topic to best understand the research problem.14
as follows: It gives the means to corroborate the varying strengths and
non-overlapping shortcomings of quantitative methods (extensive
• Combining the two data sets.
sample size, trends, generalization) with those of qualitative
• Determining from the results of one data set, the collection of
methods (limited N, details, in-depth).20
the second information pool.
• Embedding one sort of information into a broader design or Procedure
procedure.
It is a one-phase system in which researchers apply quantitative
• Using a framework to tie the sets of data together (theoretical
and qualitative methods of equal status over the same timeframe.
or program).18
It typically requires the compilation and analysis of quantitative
Generally, mixing can take place at either one or all of the and qualitative data at the same time, but separately, so that the
following research steps: aim, research questions, theoretical drive, researcher can better understand the research issue.
methodology, data analysis, and results. The researcher tries to combine both data sets, usually by
putting together the different outcomes in the interpretation or
Mixed-method Research Designs by manipulating data to allow the convergence during the analysis
Considering all these factors, a variety of research designs have of the two data types.
been described.
Tashakkori and Teddlie (2003) presented an exhaustive list of Variants
35 mixed-method research designs.1,19 The different variants are the convergence model, the data
Following are the six “major mixed methods design” as transformation model, the validating quantitative data model, and
commonly used designs, described by Creswell and Plano Clark.18 the multilevel model.
• Convergent parallel design—Both the aspects are carried
Strengths Including Advantages
out separately, and the results are incorporated in the
comprehensive analysis. Good for the beginners in mixed-method research.
• Explanatory sequential design—Collecting and analyzing the Efficient architecture in which both data types are gathered at
data quantitatively is the first phase which is followed by the roughly the same point during one phase of the research.
qualitative aspect of the study. The qualitative data are used The individuals with both quantitative and qualitative
here to clarify the initial quantitative outcomes. proficiency can be included in the research type as both the
• Exploratory sequential design—It begins with accumulating quantitative and qualitative data are gathered and evaluated
the qualitative data which is followed by the collection of separately.
quantitative data to explore the initial qualitative results.
• Embedded design—This is a conventional qualitative or Disadvantages
quantitative design, a section of some other form is introduced Demands proficiency and effort as the data is gathered
to improve the overall design. simultaneously and the fact both the aspects of the study are
• Transformative design—A conceptual transforming structure equally important.
forms the qualitative and quantitative dimension of connection, The consequences of no agreement between the quantitative
priority, timing, and mixing, and qualitative results must be considered. At times, these
disparities can be difficult to overcome and may need other quantifiable generalizations, so a cross-sectional survey of dentists
supplementary data to be gathered. was also undertaken.
this phase will further be investigated in detail by the qualitative This method can be used for both multiphase and single
phase which means to understand why or why not the year of studies.
training affected the students’ clinical reasoning, interviews will
be conducted. Challenges
If we look closely at this process and explain it in terms of the The two-phase approach requires a significant amount of time to
factors required to design the mixed-method approach, as outlined incorporate.
at the beginning of this article, it will include: Researchers need to consider the aspect and build time into
the schedule for their analysis.
Theoretical Drive Researchers will explore whether the same individuals at both
There is a core component and a supplemental component of the the qualitative and quantitative phases should serve as participants.
study. Both quantitative and qualitative aspects relate equally to the The researcher will determine the data to use from the
awareness of this method for this review. Thus, this study would be qualitative process to create the quantitative method and how to
considered a qualitative-quantitative continuum, (or equal status) use the data to produce quantitative measures.
in terms of theoretical drive. Procedures should be followed to ensure the validity and
reliability of scores produced on the instrument.
Timings
Example
• In terms of the sequence: The quantitative phase is followed by
The research has described the experience of the parents of the
the qualitative stage, hence, sequential.
children feeling fearful for a dental visit. If a study is designed to
• In terms of dependency: The qualitative phase explains the
scale the stress of these parents, an exploratory mixed-method
results from the quantitative phase, so dependent.
approach will be needed.
First, the data will be collected qualitatively from these parents.
Point of Integration The themes emerging from the data will then be used to create a
In this study, it would occur at the methodological phase as well scale, which is tested for reliability and validity.
as the inferential stages. In the inferential stage, the results of both
these aspects will be integrated to answer the research question.
Thus, this is an example of an explanatory sequential mixed-
C o n c lu s i o n and Clinical Significance
method study design. Mixed-method studies are important to understand a process
completely. Mixed-method studies are gaining popularity in health-
Exploratory Design related research. Extensive work has been done in medicine and
Use nursing education using a mixed-method study design. However,
This two-phase exploratory design is used to help improve or its application to dental research is emerging especially among
inform the second (quantitative) method through the results of educators and policymakers. This literature review gives an insight
the first (qualitative) process. This design assumes that for one of into the basics needed to design and execute a mixed-method
many reasons an exploration is needed: metrics or instruments study.
are either not available or not suitable, the variables are uncertain,
or there is no guidance system or theory. As this approach begins References
qualitatively, the study of a phenomenon is ideally suited to this.15 1. Onwuegbuzie L. A typology of mixed methods research designs.
This design is especially useful when a researcher wants to Quality & Quantity 2009;43(2):265–275. DOI: 10.1007/s11135-007-
create and evaluate an instrument because one is not available or 9105-3.
recognizes significant variables to be tested quantitatively when the 2. Creswell JW, Garett AL. The “movement” of mixed methods research
parameters are unknown. This is also necessary to investigate forms and the role of educators. South Afr J Educat 2008;28(3):321–333. DOI:
of an emerging approach or concept or analyzing a phenomenon 10.15700/saje.v28n3a176.
in detail and then assess its popularity.14,24 3. Denzin NK, Lincoln YS. Introduction: The discipline and practice
of qualitative research. In: Denzin NK, Lincoln YS, ed., The Sage
Procedure handbook of qualitative research, Thousand Oaks, CA: Sage
Publications; 2005. pp. 1–32.
It is a two-phase approach and is often referred to as exploratory 4. Jick TD. Mixing qualitative and quantitative methods: triangulation
sequential design.21 To investigate a phenomenon, this design starts in action. Adm Sci Quarterly 1979;24(4):602–611. DOI: 10.2307/
with qualitative data and then builds on a second, quantitative level. 2392366.
5. Ostlund U, Kidd L, Wengstrom Y, et al. Combining qualitative and
Variants quantitative research within mixed method research designs: a
This design has two common variants: the instrument development methodological review. Int J of Nursing Studies 2011;48(3):369–383.
model and the taxonomy development model. DOI: 10.1016/j.ijnurstu.2010.10.005.
6. Johnson BR, Onwuegbuzie AJ, Turner LA. Toward a definition of
Strengths/advantages mixed methods research. J Mixed Methods Res 2007;1(2):112–133.
DOI: 10.1177/1558689806298224.
Ease of description, implementation, and reporting with this design
7. Tashakkori A, Creswell JW. Editorial. The new era of mixed methods.
as it is conducted in separate phases. J Mixed Methods Res 2007;1(1):3–7. DOI: 10.1177/2345678906293042.
Although the qualitative dimension is typically emphasized 8. Schoonenboom J, Johnson RB. How to construct a mixed methods
by this design, the inclusion of a quantitative aspect will make the research design. Köln Z Soziol 2017;69(Suppl 2):107–131. DOI: 10.1007/
qualitative method more suitable for quantitative audiences. s11577-017-0454-1.
9. Morse JM. Principles of mixed methods and multi-method research and behavioral sciences. 1st ed., Los Angeles: Sage Publications Inc;
design. In: Teddlie C, Tashakkori A, ed. Handbook of mixed methods in 2009.
social and behavioral research. Thousand Oaks, CA: Sage Publication; 18. Creswell JW, PIano, Clark VL. Designing and conducting mixed
2003. pp. 189–208. methods research. 2nd ed., Los Angeles: Sage Publications Inc; 2011.
10. Greene JC, Hall JN. Dialectics and pragmatism. In: Tashakkori A, p. 89.
Teddlie C, ed. Handbook of mixed methods in social & behavioral 19. Teddlie C, Tashakkori A. Major issues and controversies in the use of
research. 2nd ed., Los Angeles: Sage; 2010. pp. 119–167. mixed methods in the social and behavioral sciences. In: Tashakkori A,
11. Bryman A. Integrating quantitative and qualitative research: How is Teddlie C, ed. Handbook of mixed methods in social and behavioral
it done? Qualitative Research 2006;6(1):97–113. research. Thousand Oaks, CA: Sage Publications; 2003. pp. 3–50.
12. Greene JC, Caracelli VJ, Graham WF. Toward a conceptual framework 20. Patton MQ. Qualitative evaluation and research methods. 2nd ed.,
for mixed-method evaluation designs. Educational evaluation and Newbury Park CA: Sage Publications Inc; 1990.
policy analysis. Fall 1989;11(3):255–274. 21. Creswell JW, Piano Clark VL, Gutmann ML, et al. Advanced mixed
13. Schoonenboom J. The multilevel mixed intact group analysis: a methods research designs. In: Tashakkori A, Teddlie C, ed. Handbook
mixed method to seek, detect, describe, and explain differences on mixed methods in the behavioral and social sciences. Thousand
between intact groups. J Mixed Methods Res 2016;10(2):129–146. Oaks, CA: Sage Publications Inc; 2003. pp. 209–240.
DOI: 10.1177/1558689814536283. 22. Caracelli VJ, Greene JC. Crafting mixed-method evaluation
14. Morse JM. Approaches to qualitative-quantitative methodological designs. New Direct Evaluat 1997;74(74):19–32. DOI: 10.1002/
triangulation. Nurs Res 1991;40(2):120–123. DOI: 10.1097/00006199- ev.1069.
199103000-00014. 23. Dyer TA, Robinson PG. General health promotion in general dental
15. Guest G. Describing mixed methods research: an alternative to practice — the involvement of the dental team part 2: a qualitative
typologies. J Mixed Methods Research 2013;7(2):141–151. DOI: and quantitative investigation of the views of practice principals
10.1177/1558689812461179. in South Yorkshire. Br Dent J 2006;201(1):45–51. DOI: 10.1038/
16. Morse JM, Niehaus L. Mixed method design: principles and sj.bdj.4813774.
procedures. Walnut Creek, CA, USA: Left Coast Press Inc.; 2009. 24. Morgan DL. Practical Strategies for combining qualitative and
17. Teddlie CB, Tashakkori A. Foundations of mixed methods research: quantitative methods: applications tO health research. Qual Health
Integrating quantitative and qualitative approaches in the social Res 1998;8(3):362–376. DOI: 10.1177/104973239800800307.