Multimethodology
Encyclopedia
Multimethodology, mixed methods research, compatibility thesis or pragmatist paradigmis an approach to professional research
that combines the collection and analysis of quantitative
and qualitative
data.
The term 'multimethodology' appears to be more widely used in operations research
than in other branches of social science.
This approach has been gaining in popularity since the 1980s.
A research strategy is a procedure for achieving a particular intermediary research objective—such as sampling, data collection, or data analysis. We may therefore speak of sampling strategies or data analysis strategies. The use of multiple strategies to enhance construct validity (a form of methodological triangulation
) is now routinely advocated by most methodologists. In short, mixing or integrating research strategies (qualitative and/or quantitative) in any and all research undertaking is now considered a common feature of all good research.
A research approach refers to an integrated set of research principles and general procedural guidelines. Approaches are broad, holistic (but general) methodological guides or roadmaps that are associated with particular research motives or analytic interests. Two examples of analytic interests are population frequency distributions and prediction. Examples of research approaches include experiments, surveys, correlational studies, ethnographic research, and phenomenological inquiry. Each approach is ideally suited to addressing a particular analytic interest. For instance, experiments are ideally suited to addressing nomothetic explanations or probably cause; surveys—population frequency descriptions, correlations studies—predictions; ethnography—descriptions and interpretations of cultural processes; and phenomenology—descriptions of the essence of phenomena or lived experiences.
In a single approach design (SAD) only one analytic interest is pursued. In a mixed approach design (MAD) two or more analytic interests are pursued. NOTE: a mixed approach design may include entirely “quantitative” approaches such as combining a survey and an experiment; or entirely “qualitative” approaches such as combining an ethnographic and a phenomenological inquiry.
A word of caution about the term “multimethodology”. It has become quite common place to use the terms "method" and "methodology" as synonyms (as is the case with the above entry). However, there are convincing philosophical reasons for distinguishing the two. "Method" connotes a way of doing something — a procedure. "Methodology" connotes a discourse about methods—i.e., a discourse about the adequacy and appropriateness of particular combination of research principles and procedures. The terms methodology and biology share a common suffix "logy." Just as bio-logy is a discourse about life—all kinds of life; so too, methodo-logy is a discourse about methods—all kinds of methods. It seems unproductive, therefore, to speak of multi-biologies or of multi-methodologies. It is very productive, however, to speak of multiple biological perspectives or of multiple methodological perspectives.
It can be used when you want to build from one phase of research to another. You may first want to explore the data qualitatively to develop an instrument or to identify variables to test in a later quantitative study. You engage in a mixed methods study when you want to follow up a quantitative study with a qualitative one to obtain more detailed specific information.
- particularly post-structuralist and post-modernists. Its critics argue that multimethodology is inherently wrong because quantitative and qualitative research paradigms should not be mixed.
Schram, Sanford F., and Brian Caterino, eds., Making Political Science Matter: Debating Knowledge, Research, and Method (New York: New York University Press, 2006).
Research
Research can be defined as the scientific search for knowledge, or as any systematic investigation, to establish novel facts, solve new or existing problems, prove new ideas, or develop new theories, usually using a scientific method...
that combines the collection and analysis of quantitative
Quantitative research
In the social sciences, quantitative research refers to the systematic empirical investigation of social phenomena via statistical, mathematical or computational techniques. The objective of quantitative research is to develop and employ mathematical models, theories and/or hypotheses pertaining to...
and qualitative
Qualitative research
Qualitative research is a method of inquiry employed in many different academic disciplines, traditionally in the social sciences, but also in market research and further contexts. Qualitative researchers aim to gather an in-depth understanding of human behavior and the reasons that govern such...
data.
The term 'multimethodology' appears to be more widely used in operations research
Operations research
Operations research is an interdisciplinary mathematical science that focuses on the effective use of technology by organizations...
than in other branches of social science.
This approach has been gaining in popularity since the 1980s.
Mixed methods research
There are two broad classes of research studies that are currently being labeled “mixed methods research”:- single approach designs (SADs) in which additional qualitative and/or quantitative strategies are employed to enhance research quality; and
- mixed approach designs (MADs). These definitions require that a distinction be made between research strategies and research approaches.
A research strategy is a procedure for achieving a particular intermediary research objective—such as sampling, data collection, or data analysis. We may therefore speak of sampling strategies or data analysis strategies. The use of multiple strategies to enhance construct validity (a form of methodological triangulation
Triangulation (social science)
In the social sciences, triangulation is often used to indicate that more than two methods are used in a study with a view to double checking results. This is also called "cross examination"....
) is now routinely advocated by most methodologists. In short, mixing or integrating research strategies (qualitative and/or quantitative) in any and all research undertaking is now considered a common feature of all good research.
A research approach refers to an integrated set of research principles and general procedural guidelines. Approaches are broad, holistic (but general) methodological guides or roadmaps that are associated with particular research motives or analytic interests. Two examples of analytic interests are population frequency distributions and prediction. Examples of research approaches include experiments, surveys, correlational studies, ethnographic research, and phenomenological inquiry. Each approach is ideally suited to addressing a particular analytic interest. For instance, experiments are ideally suited to addressing nomothetic explanations or probably cause; surveys—population frequency descriptions, correlations studies—predictions; ethnography—descriptions and interpretations of cultural processes; and phenomenology—descriptions of the essence of phenomena or lived experiences.
In a single approach design (SAD) only one analytic interest is pursued. In a mixed approach design (MAD) two or more analytic interests are pursued. NOTE: a mixed approach design may include entirely “quantitative” approaches such as combining a survey and an experiment; or entirely “qualitative” approaches such as combining an ethnographic and a phenomenological inquiry.
A word of caution about the term “multimethodology”. It has become quite common place to use the terms "method" and "methodology" as synonyms (as is the case with the above entry). However, there are convincing philosophical reasons for distinguishing the two. "Method" connotes a way of doing something — a procedure. "Methodology" connotes a discourse about methods—i.e., a discourse about the adequacy and appropriateness of particular combination of research principles and procedures. The terms methodology and biology share a common suffix "logy." Just as bio-logy is a discourse about life—all kinds of life; so too, methodo-logy is a discourse about methods—all kinds of methods. It seems unproductive, therefore, to speak of multi-biologies or of multi-methodologies. It is very productive, however, to speak of multiple biological perspectives or of multiple methodological perspectives.
Desirability
The case for multimethodology as a strategy for intervention and/or research is based on four observations:- Narrow views of the world are often misleading, so approaching a subject from different perspectives or paradigmParadigmThe word paradigm has been used in science to describe distinct concepts. It comes from Greek "παράδειγμα" , "pattern, example, sample" from the verb "παραδείκνυμι" , "exhibit, represent, expose" and that from "παρά" , "beside, beyond" + "δείκνυμι" , "to show, to point out".The original Greek...
s may help to gain a holistic perspective - There are different levels of social research (i.e.: biological, cognitive, social, etc.), and different methodologies may have particular strengths with respect to one of these levels. Using more than one should help to get a clearer picture of the social world and make for more adequate explanations
- Many existing practices already combine methodologies to solve particular problems, yet they have not been theorised sufficiently
- Multimethodology fits well with postmodernismPostmodernismPostmodernism is a philosophical movement evolved in reaction to modernism, the tendency in contemporary culture to accept only objective truth and to be inherently suspicious towards a global cultural narrative or meta-narrative. Postmodernist thought is an intentional departure from the...
Feasibility
There are also some hazards to multimethodological approaches. Some of these problems include:- Many paradigms are at odds with each other. However, once the understanding of the difference is present, it can be an advantage to see many sides, and possible solutions may present themselves.
- Cultural issues affect world views and analyzability. Knowledge of a new paradigm is not enough to overcome potential biases; it must be learned through practice and experience.
- People have cognitive abilities that predispose them to particular paradigms. The logical thinker can more easily understand and use quantitative methodologies. It is easier to move from quantitative to qualitative, and not the reverse.
Computer Assisted Mixed Methods Research Analysis Software
A few qualitative research analysis software applications support some degree of quantitative integration, and the following software or web applications focus on mixed methods research:- DedooseDedooseDedoose is a Web Based Qualitative Analysis application and Mixed Methods research tool developed by professors from UCLA, and is the successor to EthnoNotes....
is a Web Based Qualitative Analysis application and Mixed Methods research tool developed by professors from UCLA, and is the successor to EthnoNotes. - EthnoNotes
Conclusion
Multimethodology is desirable and feasible because it gives a more complete view, and because the requirement during the different phases of the intervention (or research project) make very specific demands on a general methodology. While it is demanding, it is more effective to choose the right tool for the job at hand.It can be used when you want to build from one phase of research to another. You may first want to explore the data qualitatively to develop an instrument or to identify variables to test in a later quantitative study. You engage in a mixed methods study when you want to follow up a quantitative study with a qualitative one to obtain more detailed specific information.
Criticism
Multimethodology is criticized by the adherents of incompatibility thesisIncompatibility thesis
Incompatibility thesis in is an argument in research methodology about incompatibility of quantitative research and qualitative research paradigms in the same research. This thesis is based on philosophies of post-structuralism and post-modernism...
- particularly post-structuralist and post-modernists. Its critics argue that multimethodology is inherently wrong because quantitative and qualitative research paradigms should not be mixed.
Further reading
- Brannen, Julia. 2005. “Mixing Methods: The Entry of Qualitative and Quantitative Approaches into the Research Process.” International Journal of Social Research Methodology 8:173-184.
- Flyvbjerg, Bent, Making Social Science Matter: Why Social Inquiry Fails and How It Can Succeed Again (Cambridge: Cambridge University Press, 2001).
- Mingers J., Brocklesby J., "Multimethodology: Towards a Framework for Mixing Methodologies", Omega, Volume 25, Number 5, October 1997, pp. 489–509 (21)
- Niglas, Katrin. 2004. "The Combined Use of Qualitative and Quantitative Methods in Educational Research." http://www.tlulib.ee/files/arts/24/niglaf737ff0eb699f90626303a2ef1fa930f.pdf
- Onwuegbuzie, Anthony and Leech, Nancy; 2005. “Taking the “Q” Out of Research: Teaching Research Methodology Courses Without the Divide Between Quantitative and Qualitative Paradigms.” Quality and Quantity 39:267-296.
Schram, Sanford F., and Brian Caterino, eds., Making Political Science Matter: Debating Knowledge, Research, and Method (New York: New York University Press, 2006).
- Lowenthal, P. R., & Leech, N. (2009). Mixed research and online learning: Strategies for improvement. In T. T. Kidd (Ed.), Online education and adult learning: New frontiers for teaching practices (pp. 202–211). Hershey, PA: IGI Global.