Mixed Methods Studies in Environmental Management Research: Prevalence,Purposes and Designs

Mixed methods research, that is, the combined use of quantitative and qualitative methods in the same study, is a popular approach in several fields. However, its use in the field of environmental management and sustainable development has not been examined. The authors review the application of mixed methods research in the journal Business Strategy and the Environment in the last ten years. A total of 340 articles have been read and reviewed, and 26 mixed methods studies have been identified. The main purposes and mixed methods designs are examined. Suggestions on why and how to use mixed methods research are offered, and recommendations are provided to guide future mixed methods studies to advance our understanding of environmental management topics. Copyright © 2014 John Wiley & Sons, Ltd and ERP Environment     

Generalization practices in qualitative research: a mixed methods case study

The purpose of this mixed methods case study was to examine the generalization practices in qualitative research published in a reputable qualitative journal. In order to accomplish this, all qualitative research articles published in Qualitative Report since its inception in 1990 (n =  273) were examined. A quantitative analysis of the all 125 empirical qualitative research articles revealed that a significant proportion (i.e., 29.6%) of studies involved generalizations beyond the underlying sample that were made inappropriately by the author(s). A qualitative analysis identified the types of over-generalizations that occurred, which included making general recommendations for future practice and providing general policy implications based only on a few cases. Thus, a significant proportion of articles published in Qualitative Report lack what we call interpretive consistency.     

Taking the “Q” Out of Research: Teaching Research Methodology Courses Without the Divide Between Quantitative and Qualitative Paradigms

The purpose of this paper is to provide evidence that the debate between quantitative and qualitative is divisive and, hence, counterproductive for advancing the social and behavioral science field. We advocate that all graduate students learn to utilize and to appreciate both quantitative and qualitative research methodologies. As such, students will develop into pragmatist researchers who are able to utilize both quantitative and qualitative techniques when conducting research. We contend that the best way to accomplish this is by eliminating quantitative research methodology and qualitative research methodology courses from curricula and replacing these with research methodology courses at different levels that simultaneously teach both quantitative and qualitative techniques within a mixed methodological framework.An earlier version of this article received the 2003 Southwest Educational Research Association (SERA) Outstanding Paper Award.     

Towards a hybrid model? A systematic review of human resource management research on Chinese state-owned enterprises (1993–2017)

Abstract

Over the past two decades, there has been a proliferation of research on human resource management (HRM) in Chinese state-owned enterprises (SOEs) as a result of the wide-reaching state-sector reform of the late 1980s. This article aims to provide a systematic review of literature on this topic and capture the nature of HRM in Chinese SOEs, both in research and practice. The article draws on 178 studies from 43 English academic journals over a period of 25?years (1993–2017). In analysing this literature and by taking stock of theoretical frameworks, research methods, themes and analysis of academic articles in this area, we have gained a number of insights. The study has found that the research methods used have shifted from qualitative and interpretive methodology toward quantitative and sophisticated modelling. A further insight is that there has been a relatively heavy reliance on institutional theory in the earlier studies reviewed, and since then a switch towards organizational behaviour perspectives. The level of analysis has moved from macro to micro level and thematic foci have become more diverse and complex. We highlight a number of avenues, theoretical and empirical, for future studies in this field.     

Mixed methods research synthesis: definition, framework, and potential

Literature on the combination of qualitative and quantitative research components at the primary empirical study level has recently accumulated exponentially. However, this combination is only rarely discussed and applied at the research synthesis level. The purpose of this paper is to explore the possible contribution of mixed methods research to the integration of qualitative and quantitative research at the synthesis level. In order to contribute to the methodology and utilization of mixed methods at the synthesis level, we present a framework to perform mixed methods research syntheses (MMRS). The presented classification framework can help to inform researchers intending to carry out MMRS, and to provide ideas for conceptualizing and developing those syntheses. We illustrate the use of this framework by applying it to the planning of MMRS on effectiveness studies concerning interventions for challenging behavior in persons with intellectual disabilities, presenting two hypothetical examples. Finally, we discuss possible strengths of MMRS and note some remaining challenges concerning the implementation of these syntheses.     

Human resource management–well‐being–performance research revisited: Past,present, and future

The authors provide an up‐to‐date theoretically based qualitative review of research dealing with the relationship between HRM, employee well‐being, and individual/organisational performance (HRM‐WB‐IOP research). The review is based on a systematic critical analysis of all HRM‐WB‐IOP studies (N = 46) published in 13 core HRM and management journals in the 2000 to 2018 period. The authors first identify different theoretical models of the HRM‐WB‐IOP relationship, which they then use to map research in the area. The results show that mutual gains conceptualisations play a dominant role in extant HRM‐WB‐IOP research, at the expense of alternative conflicting outcomes and mutual losses models, which are also shown to receive very limited empirical support across the 46 studies. As part of this mapping exercise, the authors identify important knowledge gaps in the area and conclude by setting out a number of key recommendations for future research to address these gaps.     

Empirical research consolidation: a generic overview and a classification scheme for methods

I define research consolidation as comparing and combining (amalgamating or, at least, juxtaposing) results or other output from multiple previously conducted research activities, relevant to a goal or topic of interest. The concept, not limited to empirical research or any specific method, is similar to and subsumes what is often referred to as research synthesis or research integration; I explain the concept and my rationale for the new term. After introducing the broader concept, I focus on consolidation of empirical research. As background for this, I offer a brief introduction to empirical research. Then I provide a generic overview of empirical research consolidation, abstracted from several of its specific methods, such as quantitative meta-analysis and qualitative meta-synthesis; this sort of overview—method agnostic and capturing the commonality—is not readily available in the literature. At the core of the paper, I propose a scheme to classify methods for empirical research consolidation followed by a review and classification of selected methods, illustrating the scheme. I also discuss and clarify related terminology. The classification scheme differentiates between two major attributes of methods—consolidation technique and type of content to be consolidated—that may reflect the positivist or constructivist research paradigm. Consolidation techniques could be aggregative, interpretive, or a combination thereof. Content consolidated, from empirical research reports, could be empirical or not and could be from quantitative research, qualitative research, other kinds of empirical research, or a combination thereof.     

Subjective well-being among the elderly: A bibliometric analysis

Demographic trends have stimulated interest in empirical research on subjective well-being among the elderly. Despite the steep increase in published articles, no one has yet provided a summarized review of the scientific landscape. With this article, we aim to fill this research gap by providing a bibliometric analysis of the field. We do so by collecting a broad dataset of publication data from 1961 to 2016 found on the Web of Science webpage. By combining quantitative scientometric methods, as well as qualitative methods, we were able to provide a historic context of research on subjective well-being among the elderly and distinguish the most important articles, authors, journals, organizations and countries in the field. We found a big leap in research on subjective well-being among the elderly in the last 10 years, as well as a substantial globalization of the field. Although research on subjective well-being among the elderly has clear antecedents, we expect the field to further increase and mature due to more scholars from different braches of science joining the conversation.

     

Numbers and words revisited: Being “shamelessly eclectic”

Despite the growing acknowledgement that complex social phenomena can be usefully understood through multiple methods of inquiry, there are few sound examples of mixed-methods research. This paper offers concrete examples from recent policy research in the United States about how qualitative and quantitative methods can be combined to better address complex research questions. Using a conceptual framework developed in 1985 and recently elaborated, we describe how, in both the design and analysis phases of research, combing methods can enhance the research purposes ofcorroborating, elaborating, developing, andinitiating understandings of social phenomena.A previous version of this paper was presented at the annual meetings of the American Educational Research Association, Chicago, 1991.     

Towards a flexible online mixed method design with a feedback loop

The notion of mixed methods design relates to the research studies that combine qualitative and quantitative approaches. However, most of these studies are tailored to specific research problem in a particular study and are typically limited to a fixed sequence of qualitative and quantitative approaches (e.g. qualitative interviews followed by a survey or vice-versa). This limitation historically arises from time, cost and logistic restrictions. As an alternative, we develop an general extension of fixed mixed method design by introducing a flexible feedback-loop so that several phases can be combined in a flexible order. In practice, such designs are now increasingly feasible within an information-communication technology environment, where online respondents are readily available for immediate participation. An online experiment combining interactive series of web surveys and in-depth web interviews was performed to compare this approach with standard two-phase designs involving mixed methods. The costs, timing, quality of finiding and experiences of researchers were systematically evaluated. In summary, the proposed approach proved to be very beneficial.     

Guidance for deciding upon use of primary mixed methods studies in research synthesis: lessons learned in childhood trauma

When reviewing literature, mixed methods studies (MMS) are increasingly retrieved, yet it is unclear how they should be dealt with in a research synthesis. In this article we examine the inclusion of primary MMS in research synthesis, based on experiences with a meta-analysis (MA) and a qualitative evidence synthesis (QES) in childhood trauma. The aim is to offer guidance for reviewers in deciding upon the use of MMS. This review article examines (1) the qualitative component, (2) the quantitative component, as well as (3) the third component of combined yield for use in a MA, a QES or a mixed studies review. A systematic search for MMS in the field of childhood trauma from January 1980 to October 2011 resulted in twelve MMS. Eight qualitative components, six quantitative components and one combined yield could have been included in a MA or QES. Exclusion of qualitative components was due to insufficient quality. Quantitative components were excluded because sample sizes were too small, different outcome measures than ours were used or no adequate statistics were provided. Yield could not be included because it was absent, outside the scope or otherwise unspecified. Finally, we offer flow charts with clear steps to assist researchers in deciding upon the use of components of MMS. Our study demonstrates that MMS can cover new areas and therefore cannot be neglected in a research synthesis.     

Integrating quality into quantity: survey research in the era of mixed methods

As widely recognized during the golden age of survey research thanks to the work of the Columbia school, the use of mixed strategies allows survey research to overcome its limitations by incorporating the advantages of qualitative approaches rather than seeking alternative methods. The need to re-think survey research before embarking on this course impelled the author to undertake a critical analysis of one of the survey’s most important assumptions, proposing a shift from standardization of stimulus to standardization of meanings in order to anchor the requirement of answer comparability on a more solid basis. This proposal for rapprochement with qualitative research is followed by a more detailed section in which the author distinguishes four different types of mixed survey strategies, combining two criteria (time order and function of qualitative procedures). The most significant parts of the constructed typology are then brought together in a model called the multilevel integrated survey approach. This methodological model is concretely illustrated in an empirical study of homophobic prejudice among teenagers. The example shows how in research practice analytical mixed strategies can be creatively combined in the same survey research design, contributing to improvements in data quality and the relevance of research findings.     

Circular economy to enhance sustainability of small and medium‐sized enterprises

The circular economy (CE) represents a major paradigm shift of moving from the concepts of linear to circular supply chains across multiple industries. Although some aspects of CE adoption within industrial supply chains have been researched extensively (particularly addressing challenges of design, implementation, and operations), the research that relates CE practices with sustainability performance to reveal the current state of CE practices within small and medium‐sized enterprises (SMEs) is scant. The aim of this research was to facilitate SMEs to achieve greater sustainability through CE implementation. This research addresses three research questions—How are CE fields of action related to sustainability performance? What are the issues, challenges, and opportunities of adopting CE in SMEs? And what key strategies, resources, and competences facilitate effective implementation of CE in SMEs? This study adopts a mixed method approach (qualitative and quantitative) using survey research, focus group, and case studies; 130 randomly selected SMEs within the Midlands of the United Kingdom have been surveyed, and the responses are analysed using statistical tools along with findings from focus groups and case studies. The study reveals that all CE fields of action (take, make, distribute, use, and recover) of SMEs are correlated to economic performance, but only make and use are related to environmental and social performance. The study further derives strategies, resources, and competences for achieving sustainability across all the CE field of actions. Additionally, this research reveals the issues and challenges, strategies, resources, and competences required for implementing CE in SMEs.     

Qualitative Research in Management: A Decade of Progress

Approximately 10 years ago, Lee et al. reviewed the qualitative methods published during 1979–99 in the major US journals in the organizational sciences. This ten‐year follow‐up review of 198 qualitative articles assesses the progress made in qualitative research in management by specifically considering: (1) the strength and legitimacy of recent publications that challenge any positivistic stigmatizations of qualitative research; (2) the methodological advances in qualitative methods, including the use and elucidation of novel techniques; and (3) the general contribution of qualitative research to the accumulation of management knowledge. By encompassing both US and European journals in our review, we also compare and contrast the qualitative research published on both sides of the Atlantic, stressing what each can learn from the other. We highlight exemplary articles and procedures and make recommendations for the next decade of qualitative research in management.     

QUALITATIVE AND MIXED‐METHODS RESEARCH IN ECONOMICS: SURPRISING GROWTH,PROMISING FUTURE

Qualitative research in economics has traditionally been unimportant compared to quantitative work. Yet there has been a small explosion in use of quantitative approaches in the past 10–15 years, including ‘mixed‐methods’ projects which use qualitative and quantitative methods in combination. This paper surveys the growing use of qualitative methods in economics and closely related fields, aiming to provide economists with a useful roadmap through major sets of qualitative methods and how and why they are used. We review the growing body of economic research using qualitative approaches, emphasizing the gains from using qualitative‐ or mixed‐methods over traditional ‘closed‐ended’ approaches. It is argued that, although qualitative methods are often portrayed as less reliable, less accurate, less powerful and/or less credible than quantitative methods, in fact, the two sets of methods have their own strengths, and how much can be learned from one type of method or the other depends on specific issues that arise in studying the topic of interest. The central message of the paper is that well‐done qualitative work can provide scientifically valuable and intellectually helpful ways of adding to the stock of economic knowledge, especially when applied to research questions for which they are well suited.     

Empirical evaluation of educational interactive systems

Educational software systems are usually highly interactive systems that needs to be evaluated from two different perspectives, first as interactive software, mainly using usability and accessibility approaches, and second as an educational product that needs to be evaluated from its learning impact. The empirical evaluation methods may be quantitative, with a more deductive reasoning, or qualitative, with a more inductive reasoning, oriented, however mixed approaches have been used extensively because they combine the both main methods with a more pragmatic knowledge focusing on knowing the consequences or solving problems. The empirical evaluation of interactive educational software due to its own characteristics requires a mixed approach typically. This special issue is devoted to identify, share and valorise best practices and experiences, with a very solid modelling background, that are focused on the empirical evaluation of educational interactive systems with a special emphasis on mixed quantitative and qualitative approaches.     

Validity and Qualitative Research: An Oxymoron?

Although the importance of validity has long been accepted among quantitative researchers, this concept has been an issue of contention among qualitative researchers. Thus, the first purpose of the present paper is to introduce the Qualitative Legitimation Model, which attempts to integrate many of the types of validity identified by qualitative researchers. The second purpose of this article is to describe 24 methods for assessing the truth value of qualitative research. Utilizing and documenting such techniques should prevent validity and qualitative research from being seen as an oxymoron.     

Qualitative methodology and its pitfalls in educational research

There is considerable controversy in educational research with respect to the use of qualitative and quantitative data and as to what constitutes scientific research. The objective of this study is to explore the degree to which in-service teachers understand the difference between qualitative/quantitative data and methods, validity/authenticity, generalization and how these can be used to solve problems faced by the teachers. The study is based on 84 participants who had registered for a 10-week course on Methodology of Investigation in Education, as part of their Master’s degree program. The course is based on 11 readings drawing on a history and philosophy of science perspective (positivism, constructivism, Popper, Kuhn, Lakatos). Course activities included written reports, class room discussions based on participants’ presentations, and written exams. Based on the results obtained it is concluded: (a) Most participants understood that the problem to be investigated precedes the method and determines the methodology to be used; (b) As all observations are theory-laden, it is preferable that interpretations based on both qualitative and quantitative data be allowed to compete in order to provide validity to our research findings; (c) The difference between validity and authenticity was controversial and most participants considered the need for interpreting data and hence favored authenticity; (d) Discussions led to the idea of ‘degrees of validity’ as both validity in the quantitative sense and authenticity in the qualitative sense, ultimately depend on critical appraisals of the community; (e) Generalizability of results obtained from qualitative studies was a controversial topic and most participants agreed that it is not desirable to generalize; (f) Discussions suggested an alternative: In both qualitative and quantitative research generalizability is possible, provided we are willing to grant that our conceptions/theories are not entirely grounded in empirical evidence but rather on the degree to which the community can uphold such a consensus; (g) Most teachers considered the use of participant observation in qualitative research as non-controversial. Class discussions led to the understanding that emphasizing observations may lead us to the Aristotelian ideal of empirical science; (h) Formulation of hypotheses, manipulation of variables, and the quest for causal variables was considered by many teachers to be equivalent to the scientific method. Discussions facilitated the understanding that this led to idealization and thus helped to reduce the complexity of a problem.     

Characteristics of research on green marketing

This paper aims to describe and analyze the main characteristics of articles on green marketing published in the most relevant journals within the period 1993–2003, in order to determine the evolution of this current issue of research over recent years and improve our understanding of this subject. We built up a database with 112 articles on green marketing and we have explored the topic, the methodology and the techniques of analysis, as well as other relevant aspects of the research. In order to complete this analysis, we made a review of articles published in two journals specializing in environmental management: BSE and CSREM. In this way, this paper offers practical help to those who are beginning research on this topic because the results will help us to determine what still needs to be investigated in this topic and hence propose a research agenda for the coming years. Copyright © 2007 John Wiley & Sons, Ltd and ERP Environment.     

A typology of mixed methods research designs

The mixed methods paradigm is still in its adolescence, and, thus, is still relatively unknown and confusing to many researchers. In general, mixed methods research represents research that involves collecting, analyzing, and interpreting quantitative and qualitative data in a single study or in a series of studies that investigate the same underlying phenomenon. Over the last several years, a plethora of research designs have been developed. However, the number of designs that currently prevail leaves the doctoral student, the beginning researcher, and even the experienced researcher who is new to the field of mixed methods research with the challenge of selecting optimal mixed methods designs. This paper presents a three-dimensional typology of mixed methods designs that represents an attempt to rise to the challenge of creating an integrated typology of mixed methods designs. An example for each design is included as well as a notation system that fits our eight-design framework. This paper won the James E. McLean outstanding paper award.