Ensuring survey research data integrity in the era of internet bots

Quality & Quantity - We used an internet-based survey platform to conduct a cross-sectional survey regarding the impact of COVID-19 on the LGBTQ?+?population in the United States....     

A typology of mixed methods research designs

The mixed methods paradigm is still in its adolescence, and, thus, is still relatively unknown and confusing to many researchers. In general, mixed methods research represents research that involves collecting, analyzing, and interpreting quantitative and qualitative data in a single study or in a series of studies that investigate the same underlying phenomenon. Over the last several years, a plethora of research designs have been developed. However, the number of designs that currently prevail leaves the doctoral student, the beginning researcher, and even the experienced researcher who is new to the field of mixed methods research with the challenge of selecting optimal mixed methods designs. This paper presents a three-dimensional typology of mixed methods designs that represents an attempt to rise to the challenge of creating an integrated typology of mixed methods designs. An example for each design is included as well as a notation system that fits our eight-design framework. This paper won the James E. McLean outstanding paper award.     

Generalization practices in qualitative research: a mixed methods case study

The purpose of this mixed methods case study was to examine the generalization practices in qualitative research published in a reputable qualitative journal. In order to accomplish this, all qualitative research articles published in Qualitative Report since its inception in 1990 (n =  273) were examined. A quantitative analysis of the all 125 empirical qualitative research articles revealed that a significant proportion (i.e., 29.6%) of studies involved generalizations beyond the underlying sample that were made inappropriately by the author(s). A qualitative analysis identified the types of over-generalizations that occurred, which included making general recommendations for future practice and providing general policy implications based only on a few cases. Thus, a significant proportion of articles published in Qualitative Report lack what we call interpretive consistency.     

The use of mixed methods research in the field of behavioural sciences

Mixed methods research involves the combined use of quantitative and qualitative methods in the same research study, and it is becoming increasingly important in several scientific areas. The aim of this paper is to review and compare through a mixed methods multiple-case study the application of this methodology in three reputable behavioural science journals: the Journal of Organizational Behavior, Addictive Behaviors and Psicothema. A quantitative analysis was carried out to review all the papers published in these journals during the period 2003–2008 and classify them into two blocks: theoretical and empirical, with the latter being further subdivided into three subtypes (quantitative, qualitative and mixed). A qualitative analysis determined the main characteristics of the mixed methods studies identified, in order to describe in more detail the ways in which the two methods are combined based on their purpose, priority, implementation and research design. From the journals selected, a total of 1,958 articles were analysed, the majority of which corresponded to empirical studies, with only a small number referring to research that used mixed methods. Nonetheless, mixed methods research does appear in all the behavioural science journals studied within the period selected, showing a range of designs, where the sequential equal weight mixed methods research design seems to stand out.     

Integrating the disabled into the work force: A survey of fortune 500 company attitudes and practices

Full participation in the work force continues to be an elusive goal for disabled individuals. One common explanation for this state of affairs is that employers tend to have negative attitudes about what the handicapped have to offer as employees and what is required to integrate them into the work force. Unfortunately, relatively little recent data is available about such attitudes. Thus, a survey of Fortune 500 companies was conducted to examine employers' attitudes toward the disabled. Employers' hiring and accommodation practices were also examined. Results were encouraging for the handicapped in some areas (e.g., performance perceptions) and a cause for concern in others (e.g., the perceived cost of making workplace accommodations). Level of exposure to the handicapped was also related to attitudes and practices. Limitations, research directions, and implications for corporations are discussed.     

Use of mixed methods designs in substance research: a methodological necessity in Nigeria

The utility of mixed methods (qualitative and quantitative) is becoming increasingly accepted in health sciences, but substance studies are yet to substantially benefit from such utilities. While there is a growing number of mixed methods alcohol articles concerning developed countries, developing nations are yet to embrace this method. In the Nigerian context, the importance of mixed methods research is yet to be acknowledged. This article therefore, draws on alcohol studies to argue that mixed methods designs will better equip scholars to understand, explore, describe and explain why alcohol consumption and its related problems are increasing in Nigeria. It argues that as motives for consuming alcohol in contemporary Nigeria are multiple, complex and evolving, mixed method approaches that provide multiple pathways for proffering solutions to problems should be embraced.     

企业文化的重要内容——质量文化

在竞争日益激烈的现代市场经济中．“以质量求生存，以信誉求发展”已成了企业制胜的法宝。实践证明，企业要想在竞争中长盛不衰，最关键的因素不是先进的设备和技术，也不是严格的规章制度，而是依靠先进的质量管理和质量文化。2000版ISO9000族标准强调，“质量是企业追求的．也是顾客想要得到的”．要做到向顾客提供高质量的产品．     

Mixed strategies for improving data quality: the contribution of qualitative procedures to survey research

This article aims to illustrate how qualitative research strategies contribute to the implementation of the standard survey model by monitoring and improving the quality of collected data and thus the quality of survey findings as well. The methodological cycle for survey data-quality construction using qualitative strategies comprises three sequential stages that alternate with standard procedures: the pilot study, pretesting, and deviant case analysis. If the first two of these stages have enjoyed a certain recognition in the literature, the same cannot be said for deviant case analysis. Deviant case analysis is a research strategy originally proposed by Lazarsfeld and promoted within the Colombia School from the 1940s to the 1960s, unfortunately without subsequently receiving the attention it deserved within the area of survey research in general. It refers to searching outside the collected empirical base for clues concerning anomalous responses revealed by statistical analysis that either deviate from research hypotheses or produce contradictory classificatory results.     

Occupational choice: Teacher quality versus teacher quantity

This article examines the relationship between skill-biased technological changes and the decline in both teacher quality and pupil–teacher ratio—called the “quality–quantity trade-off”—in the United States and other advanced economies during the past several decades. The study presents a theory of educational production that emphasizes teachers’ occupational choices. A key assumption is that talented agents have a comparative advantage in learning. The model endogenously generates a teachers sector with intermediate abilities between two types of skilled workers with tertiary education: highly skilled workers and vocational workers. This unique feature helps specify which technological changes may lead to quality–quantity trade-offs. In particular, a crucial element is that the ratio of incomes and thus the income inequality rises within the skilled sector. In this case, the most talented teachers depart from the teachers sector to join the highly skilled sector, and as such, teacher quality declines. In other cases, both teacher quality and teacher quantity may increase. The results are consistent with the observed patterns of technology, educational attainment, educational expenditure, and wage inequality in advanced economies. Finally, another potential cause for the quality–quantity trade-off is a reduction in teacher certification requirement unless the reduction is implemented exclusively on high-ability workers.     

Disaster relief routing: Integrating research and practice

Disaster relief presents many unique logistics challenges, with problems including damaged transportation infrastructure, limited communication, and coordination of multiple agents. Central to disaster relief logistics is the distribution of life-saving commodities to beneficiaries. Operations research models have potential to help relief agencies save lives and money, maintain standards of humanitarianism and fairness and maximize the use of limited resources amid post-disaster chaos. Through interviews with aid organizations, reviews of their publications, and a literature review of operations research models in transportation of relief goods, this paper provides an analysis of the use of such models from the perspective of both practitioners and academics. With the complexity of disaster relief distribution and the relatively small number of journal articles written on it, this is an area with potential for helping relief organizations and for tremendous growth in operations research.     

Guidance for deciding upon use of primary mixed methods studies in research synthesis: lessons learned in childhood trauma

When reviewing literature, mixed methods studies (MMS) are increasingly retrieved, yet it is unclear how they should be dealt with in a research synthesis. In this article we examine the inclusion of primary MMS in research synthesis, based on experiences with a meta-analysis (MA) and a qualitative evidence synthesis (QES) in childhood trauma. The aim is to offer guidance for reviewers in deciding upon the use of MMS. This review article examines (1) the qualitative component, (2) the quantitative component, as well as (3) the third component of combined yield for use in a MA, a QES or a mixed studies review. A systematic search for MMS in the field of childhood trauma from January 1980 to October 2011 resulted in twelve MMS. Eight qualitative components, six quantitative components and one combined yield could have been included in a MA or QES. Exclusion of qualitative components was due to insufficient quality. Quantitative components were excluded because sample sizes were too small, different outcome measures than ours were used or no adequate statistics were provided. Yield could not be included because it was absent, outside the scope or otherwise unspecified. Finally, we offer flow charts with clear steps to assist researchers in deciding upon the use of components of MMS. Our study demonstrates that MMS can cover new areas and therefore cannot be neglected in a research synthesis.     

Integrating the Nash program into mechanism theory

Abstract. The present paper provides a method by which the Nash Program may be embedded into mechanism theory. It is shown that any result stating the support of any solution of a cooperative game in coalitional form by a Nash equilibrium of some suitable game in strategic form can be used to derive the mechanism theoretic Nash-implementation of that solution. Received: 29 June 1999 / Accepted: 3 April 2002     

Sociological explanation and mixed methods: the example of the Titanic

Quality & Quantity - The question of how and with what methods the social sciences should explain phenomena is fiercely contested. While several scholars have argued that mixed methods may help...     

Revisiting IS research practice in the era of big data

Through building and testing theory, the practice of research animates data for human sense-making about the world. The IS field began in an era when research data was scarce; in today's age of big data, it is now abundant. Yet, IS researchers often enact methodological assumptions developed in a time of data scarcity, and many remain uncertain how to systematically take advantage of new opportunities afforded by big data. How should we adapt our research norms, traditions, and practices to reflect newfound data abundance? How can we leverage the availability of big data to generate cumulative and generalizable knowledge claims that are robust to threats to validity? To date, IS academics have largely welcomed the arrival of big data as an overwhelmingly positive development. A common refrain in the discipline is: more data is great, IS researchers know all about data, and we are a well-positioned discipline to leverage big data in research and teaching. In our opinion, many benefits of big data will be realized only with a thoughtful understanding of the implications of big data availability and, increasingly, a deliberate shift in IS research practices. We advocate for a need to re-visit and extend traditional models that are commonly used to guide much of IS research. Based on our analysis, we propose a research approach that incorporates consideration of big data—and associated implications such as data abundance—into a classic approach to building and testing theory. We close our commentary by discussing the implications of this hybrid approach for the organization, execution, and evaluation of theory-informed research. Our recommendations on how to update one approach to IS research practice may have relevance to all theory-informed researchers who seek to leverage big data.     

Assessing legitimation in mixed research: a new framework

In this article, we have merged or intersected two typologies: Greene’s (Res Sch 13(1):93–98, 2006) four-domain typology for developing a methodological or research paradigm in the social and behavioral sciences and Onwuegbuzie and Johnson’s (Res Sch 13(1):48–63, 2006) nine-component typology for assessing mixed research legitimation. We argue that merging or interconnecting these typologies present a framework for assessing legitimation in mixed research. Specifically, we demonstrate how the nine types of legitimation map onto Greene’s (Res Sch 13(1):93–98, 2006) four methodological domains and illustrate how legitimation in mixed research, rather than being viewed as a procedure that occurs at a specific step of the mixed research process, is better conceptualized as a continuous iterative, interactive, and dynamic process. Additionally, in presenting this framework, we hope to reduce misperceptions that some researchers have voiced about mixed research.     

Marginal values of water quantity and quality variations

A model is presented that incorporates water quantity and quality aspects and a market-based system is developed to characterize optimum water allocations between two regions or countries. A methodology is developed to compute an optimal policy that could support an interregional optimum water quantity and quality allocation in case that the relevant authorities of both regions agreed to impose it. The methodology is illustrated using the case of the Nestos river in the Balkans.     

Health status indexes: The trade-off between quantity and quality of life

In the last decade many attempts have been made to combine mortality and morbidity statistics in a single, overall health index. In this paper all of these indexes are shown to involve the same general trade-off between quantity and quality of life. All of them allow increases in the quantity of life to offset decreases in average health status. A formally identical trade-off between population size and average happiness has long been debased in utilitarian ethics, with a marked tendency among modern philosophers to decide in favor of average happiness, that is, precisely contrary to recent health-index researchers. Other considerations also suggest that the trade-off implicit in recent health status indexes may not have general support. The paper concludes with a discussion of various ways of proceeding from this point.     

Comparative research in industrial relations: helping the survey cross frontiers

There has been a relative dearth of comparative, cross-national research which has followed a survey-based approach. This partly reflects the difficulty that researchers encounter in collecting such information, either via primary collection or the secondary matching of existing survey material. This paper addresses these difficulties and suggests ways in which their impact can be minimized. It notes that such difficulties are much more severe in the case of secondary matching and are thereby likely to constrain the scope of this approach. They are not totally absent in primary collection and it is suggested that there are limits to what can be achieved during data collection to promote the development of like data-sets across countries. This indicates that great care must be taken in interpreting data so obtained. Despite such limits and cautions, it is nevertheless concluded that the survey approach can be an important adjunct to the process of understanding why the world of work varies across frontiers.     

Would you mind completing this survey: Assessing the state of survey research in supply chain management

In supply chain management, survey research is one of the primary methodologies used by researchers to generate empirical data. Critical to its effectiveness is an acceptable response rate. Recently, concerns have been raised regarding perceived falling response rates. Using data taken from 464 survey-based studies, as drawn from five representative journals that publish survey-based supply chain studies, this study assesses whether these concerns are valid. Furthermore, it assesses whether the various tactics recommended for improving response rates have been successful. The findings indicate that (1) responses rates have been falling (with a significant decrease beginning in 2001); (2) it is difficult to evaluate the effectiveness of the various techniques because of unevenness in reporting of techniques used; and, (3) response rates are significantly influenced by factors such as the number of questions, source of survey population, method of survey delivery, specific respondents targeted, and use of prequalification/pre-notification.     

'More is not necessarily better': the relationship between the quantity and quality of training efforts

International comparisons indicate that, on average, Belgian companies spend less on training than their French, German and Dutch counterparts. Encouraging companies to commit to training has consequently been an important policy goal over the last few years. One notable aspect of the policy to encourage training efforts by companies is that the effort is always represented in terms of the resources invested (input), not in terms of the learning achieved (output) or the quality of training programmes (throughput). Government policy is aimed at increasing the level of investment in company training. One of the questions we wish to investigate is whether this input-oriented approach to the training issue is actually effective. Whether companies will succeed in raising human capital to ever-increasing levels may depend not only (and maybe not even chiefly) on the extent of financial investment in training. The investment level does not necessarily determine the quality of the training processes developed by companies. Therefore, this paper focuses on the following research questions: (1) to what extent do companies monitor the systematic development of sufficiently effective training processes? In other words, is qualitative under-investment an issue, alongside financial under-investment? (2) Is the level of financial investment in company training correlated to the quality of training processes? The empirical data confirm that a kind of 'qualitative' under-investment can be reported and that the relationship between the level of investment in training and the quality of the training programmes is weak.