Social Desirability Bias in Survey Research on Sustainable Development in Small Firms: an Exploratory Analysis of Survey Mode Effect

Survey methodology has become an increasingly popular weapon of choice in conducting research on the topic of environmental sustainability in the small firm context. However, conventional application of survey research in many empirical studies tends to ignore the inherent issues associated with the mode of administration of survey questionnaires. One of these issues is social desirability bias (SDB) arising from survey modes such as face to face, the assisted type of survey questionnaire administration and mailed or purely self‐administered survey. This study is an analysis of survey data generated by two modes: purely self‐administered and survey enumerator assisted. The paper argues that the presence of an enumerator in the workplace or actual site of the business to administer the survey will motivate the respondents to provide more accurate information about the firms' environmental sustainability knowledge and practices. The article offers suggestions to address SDB in carrying out surveys about environmental sustainability in small firms. Copyright © 2011 John Wiley & Sons, Ltd and ERP Environment.     

Conducting multilevel studies in purchasing and supply management research

Purchasing and supply management (PSM) research commonly covers multiple levels of theory and analysis. The theorizing and simultaneous testing of hypotheses across multiple levels is referred to as multilevel analysis (MLA) and is commonly performed using hierarchical linear modeling (HLM). Researchers in the PSM domain have paid little attention thus far to the topic of multilevel studies. Although MLA holds the potential to yield novel insights into PSM issues, it also generates new challenges for authors and reviewers alike. We contribute to this methodological dialogue by examining reasons for conducting multilevel PSM research and offering practical guidance for increasing its methodological rigor.     

The estimates of philanthropic behavior and attitude in South Korea: Methodological consideration

Estimates on philanthropic giving are one of the major topics within nonprofit studies globally. South Korea has engaged in measuring philanthropic behaviors and attitudes since the early 2000s, however, little is known about the validity of the measures that are used to collect giving and volunteering data. This study aims to investigate the methodological matters of the empirical philanthropy datasets in South Korea. A total of nine datasets were identified that measure philanthropic behaviors and attitudes in South Korea. Among the nine datasets, six were used to analyze the methodological matters for the purposes of this study. This article discusses the challenges associated with research methods including definitional challenges, instrument design issues, and other research methodological issues on the identified philanthropic giving datasets in South Korea. Results of this study suggest insights for improving measures of charitable giving and volunteering in South Korea. The findings are significant because differences in approaches to measuring donation behavior produce substantial differences in reported estimates.     

Asking sensitive questions: the impact of forgiving wording and question context on social desirability bias

Sensitive questions are prone to systematic measurement error due to the respondents?? social desirability concerns. Literature on empirical social research often recommends either positive ??loading?? of sensitive questions, e.g. using ??forgiving?? wording, or manipulating the question context to reduce social desirability bias. We derive theoretical explanations of how manipulations of question wording and context could elicit more socially undesirable answers in sensitive surveys. In an experimental online survey (N?=?1,176), we evaluate the effects of (1) forgiving wording and (2) question context on social desirability bias in different sensitive questions. The empirical evidence on the assumed bias-reducing effects shows inconsistent results. It is indicated however, that the perceived social norm has the strongest and most consistent effect on the respondents?? propensity to self-report socially undesirable behavior.     

Determinants of social desirability bias in sensitive surveys: a literature review

Survey questions asking about taboo topics such as sexual activities, illegal behaviour such as social fraud, or unsocial attitudes such as racism, often generate inaccurate survey estimates which are distorted by social desirability bias. Due to self-presentation concerns, survey respondents underreport socially undesirable activities and overreport socially desirable ones. This article reviews theoretical explanations of socially motivated misreporting in sensitive surveys and provides an overview of the empirical evidence on the effectiveness of specific survey methods designed to encourage the respondents to answer more honestly. Besides psychological aspects, like a stable need for social approval and the preference for not getting involved into embarrassing social interactions, aspects of the survey design, the interviewer’s characteristics and the survey situation determine the occurrence and the degree of social desirability bias. The review shows that survey designers could generate more valid data by selecting appropriate data collection strategies that reduce respondents’ discomfort when answering to a sensitive question.     

The political dimension of intercultural research - the Australian experience

Australia's linguistic, ethnic and racial diversity presents many interesting and important methodological challenges to social science research. A much neglected or even officially unacknowledged dimension of intercultural research endeavours are the political and ideological power structures which not only focus and direct research projects, but also influence, if not determine, methodological approaches. This paper examines some aspects of the various power relations and power structures that have, and continue to have, a significant impact on methodological issues and hence on the validity and reliability of research findings. Since much of the debate about immigration (past, present and future) about settlement practices, service and welfare provisions etc. in Australia centers and relies on cross-cultural studies, methodological issues, and the enhancement of a projects validity and reliability should be of paramount importance. Available evidence suggests that this is not necessarily or always the case.     

Research And Development Productivity And Spillovers: Empirical Evidence At The Firm Level

Abstract.  A variety of methods have been used to investigate the empirical relationship between research and development (R&D) spending and the productivity of firms. The most widely employed frameworks are the production function and the associated productivity framework. In these settings, productivity growth is related to expenditures on R&D, and an attempt is made to estimate statistically the part of productivity growth that can be attributed to R&D activities. This article surveys the expansive body of empirical literature on this subject and finds a large and significant impact of R&D on firm performance on average. However, the estimated returns vary considerably between the different studies due to differences across data samples and econometric models, as well as methodological and conceptual issues. A meta-analysis on the studies surveyed reveals that the estimated rates of return do not significantly differ between countries, whereas the estimated elasticities do. Furthermore, the estimated elasticities are significantly higher in the 1980s and consistently higher in the 1990s compared with the 1970s. Hence, contrary to a widely held belief, we find no convincing evidence of an exhaustion of R&D opportunities in the last two decades.     

Content analytic approach to measuring constructs in operations and supply chain management

This paper presents and illustrates the content analytic approach to measuring constructs in operations and supply chain management (OSCM). In this paper, a methodological review of OSCM empirical research in 2002-2007 is provided to highlight that OSCM empirical studies, unlike those in other business disciplines, have rarely used content analysis as a methodological tool. This paper then reviews the methodological strengths of content analysis, which lie primarily in its malleability, economy of data collection, repeatability, and unobtrusiveness. These strengths not only make content analysis a viable empirical method but also position it as a method that can be used in concert with other empirical methods in OSCM research, such as survey, case study, and secondary research methodologies. This paper also proposes a generic framework for a content analytic approach to measuring theoretical constructs, illustrates the application of the framework to a construct in the OSCM literature (buyer-supplier relationalism), and reports the satisfactory results of reliability and validity tests for the content analysis-based measure of buyer-supplier relationalism. In addition, this paper proposes and demonstrates that the use of convergence study in tandem with content analysis can substantially reduce the content analysis efforts needed in measuring the construct of interest, thus improving the overall efficiency of the process of content analysis.     

Conducting Online Surveys

The World Wide Web (WWW) is increasingly being used as a tool and platform for survey research. Two types of electronic or online surveys available for data collection are the email and Web based survey, and they constitute the focus of this paper. We address a multitude of issues researchers should consider before and during the use of this method of data collection: advantages and liabilities with this form of survey research, sampling problems, questionnaire design considerations, suggestions in approaching potential respondents, response rates and aspects of data processing. Where relevant, the methodological issues involved are illustrated with examples from our own research practice. This methods review shows that most challenges are resolved when taking into account the principles that guide the conduct of conventional surveys.     

Exit-voice and employee absenteeism: A critique of the industrial relations literature

Industrial relations research that has examined the effects of collective voice on employee absenteeism through traditional exit-voice analyses suffers from a number of important theoretical and empirical limitations. The research is limited theoretically in that the framework used cannot discretely classify absenteeism as a form of either exit or voice. This inability reflects a larger problem with the exit-voice framework’s lack of adequate attention to the conditions under which collective voice mechanisms fail and the consequences of such failure for the behavior of industrial relations actors. Exit-voice studies of absenteeism have important methodological problems, particularly in the way absenteeism and voice criteria have been operationalized. These defects in the literature can be addressed through the integration of behavioral theory and research on such topics as absenteeism, exit, voice, loyalty and neglect, and the literature on organizational justice.     

SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING

Abstract Propensity score matching (PSM) has become a popular approach to estimate causal treatment effects. It is widely applied when evaluating labour market policies, but empirical examples can be found in very diverse fields of study. Once the researcher has decided to use PSM, he is confronted with a lot of questions regarding its implementation. To begin with, a first decision has to be made concerning the estimation of the propensity score. Following that one has to decide which matching algorithm to choose and determine the region of common support. Subsequently, the matching quality has to be assessed and treatment effects and their standard errors have to be estimated. Furthermore, questions like ‘what to do if there is choice‐based sampling?’ or ‘when to measure effects?’ can be important in empirical studies. Finally, one might also want to test the sensitivity of estimated treatment effects with respect to unobserved heterogeneity or failure of the common support condition. Each implementation step involves a lot of decisions and different approaches can be thought of. The aim of this paper is to discuss these implementation issues and give some guidance to researchers who want to use PSM for evaluation purposes.     

Validity — the quest for reality in quantitative and qualitative research

It has been argued that fundamentally different methodological approaches have made for ‘two sociologies’. This view has obscured the fact that the problem of validity has to be tackled independently of any specific methodological premises because of the textuality of sociological data. This does not necessarily imply, however, a single, unified strategy for validity testing. In this paper, some basic theoretical presuppositions underlying the approach to validity testing in quantitative research will be contrasted with the strategies offered by Max Weber's methodological writings on the ideal type. It is argued that the use of ideal typical constructs in qualitative research (exemplified by patient's illness careers) allows systematic validity testing despite the important differences in the conceptualization of social reality which is used in quantitative research, thus serving the purpose of any empirical sociological research, that is, to gain valid insight into societies' concrete reality.     

Diversification and Performance: Critical Review and Future Directions*

This article uses an integrative theoretical framework to review existing empirical research on the diversification-performance relationship along the three different research streams which have studied this relationship. the article highlights the considerable diversity in the findings across studies in each stream and identifies certain key theoretical and methodological issues which might help to explain the observed diversity. Also discussed is a contingency-based perspective and several useful directions for future research.     

Researching expatriate types: the quest for rigorous methodological approaches

International talent flow is critical to meeting the needs for skilled human capital in global and multinational organisations and in developed and developing countries. Recent decades have witnessed a boom in research into long‐term skilled international mobility, especially the traditional category of international assignees, but also skilled immigrants and a relatively new expatriate type: self‐initiated expatriates. The upsurge in empirical interest has highlighted a number of issues relating to the way the research has been conducted. This article examines methodological issues associated with research into the three expatriate types and seeks to advise researchers on how future research can be conducted to improve the robustness of results. In this way, practitioners and policy makers may be able to make more use of the empirical evidence.     

Operationalization,a superfluous concept

This paper discusses a number of issues in the methodology of social and behavioral sciences which concern how concepts are defined and related to observations, how theories are constructed, and how we proceed in actual research. Examples are mainly taken from experimental psychology, and from social psychology, but the problems and answers apply to the whole of behavioral and social sciences. These issues are related to philosophy of science. They are, however, presented from the point of view of a researcher who asks himself how to proceed in actual research, and who is critical about the present status of social and behavioral science. The main point is a pledge for a renewed empiricism. This is close to what can be called logical empiricism but should not be identified with any particular-ism. Some issues raised by critics of logical empiricism are addressed in the final section. The first problem deals with how to clarify concepts in behavioral and social science. This will show an unresolvable circularity in operationalization of theoretical constructs. The position and role of measurement is discussed in relation to the objectives of behavioral and social research. Subsequently, it is pointed out that a clear distinction between empirical concepts and theoretical constructs solves many, if not all of the problems of defining and clarifying concepts, thereby obviating the need for a so-called operationalization. It should, however, be very clear from the beginning that we cannot do without operational definitions of theoretical concepts, and that to some extent we must return to the original spirit of operationism, although in a manner which is different from current practice. An important element of the advocated approach is the definition of the empirical domain of a theory in terms of observational categories. Guttman's facet design can be a useful tool to define domains, especially for non-experimental research.     

Inference on stochastic time-varying coefficient models

Recently, there has been considerable work on stochastic time-varying coefficient models as vehicles for modelling structural change in the macroeconomy with a focus on the estimation of the unobserved paths of random coefficient processes. The dominant estimation methods, in this context, are based on various filters, such as the Kalman filter, that are applicable when the models are cast in state space representations. This paper introduces a new class of autoregressive bounded processes that decompose a time series into a persistent random attractor, a time varying autoregressive component, and martingale difference errors. The paper examines, rigorously, alternative kernel based, nonparametric estimation approaches for such models and derives their basic properties. These estimators have long been studied in the context of deterministic structural change, but their use in the presence of stochastic time variation is novel. The proposed inference methods have desirable properties such as consistency and asymptotic normality and allow a tractable studentization. In extensive Monte Carlo and empirical studies, we find that the methods exhibit very good small sample properties and can shed light on important empirical issues such as the evolution of inflation persistence and the purchasing power parity (PPP) hypothesis.     

Advancing the field of employee assistance programs research and practice: A systematic review of quantitative studies and future research agenda

The COVID-19 pandemic has accentuated the critical role of organizational support for the workforce. An employee assistance program (EAP) represents an inclusive strategy which organizations adopt to provide supportive and empathic care to help employees overcome undesirable situations. To date, we have limited knowledge of what EAP issues have been researched from the human resource management (HRM) perspective and what theoretical underpinning these studies have used. This article systematically reviews quantitative empirical studies on EAPs. Drawing upon 115 articles from 72 journals across 40 years (1981–2020), we trace the evolutionary trend of the construct of EAP and shed light on the internal link of EAP with HRM. After summarizing research themes, methods, theories, and approaches to the evaluation of EAPs, we identify pitfalls in the current research and contribute to extending the field by proposing several research agendas for future investigation.