Evaluating rater training with double-pretest one-posttest designs: an analysis of testing effects and the moderating role of rater self-efficacy

Abstract

Previous research on performance appraisal in Human Resource Management has found that frame-of-reference (FOR) training can improve rating accuracy. However, both the time-consuming development of training materials and the almost exclusive use of experimental evaluation designs limit the dissemination of FOR training as well as a better understanding of how and when it works. Therefore, unlike past research, the present studies used more general rater training materials and examined improvements in rater accuracy by means of a double-pretest one-posttest design. Study 1, using a student sample (the majority being part-time employees; N = 58), demonstrated the effectiveness of the rater training over and above a testing effect. Study 2 with participants from the workforce population (N = 45) replicated these results. In addition, in Study 2, pre-training rater self-efficacy moderated rater training effectiveness such that the rating accuracy of trainees with low self-efficacy improved more than did accuracy scores of trainees high in rater self-efficacy. We conclude that an effective FOR training can be conducted with less organization-specific materials, though both testing effects must be controlled for and individual differences (i.e. rater self-efficacy) between trainees have to be taken into account.     

Optimal portfolio selection via conditional convex risk measures on L p

We consider conditional convex risk measures on L ^p and show their robust representation in a standard way. Such measures are used as evaluation functionals for optimal portfolio selection in a Black&Scholes setting. We study this problem focusing on the conditional Average Value at Risk and the conditional entropic risk measure and compare the respective optimizers.     

Does acquiring venture capital pay off for the funded firms? A meta-analysis on the relationship between venture capital investment and funded firm financial performance

Researchers and practitioners frequently propose that venture capital (VC) is an important resource to increase the performance of funded firms, especially in environments of uncertainty. In this paper we scrutinize these theoretical propositions, following an evidence-based research approach. We synthesize 76 empirical samples on 36,567 firms. We find a small positive performance effect of VC investment on funded firm performance; however, the effect vanishes if researchers control for industry selection effects. Furthermore, we find that the performance effect mainly relates to firm growth while profitability is unaffected. We also uncover that performance effects are reduced when the funded firms are very young or very mature. In addition, studies focusing on IPO events, which constitute the majority of studies, determine a substantially smaller performance effect. We discuss theoretical implications and offer suggestions for future research on VC.     

The Recipe for the Perfect Review?

Online product reviews, originally intended to reduce consumers’ pre-purchase search and evaluation costs, have become so numerous that they are now themselves a source for information overload. To help consumers find high-quality reviews faster, review rankings based on consumers’ evaluations of their helpfulness were introduced. But many reviews are never evaluated and never ranked. Moreover, current helpfulness-based systems provide little or no advice to reviewers on how to write more helpful reviews. Average review quality and consumer search costs could be much improved if these issues were solved. This requires identifying the determinants of review helpfulness, which we carry out based on an adaption of Wang and Strong’s well-known data quality framework. Our empirical analysis shows that review helpfulness is influenced not only by single-review features but also by contextual factors expressing review value relative to all available reviews. Reviews for experiential goods differ systematically from reviews for utilitarian goods. Our findings, based on 27,104 reviews from Amazon.com across six product categories, form the basis for estimating preliminary helpfulness scores for unrated reviews and for developing interactive, personalized review writing support tools.     

Harnessing Wicked Problems in Multi-stakeholder Partnerships

Despite the burgeoning literature on the governance and impact of cross-sector partnerships in the past two decades, the debate on how and when these collaborative arrangements address globally relevant problems and contribute to systemic change remains open. Building upon the notion of wicked problems and the literature on governing such wicked problems, this paper defines harnessing problems in multi-stakeholder partnerships (MSPs) as the approach of taking into account the nature of the problem and of organizing governance processes accordingly. The paper develops an innovative analytical framework that conceptualizes MSPs in terms of three governance processes (deliberation, decision-making and enforcement) harnessing three key dimensions of wicked problems (knowledge uncertainty, value conflict and dynamic complexity). The Roundtable on Sustainable Palm Oil provides an illustrative case study on how this analytical framework describes and explains organizational change in partnerships from a problem-based perspective. The framework can be used to better understand and predict the complex relationships between MSP governance processes, systemic change and societal problems, but also as a guiding tool in (re-)organizing governance processes to continuously re-assess the problems over time and address them accordingly.     

App Users Unwittingly in the Spotlight: A Model of Privacy Protection in Mobile Apps

Mobile apps are increasingly jeopardizing app users' online privacy by collecting, storing, and sharing personal data disclosed via apps. However, little is known about mobile app users' current privacy protection behavior and the factors that motivate it. Drawing on Roger's Protection Motivation Theory (PMT), this study develops and tests the App Privacy Protection Model among 1,593 Western European app users. The results demonstrate that, on the one hand, increased levels of perceived self‐efficacy, vulnerability, and privacy concern enhance mobile app users' motivation to engage in risk‐reducing behavior, while on the other hand, higher levels of knowledge of the data collection practices of mobile apps, app attitude, and perceived response costs diminish it. Being the first study that applies PMT in the mobile app context, this study offers several important implications regarding privacy protection in mobile apps.     

How Techniques of Neutralization Legitimize Norm- and Attitude-Inconsistent Consumer Behavior

In accordance with societal norms and values, consumers readily indicate their positive attitudes toward sustainability. However, they hardly take sustainability into account when engaging in exchange relationships with companies. To shed light on this paradox, this paper investigates whether defense mechanisms and the more specific concept of neutralization techniques can explain the discrepancy between societal norms and actual behavior. A multi-method qualitative research design provides rich insights into consumers’ underlying cognitive processes and how they make sense of their attitude–behavior divergences. Drawing on the Ways Model of account-taking, which is advanced to a Cycle Model, the findings illustrate how neutralization strategies are used to legitimize inconsistencies between norm-conforming attitudes and actual behavior. Furthermore, the paper discusses how the repetitive reinforcement of neutralizing patterns and feedback loops between individuals and society are linked to the rise of anomic consumer behavior.     

Convenient Stalemates: Why International Patent Law Negotiations Continue Despite Deadlock

For almost 30 years, industrialised, emerging and developing countries negotiate on a substantive patent law harmonisation under the umbrella of the World Intellectual Property Organization (WIPO). Although a common approach or at least some vague outlines of common ground seem beyond reach, all participants regularly agree on a continuation of the discussion process. Despite an incessant wheeling and dealing among delegates and WIPO officials, the only effect is that discussions still keep going on. In our paper, we draw on a synthesis of both neo-mercantilist and liberal institutionalist insights in order to explain the vibrant stalemate of substantive patent law harmonisation talks. We argue that WIPO's involvement in the negotiation process offers an incentive structure for states to continue negotiations even when a successful conclusion appears rather improbable or downright undesirable. WIPO officials do not necessarily oppose the alternative deployment of their resources and services, because national negotiators' tactics at least partially coincide with their own interests. The paper concludes with a summary of the major results and a discussion on their potential empirical and theoretical relevance for further studies.