How to examine external validity within an experiment

A fundamental concern for researchers who analyze and design experiments is that the estimate obtained from the experiment might not be externally valid for other policies of interest. Researchers often attempt to assess external validity by comparing data from an experiment to external data. In this paper, I discuss approaches from the treatment effects literature that researchers can use to begin the examination of external validity internally, within the data from a single experiment. I focus on presenting the approaches simply using stylized examples.     

The role of hospital heterogeneity in measuring marginal returns to medical care: a reply to Barreca, Guldi, Lindo, and Waddell

In Almond et al. (2010), we describe how marginal returns to medical care can be estimated by comparing patients on either side of diagnostic thresholds. Our application examines at-risk newborns near the very low birth weight threshold at 1500 g. We estimate large discontinuities in medical care and mortality at this threshold, with effects concentrated at “low-quality” hospitals. Although our preferred estimates retain newborns near the threshold, when they are excluded the estimated marginal returns decline, although they remain large. In low-quality hospitals, our estimates are similar in magnitude regardless of whether these newborns are included or excluded.     

Do Credit Cards Really Reduce Aggregate Money Holdings?

This paper discusses whether the use of credit cards reduces aggregate money holdings in an economy. Applying and modifying the Baumol-Tobin model (Baumol Quarterly Journal of Economics 66:545–556, 1952 and Tobin Review of Economics and Statistics 38(3):241–247, 1956), it studies how much money a credit card bank would normally maintain to support retail trade, and shows that whether or not the use of credit cards actually reduces the aggregate demand for money depends on how often consumers visit the bank and how long it takes to clear a check. With innovations in the banking industry such as ATMs, online banking, and other electric funds transfer services, the cost of visiting banks (i.e., switching funds between a checkable account and an interest-earning account) is now very low. For the whole economy, as a result, the use of credit cards may not necessarily reduce aggregate money holdings.     

Environmental Performance Reporting for Natural Area Tourism: Contributions by Visitor Impact Management Frameworks and Their Indicators

Environmental performance reporting is being increasingly demanded of many sectors of society, including those responsible for managing natural area tourism. Recent approaches include corporate reporting, state-of-the-environment reporting, and environmental management systems. This paper evaluates the usefulness of visitor impact management frameworks and associated resource and social indicators, both of which have a rich history of application to wilderness and backcountry management, for performance reporting on natural area tourism management. The evaluation draws on a recently developed evaluation framework for protected area management, plus detailed criteria, to address today's environmental performance reporting needs. Against these criteria, the visitor impact management frameworks rated well, with the Limits of Acceptable Change rating the highest. Resource and social indicators also showed great potential for performance reporting provided they are meaningful to senior managers, politicians and other stakeholders. Integrating these frameworks and their resource and social indicators into today's performance reporting, especially into state-of-the-environment reporting and environmental management systems, could significantly advance meaningful performance reporting for natural area tourism management.     

“China,why not?”: serious leisure and transmigrant runners’ stories from Beijing

The purpose of this study was to examine how amateur, serious distance runners negotiate their running practices upon transnational migration to China. Despite the extensive body of research into expatriate experiences and adaptation, serious leisure as a site where meaning-making occurs has not been studied in existing research. Through interviews with five female and two male expatriates, we studied the ways in which Western runners brought meaning to the transition experience and negotiated meanings and bodily practices associated with running. Through narrative analysis, we identified three core narratives of migration (possibility, necessity and growing up) and two emergent narratives (community and running to feel like oneself) about shifting meaning in running. We conclude with implications for future research in serious leisure and migration studies.     

Consumer Response toward Plus‐Size Models Featured in the Mainstream Media

The rise of the body acceptance movement among consumers has led several brands and media outlets to feature models with diverse body shapes and sizes. However, little research has examined consumer reactions to these nontraditional models. This exploratory study addresses this gap by examining consumer response to three different instances in which a plus‐size model was featured in a popular press magazine. Discourse analysis examined consumer‐generated online comments. Three broad themes were identified that included positive sentiment related to more inclusivity in media representations of women: concern about model body size and health, and questions around how a “plus” size body is defined. This work offers insight into consumer response to plus‐size models, sheds light into how society views the plus‐size body and health, as well as how brands can begin to integrate plus‐size models into marketing and advertising campaigns.     

Disability status,individual variable pay,and pay satisfaction: Does relational and institutional trust make a difference?

Although prior research suggests that disabled employees have different needs in the context of some HRM practices, we know little about their reactions to reward systems. We address this gap in the literature by testing a model using the 2011 British Workplace Employee Relations Survey (disabled employees, n = 1,251; nondisabled employees, n = 9,959; workplaces, n = 1,806) and find that disabled employees report lower levels of pay satisfaction than nondisabled employees, and when compensated based on individual performance, the difference in pay satisfaction is larger. We suggest that relational (derived from trust in management) and institutional (derived from firm‐wide policies and HRM practices, both intended to provide equitable treatment to disabled employees) forms of trust play important roles. The results of multilevel analyses show that when trust in management is high, the difference in pay satisfaction under variable pay is reduced. We find just the opposite for employees who work in organizations with a formal disability policy but without supportive HRM practices; the gap in pay satisfaction is exacerbated. However, the combination of the presence of a firm‐wide policy and HRM practices reduced the difference in pay satisfaction. Implications of the findings for theory, future research, and management practice are discussed.     

Are Congressional Black Caucus Members More Reliable? Loyalty Screening and Committee Assignments of Newly Elected Legislators

A bstract .   As previous research has suggested, the Congressional Black Caucus (CBC) demonstrates the characteristics of a well-functioning vote-producing cartel in both the degree and uniformity to which it supports the leadership of the Democratic Party in the U.S. House of Representatives. As previous work has pointed out, this cartel is, therefore, rewarded by House Democrats through selection for service on "important" committees at the beginning of each Congress. However, Democratic leaders have very little, if any, information to guide them in their choices regarding committee placement for newly elected Democratic representatives. As such, they are likely to use past CBC uniformity and loyalty as a low-cost screening device for predicting future reliability. Examination of the committee placement of newly elected Democrats to the U.S. House from the 103^rd Congress through the 106^th Congress reveals such a pattern by House Democratic leaders. In other words, newly elected CBC Democrats face much higher probabilities of receiving "important" committee assignments than their newly elected non-CBC counterparts, ceteris paribus .     

The Changing Distribution of Male Wages in the U.K.

This paper uses microeconomic data from the U.K. Family Expenditure Surveys (FES) and the General Household Surveys (GHS) to describe and explain changes in the distribution of male wages. Since the late 1970s wage inequality has risen very fast in the U.K., and this rise is characterized both by increasing education and age differentials. We show that a large part of the changes in the U.K. can be summarized quite simply as increases in eduction differentials and a decline of growth of entry level wages which persist subsequently. This fact we interpret as cohort effects. We also show that, like in the U.S., an important aspect of rising wage inequality is increased within-group wage dispersion. Finally we use the GHS to evaluate the role of alternative education measures.