Impact evaluation of multiple overlapping programs under a conditional independence assumption

Under the assumption on conditional independence between potential outcomes and program assignment, program impacts measured by the Average Treatment Effect (ATE) and the Average Treatment Effect on Treated (ATT) can be identified and estimated using cross-section regression or propensity score matching (PSM). Traditional impact literature often deals with the impact evaluation of a single program. In reality, one can participate in several programs simultaneously and the programs may be correlated. This paper discusses cross-section regression and PSM methods in this general context. It is shown that under the PSM method, impact of a program of interest can be measured as a weighted average of program impacts on groups with different program statuses. Estimation of impacts of multiple overlapping programs is illustrated using Monte Carlo simulation and an empirical example of impact measurement of international and internal remittances in Vietnam.     

Search in cities

The aim of this paper is to expose the recent developments of urban search models which incorporate a land market into a search-matching framework. Using these models, we will be able to explain why unemployment rates vary within a city, how city structure affects workers’ labor-market outcomes, how unemployment benefits and the job-destruction rate affect the growth of cities and why workers living far away from job centers search less intensively and experience higher unemployment rates than those residing closer to jobs. We are also able to explain why, as compared to whites, black workers spend more time commuting to work but travel less miles and search for jobs over a smaller area.     

The Economic Impact of AIDS Treatment: Labor Supply in Western Kenya

Using longitudinal survey data collected in collaboration with a treatment program, this paper estimates the economic impacts of antiretroviral treatment. The responses in two outcomes are studied: (1) labor supply of treated adult AIDS patients; and (2) labor supply of individuals in patients' households. Within six months after treatment initiation, there is a 20 percent increase in the likelihood of the patient participating in the labor force and a 35 percent increase in weekly hours worked. Young boys in treated patients' households work significantly less after treatment initiation, while girls and adult household members do not change their labor supply.     

Semiparametric Difference-in-Differences Estimators

The difference-in-differences (DID) estimator is one of the most popular tools for applied research in economics to evaluate the effects of public interventions and other treatments of interest on some relevant outcome variables. However, it is well known that the DID estimator is based on strong identifying assumptions. In particular, the conventional DID estimator requires that, in the absence of the treatment, the average outcomes for the treated and control groups would have followed parallel paths over time. This assumption may be implausible if pre-treatment characteristics that are thought to be associated with the dynamics of the outcome variable are unbalanced between the treated and the untreated. That would be the case, for example, if selection for treatment is influenced by individual-transitory shocks on past outcomes (Ashenfelter's dip). This article considers the case in which differences in observed characteristics create non-parallel outcome dynamics between treated and controls. It is shown that, in such a case, a simple two-step strategy can be used to estimate the average effect of the treatment for the treated. In addition, the estimation framework proposed in this article allows the use of covariates to describe how the average effect of the treatment varies with changes in observed characteristics.     

Price Regulation in Australia: How Consistent Has It Been?

We assemble a database consisting of 52 regulatory decisions made by seven different regulators across five different industries. We examine how the proportion of firms' revenue requirements that were disallowed by the regulator vary by regulator, industry and time. Despite the differences in the implementation of price regulation across industries and across jurisdictions in Australia, outcomes are surprisingly consistent. For example, we show that it is not possible to reject the hypothesis that the regulatory outcomes in South Australia, New South Wales, the Australian Capital Territory and Victoria are similar despite the different regulatory approaches undertaken in these jurisdictions.     

The Australian Labour Market and the Early Impact of COVID-19: An Assessment

From March to June 2020 was the most dramatic four months in the history of the Australian labour market. Never before has a such a substantial decrease in labour demand (and partial reversal) occurred so quickly. In this article, we present an overview of the early impact of COVID-19: the main drivers it brought into play and the consequent labour market developments. Aggregate effects and how impacts differed by type of job and worker are described. We conclude with a brief review of the main government response to COVID-19, the JobKeeper program.     

Estimating Risk Attitudes in Denmark: A Field Experiment*

We estimate individual risk attitudes using controlled experiments in the field in Denmark. The experiments were carried out across Denmark using a representative sample of 253 people between 19 and 75 years of age. Risk attitudes are estimated for various individuals differentiated by socio‐demographic characteristics. Our results indicate that the average Dane is risk averse, and that risk neutrality is an inappropriate assumption to apply. We also find that risk attitudes vary significantly with respect to several important socio‐demographic variables such as age and education. However, we do not find any effect of sex on risk attitudes.     

The market-based dissemination of energy-access technologies as a business model for rural entrepreneurs: Evidence from Kenya

Improving access to more modern forms of energy requires supply chains that reach further into rural areas. This paper studies a supply-side intervention intended to foster last-mile distribution of energy-access technologies through local small-scale entrepreneurship. We use a staggered-implementation evaluation design to assess the impact on employment and income outcomes of the intervention, which is a large-scale program in Kenya that supports the diffusion of improved cookstoves and small solar products. The results demonstrate how trained entrepreneurs intensify and diversify their income-generating activities, often by shifting away from subsistence farming as a main source of income. For cookstove entrepreneurs, this goes along with improvements in individual and household incomes as well as perceived economic well-being. Our estimates suggest that impacts do not only differ between the two technologies but also across subgroups including gender, age, and baseline occupation. Our findings substantiate that market-based interventions can foster energy access in rural areas by supporting the establishment of local businesses. We highlight several contextual factors that are of relevance when considering the adoption of this approach.     

The aggregate labor market effects of the Swedish Knowledge Lift program

The Swedish adult education program known as the Knowledge Lift (1997–2002) was unprecedented in its size and scope, aiming to raise the skill level of large numbers of low-skill workers. This paper evaluates the potential effects of this program on aggregate labor market outcomes. This is done by calibrating an equilibrium search model with heterogeneous worker skills using pre-program data and then forecasting the program impacts. We compare the forecasts to observed aggregate labor market outcomes after termination of the program.     

The welfare implications of increasing disability insurance benefit generosity

In order to evaluate whether workers are over- or under-insured through the Disability Insurance (DI) program, we develop a framework that allows us to simulate the benefits as well as the costs associated with marginal changes in payment generosity from a representative cross-sectional sample of the population. Under the assumption that individuals are reasonably risk averse, we find that the typical worker would value increased benefits somewhat above the average costs of providing them. However, whether the benefit increases tend to lower or raise utility when we average across all individuals in our sample is sensitive to assumptions that affect the relative marginal utility of income to disabled individuals.     

Higher-order risk preferences in social settings

We study prudence and temperance (next to risk aversion) in social settings. Previous experimental studies have shown that these higher-order risk preferences affect the choices of individuals deciding privately on lotteries that only affect their own payoff. Yet, many risky and financially relevant decisions are made in the social settings of households or organizations. We elicit higher-order risk preferences of individuals and systematically vary how an individual’s decision is made (alone or while communicating with a partner) and who is affected by the decision (only the individual or the partner as well). In doing so, we can isolate the effects of other-regarding concerns and communication on choices. Our results reveal that the majority of choices are risk averse, prudent, and temperate across social settings. We also observe that individuals are influenced significantly by the preferences of a partner when they are able to communicate and choices are payoff-relevant for both of them.     

Past experience of uncertainty affects risk aversion

In an experiment with more than 500 participants we study how past experience of uncertainty (imperfect knowledge of the state space) affects risk preferences. Participants in our experiment choose between a sure outcome and a lottery in 32 periods. All treatments are exactly identical in periods 17–32 but differ in periods 1–16. In the early periods of the risk treatment there is perfect information about the lottery; in the ambiguity Treatment participants perfectly know the outcome space but not the associated probabilities; in the unawareness treatment participants have imperfect knowledge about both outcomes and probabilities. We observe strong treatment effects on behavior in periods 17–32. In particular, participants who have been exposed to an environment with very imperfect knowledge of the state space subsequently choose lotteries with high (low) variance less (more) often compared to other participants. Estimating individual risk attitudes from choices in periods 17–32 we find that the distribution of risk attitude parameters across our treatments can be ranked in terms of first order stochastic dominance. Our results show how exposure to environments with different degrees of uncertainty can affect individuals’ subsequent risk-taking behavior.     

The impact of the Bolsa Escola/Familia conditional cash transfer program on enrollment, dropout rates and grade promotion in Brazil

We examine the impact of Brazil's Bolsa Escola/Familia program on Brazilian children's education outcomes. Bolsa provides cash payments to poor households if their children (ages 6 to 15) are enrolled in school. Using school census data to compare changes in enrollment, dropping out and grade promotion across schools that adopted Bolsa at different times, we estimate that the program has: increased enrollment by about 5.5% (6.5%) in grades 1-4 (grades 5-8); lowered dropout rates by 0.5 (0.4) percentage points in grades 1-4 (grades 5-8); and raised grade promotion rates by 0.9 (0.3) percentage points in grades 1-4 (grades 5-8). About one third of Brazil's children participate in Bolsa, so assuming no spillover effects onto non-participants implies that Bolsa's impacts are three times higher than these estimates. However, simple calculations using enrollment impacts suggest that Bolsa's benefits in terms of increased wages may not exceed its costs.     

Temporal insensitivity of willingness to pay and implied discount rates

A number of studies have defined and tested the temporal sensitivity of willingness to pay to payment schemes and the resulting implied discount rates for environmental projects. We demonstrate that those studies have imposed restrictive assumptions on the structure of the willingness to pay function and the underlying decision process. We investigate the temporal sensitivity of willingness to pay using a new temporal willingness to pay function applied to a proposed oyster reef restoration program. We find that (1) holding the length of the project constant, the temporal willingness to pay for the project is the same across different payment schemes, (2) temporal willingness to pay does not vary significantly across projects of varying lengths, and (3) estimated discount rates are low relative to previous studies, but vary significantly across payment schemes and project lengths.     

Linking scenarios across geographical scales in international environmental assessments

The development and analysis of scenarios or plausible futures has evolved to be a useful approach for dealing with uncertainty about future developments in a structured and integrated manner. Commonly, scenario exercises have focussed on processes at one specific geographic scale. Recently scenario-based approaches have also been used to address multi-scale processes or to link scenarios developed at various geographical scales with each other in order to better understand the interaction of processes across scales.The level of interconnectedness across scales will vary, and depends largely on the approaches used to develop multi-scale scenarios. We distinguish five levels of interconnectedness scenarios may display across scales: (a) Equivalent, (b) Consistent, (c) Coherent, (d) Comparable, and (e) Complementary. Furthermore, we describe five different types of coupled scenario development processes: (a) Joint, (b) Parallel, (c) Iterative, (d) Consecutive, and (e) Independent.Based on this nomenclature, the relationship between the level of interconnectedness of scenarios and the degree of coupling of scenario development processes across geographical scales is discussed. Which process is best suited and how much interconnectedness is needed, will depend both on the focal issue and the primary purpose of the scenario exercise, i.e. whether the aim is education, scientific exploration, or decision-support.     

Does more cash in conditional cash transfer programs always lead to larger impacts on school attendance?

There is considerable evidence that conditional cash transfer (CCT) programs can have large impacts on school enrollment, including in very poor countries. However, little is known about what features of program design account for the observed outcomes. In this paper we analyze the impact of a program in Cambodia that made payments of varying magnitude to otherwise comparable households. The identification is based on a sharp regression discontinuity design. We find that a modest cash transfer, equivalent to approximately 2% of the consumption of the median recipient household, had a substantial impact on school attendance, approximately 25 percentage points. A somewhat larger transfer did not raise attendance rates above this level.     

A WARM EMBRACE OR THE COLD SHOULDER? WAGE AND EMPLOYMENT OUTCOMES IN ETHNIC ENCLAVES

This paper examines how immigrant enclaves influence labor market outcomes. We examine the effect of variation in ethnic concentration across counties and county subdivisions on both immigrant earnings and employment using the non‐public use, 1‐in‐6 sample of the 2000 U.S. Census. We find that there is heterogeneity in enclave impacts by ethnic group and skill composition of the enclave. While some groups tend to suffer from lower wages and employment propensities when residing in areas with larger ethnic concentrations, others have higher wages and improved employment opportunities in enclaves. (JEL J61, J15, R23)     

Modelling mortality: are we heading in the right direction?

Predicting life expectancy has become of upmost importance in society. Pension providers, insurance companies, government bodies and individuals in the developed world have a vested interest in understanding how long people will live for. This desire to better understand life expectancy has resulted in an explosion of stochastic mortality models many of which identify linear trends in mortality rates by time. In making use of such models for forecasting purposes, we rely on the assumption that the direction of the linear trend (determined from the data used for fitting purposes) will not change in the future, recent literature has started to question this assumption. In this article, we carry out a comprehensive investigation of these types of models using male and female data from 30 countries and using the theory of structural breaks to identify changes in the extracted trends by time. We find that structural breaks are present in a substantial number of cases, that they are more prevalent in male data than in female data, that the introduction of additional period factors into the model reduces their presence, and that allowing for changes in the trend improves the fit and forecast substantially.     

Lower and upper bounds of returns to schooling: An exercise in IV estimation with different instruments

Several recent studies based on `exogenous' sources of variation in educational outcomes show IV estimates of returns to schooling that are substantially higher than the corresponding OLS estimates. Card (1995a, Earnings, schooling, and ability revisited. Research in Labor Economics 14, 23–48) suggests that these results are explained by the existence of heterogenity in individual returns and by the fact that these studies are based on instruments that influence only the educational decision of individuals with high marginal returns due to either liquidity constraints or to high ability. This conclusion is consistent with the local average treatment effect (LATE) interpretation of IV (Imbens and Angrist (1994, Identification and estimation of local average treatment effects. Econometrica 62, 467–475) according to which IV identifies only the average returns of those who comply with the assignment-to-treatment mechanism implied by the instrument. We show evidence for Germany suggesting that returns to schooling are heterogeneous, instruments matter and the LATE interpretation of IV makes sense. With an appropriate choice of instruments we also show how IV can be used to approximate the range of variations of returns to schooling in Germany.     

Heterogeneous preferences for congestion during a wilderness experience

This analysis breaks down the congestion levels experienced during specific parts of a wilderness canoe trip. By explicitly addressing the heterogeneity in preferences for congestion during a trip, we are able to determine the relative value canoeists place on solitude at different points of a trip. Our econometric model utilizes a random effects probit framework to efficiently estimate the welfare impacts of congestion on each trip portion. The welfare effects of congestion levels vary across wilderness areas, parts of a trip and individuals.