Provision Point Mechanisms and Field Validity Tests of Contingent Valuation

Past field validity tests of contingent valuation have relied on voluntary contribution mechanisms to elicit actual willingness to pay, and may overestimate hypothetical bias because of free riding in the actual contributions. This paper argues that provision point mechanisms are a preferred alternative for field validity tests of contingent valuation because they increase the proportion of demand revealed in cases in which public goods can be provided in a step function. The results of a contingent valuation validity study of participation in a green electricity pricing program that uses a provision point mechanism are reported, and hypothetical open-ended and dichotomous choice responses are compared to actual participation. Calibration of hypothetical responses is also explored.     

Theoretical incentive properties of contingent valuation questions: Do they matter in the field?

Green et al. (1998) [Green, D., Jacowitz, K.E., Kahneman, D., McFadden, D., 1998. Referendum contigent valuation, anchoring, and willingness to pay for public goods. Resource and Energy Economics 20 (2), 85−116] show theoretically that stated preference questions about public services can be framed in such ways that if the subjects accept the frame the payoff­maximizing behavior will be to answer truthfully. One key element of such a theoretically incentive­compatible framing is that the (hypothetical) decision rule specified in the survey instrument is understood to be a majority rule rather than the efficiency rule typically used in cost­benefit analysis. We conducted field experiments in Germany and Switzerland to test if a referendum framing as suggested by Green et al. is effective in reducing strategic misrepresentation in a contingent valuation setting. We did not find the expected effects of the framing treatments on stated willingness to pay or on individuals' (stated) beliefs about the social choice context. The results do not support hopes that a theoretically incentive compatible framing could be purposefully used to invoke the specific beliefs about the linkage between responses and policy implementation that would make stated preference questions incentive compatible.     

Contingent valuation and actual payment for voluntarily provided passive-use values: Assessing the effect of an induced truth-telling mechanism and elicitation formats

A fundamental question about the contingent valuation (CV) method is to what degree it predicts actual payments (AP). This has particularly been an intriguing matter related to voluntary provision of public goods representing primarily passive-use values. This paper reports the results from such a CV–AP comparison. Applying a voluntary payment mechanism there exists a theoretical expectation of upward bias in CV estimates and downward bias in AP. This study applied an induced truth-telling mechanism in one treatment group to assess the hypothetical bias effect in CV. The CV estimates in this treatment group were significantly lower than in the group that did not face this mechanism. But this effect was limited to those responding/acting to dichotomous choice, not affecting those responding to open-ended questions about willingness to pay.     

Testing the Effectiveness of Certainty Scales,Cheap Talk,and Dissonance-Minimization in Reducing Hypothetical Bias in Contingent Valuation Studies

Stated preference methods such as contingent valuation and choice modeling are subject to various biases that may lead to differences between actual and hypothetical willingness to pay. Cheap talk, follow-up certainty scales, and dissonance minimization are three techniques for reducing this hypothetical bias. Cheap talk and certainty scales have received considerable attention in the literature, but dissonance minimization has not previously been experimentally tested. Using a four-way split sample design involving over 600 subjects, results from an actual referendum on provision of a quasi-public good were compared with three similar but contingent referenda employing the three bias-reducing techniques. Hypothetical bias was again present. Certainty scales, when properly calibrated, and dissonance minimization were found to be most effective in reducing the bias.     

Contingent values as implicit contracts: estimating minimum legal willingness to pay for conservation of large carnivores in Sweden

Mean willingness-to-pay (WTP) based on multiple bounded, discrete choice responses from contingent valuation surveys are normally obtained using some kind of parametric estimator. This paper instead exploits the possibility to interpret the response to the discrete-choice question as an implicit contract between the researcher and the respondent, resulting in a minimum legal WTP (MLW) estimator. Never previously used in valuation literature, it is used in this paper to estimate the WTP for the preservation of large carnivores in Sweden, based on a large scale, national survey. Results show that MLW estimates only were 12–19% of the comparable parametric estimates. In keeping with other results in contingent valuation literature, we find that the MLW estimates are positively related to the educational level, income and the fraction of urban population, while negatively related to age. Among the advantages of the MLW estimator is its transparency as well as the fact that it rests on a contractual notion of WTP.      

Preference uncertainty in contingent valuation

In this paper, the results of empirical studies that applied two widely used methods - numerical certainty scale (NCS) and polychotmous choice (PC) - for estimating preference uncertainty adjusted willingness to pay (WTP) in contingent valuation (CV), are summarized. For this review, a number of conclusions are reached. First, there is a lack of consensus about which method is more appropriate for measuring preference uncertainty. Second, although preference uncertainty information has been found useful in detecting the incidence of hypothetical bias in CV studies, a consensus about a standard certainty threshold (or treatment mechanism) at which hypothetical behaviour converges to real behaviour is yet to emerge. Third, insufficient empirical evidence exists about the causal relationship between preference uncertainty scores and the theoretically expected explanatory variables. Finally, the preference uncertainty adjusted PC and NCS models fail to provide a consistent and more efficient welfare estimate compared to the conventional dichotomous choice certainty model.     

A comparison of empirical models used to infer the willingness to pay in contingent valuation

The essence of the contingent valuation method consists of creating a hypothetical market where respondents are asked about their willingness to pay (WTP) for a non-market good. Different empirical models can be formulated to estimate the expected WTP of a sample of respondents and, then, through aggregation, the social valuation of the good is inferred.This paper outlines the relevance of the distributional assumptions when estimating mean WTP. Several parametric and non-parametric methods are discussed and applied to calculate the existence value of a natural space. Results show that WTP is extremely sensitive to the empirical model used.First version received: November 2002 / Final version received: January 2004     

Comparing continuous and discrete contingent valuation questions

This paper explores two commonly used methods to elicit an individual's willingness to pay (WTP) for a public good in contingent valuation studies. Currently, the most preferred method is the take-it-or-leave valuation question, or discrete valuation question (DVQ), where the respondent accepts or rejects a suggested cost for the good. The traditional method, the continuous valuation question (CVQ), simply asks an individual to state his WTP for the suggested change in the provision of a public good like cleaner air. We introduce a simple way to compare the results from these two methods. We also test the anchoring behavior suggested in the psychological literature on choice under uncertainty. The results do not support the anchoring hypothesis, but suggest the hypothesis that people perceive the two tested valuation questions differently.I would like to thank Prof. Glenn Harrison, University of South Carolina, Prof. P-O Johansson, Stockholm School of Economics, Prof. Jason Shogren, Iowa State University, and two referees for helpful comments. The usual disclaimer applies.     

Public Preferences for Hydrogen Buses: Comparing Interval Data, OLS and Quantile Regression Approaches

We use a quantile regression (QR) approach to analyse contingent valuation estimates of public willingness to pay (WTP) for the air and noise pollution reductions associated with the introduction of hydrogen buses in London. QR results show that variables that were not significant in interval regression or ordinary least squares regression become significant at certain quantiles along the WTP distribution. In addition, the determinants of WTP at the lower tail of the distribution differ from those at the higher end of the distribution. Our findings illustrate the usefulness of quantile regression methods for analysing contingent valuation data, enhancing our understanding of the determinants of willingness to pay.     

Using Choice Experiments to Value the Environment

This paper we outline the “choice experiment” approach to environmental valuation. This approach has its roots in Lancaster's characteristics theory of value, in random utility theory and in experimental design. We show how marginal values for the attributes of environmental assets, such as forests and rivers, can be estimated from pair-wise choices, as well as the value of the environmental asset as a whole. These choice pairs are designed so as to allow efficient statistical estimation of the underlying utility function, and to minimise required sample size. Choice experiments have important advantages over other environmental valuation methods, such as contingent valuation and travel cost-type models, although many design issues remain unresolved. Applications to environmental issues have so far been relatively limited. We illustrate the use of choice experiments with reference to a recent UK study on public preferences for alternative forest landscapes. This study allows us to perform a convergent validity test on the choice experiment estimates of willingness to pay.     

Anchors,endorsements, and preferences: A field experiment

This study investigates how access to political endorsements affects stated preferences for an environmental public good in Switzerland. We developed a contingent valuation survey questionnaire with two valuation questions, the first formulated as a (hypothetical) policy referendum, the second an open-ended WTP question. For the referendum question we solicited endorsements from a range of political parties and relevant interest groups. We then conducted a split-sample mail-survey experiment in which a table listing the endorsements was included with a subsample of the questionnaires. Access to the policy endorsements significantly affected the responses to the open-ended willingness-to-pay question.     

Induced-Value Tests of Contingent Valuation Elicitation Mechanisms

Using an induced-value experimental design that varies whether values for a “good” are certain or uncertain and whether payment is real or hypothetical, this study investigates issues of demand revelation, hypothetical bias, and value uncertainty for four elicitation mechanisms used in contingent valuation surveys: dichotomous choice, dichotomous choice with follow-up certainty question, payment card, and multiple-bounded discrete choice. For all elicitation mechanisms, we find no evidence of hypothetical bias: voting decisions do not vary systematically when payment is hypothetical versus when it is real. Under all design conditions we find the fewest deviations between stated and induced values and the strongest evidence of demand revelation with dichotomous choice. Stated uncertainty in dichotomous choice follow-up and multiple-bounded discrete choice questions does correlate with uncertain induced values, but the signal is noisy. We discuss the implications of our findings for the design of contingent valuation surveys.     

Joint estimation of contingent valuation survey responses

Hanemann's utility difference model for the dichotomous choice contingent valuation method is modified to account for interrelationships between responses to a set of contingent valuation questions. A nonlinear seemingly unrelated regression model is presented to jointly estimate the probit models and to derive WTP from the CV responses. The model is used to test and impose restrictions derived from economic theory on the utility difference model. Mean WTP estimates for three different types of changes in the quality of California deer hunting were uniformly lower for the joint response probit model compared to a set of independent probit models.     

Respondent direct experience and contingent willingness to pay for new commodities: a switching endogenous interval regression analysis

Most environmental economists argue that direct experience with the good being valuated, or with similar goods, is a precondition for providing valid willingness to pay (WTP) responses to contingent valuation questions. Two questions are posed in this article. The first is whether previous use experience of a resource (Séné nature reserve) similar to that being valuated (future nature reserves) and located in the same geographical area (Gulf of Morbihan) impacts on WTP. The second is whether accounting for the endogeneity of direct experience matters in the estimation of WTP. We find that respondents who have not experienced the Séné nature reserve provide value estimates that are statistically comparable to that of respondents who have experienced it. Our assumption is that respondents have acquired sufficient and adequate experience of future nature reserves from the questionnaire that experience obtained by experiencing the Séné nature reserve was not necessary for making a valid value formulation. Hence, aggregation of WTP estimates to obtain a total valuation of the future nature reserves is reasonable over the full target population. In addition, our results show that direct experience is endogenously determined; but controlling for the endogeneity has a marginal effect on WTP estimates.     

Addressing Negative Willingness to Pay in Dichotomous Choice Contingent Valuation

This paper has four purposes. First, we outline the controversy surroundingthe issue of negative willingness to pay (WTP)in contingent valuation (CV) studies. Second,we use Monte Carlo simulation to examine theperformance of alternative distributionalassumptions in estimating WTP in the presenceof varying proportions of the populationholding negative WTP values. We focus ondichotomous choice CV (DC-CV), where negativeWTP values may be especially difficult todetect. Third, we extend the simulation toinvestigate the performance of the mixturemodels that have recently been proposed forhandling/identifying non-positive WTP values. Fourth, we extend the simulation to investigatethe performance of the nonparametric lowerbound Turnbull approach. Results indicate thatthe relative performance of the DC-CV modelingalternatives evaluated here, which assumepositive WTP, varies across the simulationsetting (e.g., proportion of negative WTP); butnone can be said to reasonably ``solve' theproblem ex post. This underscores theimportance of ex ante efforts to identify ifnegative WTP is likely to be prominent in agiven valuation setting. In such cases,appropriately handling negative WTP must beaddressed through ex ante survey design andmodeling choices that allow negative WTP.     

Binary Choice Valuation Studies with Heteregeneous Preferences Regarding the Program Being Valued

We investigate the effect of respondents' heterogeneous preferences regarding the good to be valued in binary-choice contingent valuationstudies. This is especially important when the valuation options give rise to both highly negative and highly positive attitudes.The survey design employs questionnaires which include separate items for willingness to favorandwillingness to contribute in monetary terms to the provision of the good. In light of our analysis, eliciting respondents' differentpreferences for the project first, without monetary considerations, wouldimprove the WTP estimates as welfare measures. Our results alsosuggest that nonparametric estimation could offer another solution foraccounting for preference heterogeneity. Nonparametric estimation is less sensitive to those `no' responses which are in fact not intended toreflect the respondents' WTP as such but merely to express their dislikefor the good at issue.     

Referenda Under Oath

Herein we explore whether a solemn oath can eliminate hypothetical bias in a voting referenda, a popular elicitation mechanism promoted in non-market valuation exercises for its incentive compatibility properties. First, we reject the null hypothesis that a hypothetical bias does not exist. Second, we observe that people who sign an oath are significantly less likely to vote for the public good in a hypothetical referenda. We complement this evidence with a self-reported measure of honesty which confirms that the oath increases truthfulness in answers. This result opens interesting avenues for improving the elicitation of preferences in the lab and beyond.     

Eliciting Willingness to Pay without Bias using Follow-up Certainty Statements: Comparisons between Probably/Definitely and a 10-point Certainty Scale

Correction for hypothetical bias using follow up certainty questions often takes one of two forms: (1) two options, “definitely sure” and “probably sure”, or (2) a 10-point scale with 10 very certain. While both have been successful in eliminating hypothetical bias from estimates of WTP by calibrating based on the certainty of yes responses, little is known about the relationship between the two. The purpose of this paper is to compare the two using data from three field experiments in a private good, dichotomous choice format. We compare four types of yes responses that differ in the criterion used to determine if there is sufficient certainty for a hypothetical yes response to be considered a true yes response. We make several comparisons, but focus on determining which values on the 10-point scale give the same estimates of WTP as “definitely sure” hypothetical yeses and real yeses (actual purchases). Values that produce equivalence are near 10 on the certainty scale.     

Asking for Individual or Household Willingness to Pay for Environmental Goods?

The aggregate welfare measure for a change in the provision of a public good derived from a contingent valuation (CV) survey will be higher if the same elicited mean willingness to pay (WTP) is added up over individuals rather than households. A trivial fact, however, once respondents are part of multi-person households, it becomes almost impossible to elicit an “uncontaminated” WTP measure that with some degree of confidence can be aggregated over one or the other response unit. The literature is mostly silent about which response unit to use in WTP questions, and in some CV studies it is even unclear which type has actually been applied. We test for differences between individual and household WTP in a novel, web-administered, split-sample CV survey asking WTP for preserving biodiversity in old-growth forests in Norway. Two samples are asked both types of questions, but in reverse order, followed by a question with an item battery trying to reveal why WTP may differ. We find in a test between samples that the WTP respondents state on behalf of their households is not significantly different from their individual WTP. However, within the same sample, household WTP is significantly higher than individual WTP; in particular if respondents are asked to state individual before household WTP. Our results suggest that using individual WTP as the response unit may overestimate aggregate WTP. Thus, the choice of response format needs to be explicitly and carefully addressed in CV questionnaire design and further research in order to avoid the risk of unprofitable projects passing the benefit-cost test.

---

     

A Learning Design for Reducing Hypothetical Bias in the Contingent Valuation Method

Over the last few years a great deal of research has focussed on hypothetical bias in value estimates obtained with the contingent valuation (CV) method and on means for ameliorating if not eliminating such bias. To date, efforts to eliminate hypothetical bias have relied on calibration techniques or on word-smithing of one kind or another to induce subjects to provide responses to hypothetical questions that mimic responses made by subjects facing actual payments in the valuation experiment. This paper introduces a different approach for eliminating hypothetical bias. A design for a CV survey format is presented which provides subjects with the opportunity to learn how the CV institution works. Sequential referenda are conducted where respondents gain experience in CV settings by participating in both hypothetical and real referenda. The logic of this Learning Design is a straightforward application of the trials process used in experimental economics. We demonstrate that the Learning Design is effective in eliminating hypothetical bias in surveys concerning donations to two different public goods.