Interview Effects in an Environmental Valuation Telephone Survey

Because of the lack of markets for many environmental services, economists have turned to valuation surveys to estimate the value of these services. However, lack of market experience may cause respondents in valuation surveys to be more prone to interview effects than they would be with other opinion surveys. Without reference to market price or experience, respondents are less likely to have well-defined preferences, which may cause respondents to be more easily influenced by the interview process and characteristics of the interviewer. In this paper, we investigate interview effects in a random digit dial telephone survey of recycling valuation and behavior. Following previous research in both psychology and survey methodology, we test the direct effects of interviewer gender and race, as well as the interaction effects between interviewer and respondent characteristics. Using data from 130 interviewers and 1,786 interviewees, we apply a hierarchical regression model that accounts for the clustering of interviews and controls for a variety of other confounding variables. We confirm the existence of both direct and conditional interviewer effects. Respondents state higher willingness to pay when interviewed by white or female interviewers than by non-white or male interviewers. There were also significant interaction effects between interviewer and respondent characteristics. The directions of the interviewer effects are consistent with previous survey research and social psychology theories. We also identify some non-traditional interview process factors that have an influence on survey responses.     

Attrition and Follow‐Up Rules in Panel Surveys: Insights from a Tracking Experience in Madagascar

Most longitudinal surveys recontact households only if they are still living in the same dwelling, producing very high attrition rates, especially in developing countries where rural–urban migration is prevalent. In this paper, we discuss the implications of the various follow‐up rules used in longitudinal surveys in the light of an original tracking survey from Madagascar. This survey attempted in 2005 to search and interview all individuals who were living in the village of Bepako in 1995, the baseline year of a yearly survey, the Rural Observatories. The tracking survey yielded an individual recontact rate of 78.8 percent, more than halving attrition compared to a standard dwelling‐based follow‐up rule. The tracking reveals a very high rate of out‐migration (38.8 percent) and household break‐ups, as three‐quarters of recontacted households had divided between 1995 and 2005. The average income growth of the sample over the period increases by 28 percentage points when follow‐up is extended to those who moved out of their household or village, suggesting that dwelling‐based panels give a partial view of the welfare dynamics of the baseline sample. A higher baseline income per capita is associated with a higher probability of staying in Bepako and of being found in the tracking if one moved out. The hardest people to find are the poorest and most isolated. Special attention should be paid to collecting data that enable the identification and follow‐up of individuals, without which attrition is likely to remain a source of bias even after a tracking procedure is carried out.     

A model of attrition and income for dynamic longitudinal surveys

This paper develops a random effects model of attrition and income applicable to a dynamic longitudinal survey such as the Survey of Income and Program Participation. Based on the partial dynamic adjustment hypothsis, this study finds that the speed of adjustment of income is not instantaneous as suggeted in many past studies using annual panel data. Also, the short-run coefficients are much smaller than their long-run counterparts, and the coefficient estimates differ substantially among individuals with divergent socioeconomic characteristics. Caution should therefore be exercised when applying dynamic panel data to models with the assumption of an instantaneous speed of adjustment.     

中国城乡老年人口状况追踪调查抽样与加权方法研究

对2000年12月、2006年6月和2010年12月开展的三次中国城乡老年人口状况追踪调查的抽样方法、数据评估和加权模型做了详尽介绍,以便为各界学者、研究人员和在读研究生使用这套数据时,对数据来源有充分了解。按与人口规模成正比的概率抽样(PPS)方法进行分级多阶段抽样框,对涉及的2万名老年人入户调查所获得的原始数据,利用调查时点左右的人口普查或1%人口抽样调查60周岁及以上人口相关结果,通过相应的加权评估,足以推论调查时点我国大陆地区老年人口的总体状况,亦可对五年内的变化状况做短期估值预测。     

EFFECT OF SURVEY CONDITIONS ON SELF-REPORTED SUBSTANCE USE

This paper examines the impact of survey conditions on the self-reported use of marijuana, cocaine, and alcohol in the 1984 and 1988 waves of the National Longitudinal Survey of Youth (NLSY). The analysis obtains probit estimates of lifetime and current participation rates and ordered probit estimates for the current frequency of use. The results clearly indicate that the manner in which the NLSY survey is administered significantly affects the self-reported substance use data. The presence of others at administration, self-administration, and data collection by telephone interview are particularly important influences .     

Workplace problems,mental health and substance use

Little is known about how workplace problems may influence diagnosable mental health and substance use (MHSU) disorders. We examine the associations between three common workplace problems (experiencing problems with co-workers, job changes and perceived financial strain) and three MHSU disorders (mood, anxiety and substance abuse/dependence). The analysis utilizes longitudinal data on a sample of working-age adults from the National Epidemiological Survey on Alcohol and Related Conditions. These data are well suited for our research objective as the survey was specifically designed to study MHSU disorders. Results show that experiencing these workplace problems is associated with an increased risk for mental health disorders, but not substance use disorders. Importantly, various robustness checks and sensitivity analyses demonstrate that our findings cannot be not fully explained by omitted variables, reverse causality or sample attrition.     

Cross-country income mobility comparisons under panel attrition: the relevance of weighting schemes

This article aims to present an assessment of the effects of panel attrition on income mobility comparisons for some EU countries by using the European Community Household Panel (ECHP). There are different possibilities of correcting the attrition problem by means of alternative longitudinal weighting schemes. The sensitivity of mobility estimates to these attrition correction procedures is tested in this article. Our results show that ECHP attrition is characterized by a certain degree of selectivity but only affecting some variables and countries. Different probability models corroborate the existence of a certain nonrandom attrition. The model chosen to construct the longitudinal weights to correct attrition offers up rather different results than those obtained when Eurostat's longitudinal weights are used. Although attrition does not seem to have a great effect on aggregated mobility indicators, it does have a decisive effect on decomposition exercises. Our tests reveal certain sensitivity of income mobility measures to the weighting system used.     

Contributions of Longitudinal Data to Poverty Measurement in Australia*

Chronic poverty is of greater social consequence than transitory poverty but its measurement requires longitudinal data. This article uses six waves of data from the Household, Income and Labour Dynamics in Australia Survey to explore the extent to which longitudinal data contribute to what is known about poverty from cross‐section data. We find an imperfect correspondence between people’s annual poverty status and chronic poverty status. Consequently, policies that aim to reduce chronic poverty using means‐tested benefits may be partially misdirected if beneficiaries are identified using annual income. Furthermore, some households experiencing chronic poverty may fall through the safety net.     

Comparison of Internet and interview survey modes when estimating willingness to pay using choice experiments

With the increasing use of the Internet as a survey mode, questions of mode effects and how potential effects influence inferences arise. Using a choice experiment combined with mixed logit estimation, willingness-to-pays (WTPs) for attributes are compared between the Internet mode and the more traditional interview survey mode. The results suggest that there are differences in WTP between the two survey models for three of four attributes. Furthermore, WTPs obtained from the interview survey are larger than the WTPs obtained from the Internet survey, suggesting potential social desirability behaviour by the interview respondents. Internet surveys involving sensitive issues may be desirable because of potential social desirability behaviour.     

The European Community Household Panel: A review

The European Community Household Panel (ECHP) is a standardized multi-purpose annual longitudinal survey carried out at the level of the European Union. It is centrally designed and coordinated by the Statistical Office of the European Communities (Eurostat), and covers demographics, labor force behavior, income, health, education and training, housing, migration, etc. After reviewing the organization of the survey, this paper discusses some of the issues that an applied economist potentially interested in the ECHP may face when trying to deal with these data. In particular, the paper focuses on survey attrition and nonresponse, the weighting procedures with which Eurostat tries to compensate for differential nonresponse and attrition rates, and the imputation methods adopted by Eurostat in order to deal with item nonresponse. First version received: July 2000/Final version received: October 2000     

MEASUREMENT ERROR IN THE BANK OF ITALY'S SURVEY OF HOUSEHOLD INCOME AND WEALTH

This paper is aimed at evaluating the incidence of measurement error in the Bank of Italy's Survey of Household Income and Wealth (SHIW). In the case of time-invariant variables, we assess the degree of inconsistency of answers given by panel households in subsequent survey waves. For quantities that vary with time, we estimate the incidence of measurement error by decomposing observed variability into true dynamics and error-induced noise. We apply the Heise model or the latent Markov model, depending on whether the data are continuous or categorical. We also present regression models that explain the error-generating process. Our results are relevant to researchers who use SHIW data for economic analysis, but also to data producers involved in similar income and wealth surveys. The methods we describe and test can be employed in a number of contexts to gain better understanding of data-related problems and plans for survey improvement.     

Sample attrition and labor force dynamics: Evidence from the Spanish labor force survey

In this paper we examine a number of issues that arise in investigating labor force dynamics using the Spanish Labor Force Survey (EPA). These issues are by no means specific to the Spanish case and apply to most European-style labor force surveys. Our main conclusions may be summarized as follows. First, survey nonresponse cannot be neglected. Second, the EPA tends to underestimate employment and participation of high-educated young people, and to overestimate those of the low-educated elderly. Finally, we find little evidence that attrition causes important selection biases in estimating quarterly transition probabilities.     

Attrition bias in the Capitalia panel

The Capitalia survey of manufacturing firms in Italy represents an important source of panel data on Italian firms. Panel attrition, however, represents a potential obstacle to such use of the sample. In this paper, sample entry and exit behaviour are studied, and a test for attrition bias is carried out in order to evaluate the potential for using panels constructed from the Capitalia survey. The analysis reveals the presence of distorting panel attrition effects in simple models of firm performance. In addition, the paper discusses both the implications of attrition bias for estimates and also briefly considers possible solutions. Finally, some suggestions are made as to how to reduce the impact of attrition bias through the provision of additional information on the nature of the attrition process available to the surveying institution at the moment of data collection.     

Are Internet surveys an alternative to face-to-face interviews in contingent valuation?

Internet is an increasingly popular data collection mode for stated preference research in environmental economics. However, little is known about how this survey mode may influence data quality and welfare estimates. As part of a national contingent valuation (CV) survey estimating willingness to pay (WTP) for biodiversity protection plans, we assign two groups of respondents either to an Internet or face-to-face (in-home) interview mode. Our design aims to better isolate measurement effects from sample composition effects by drawing both samples from the same sample frame. We find little evidence of social desirability bias in the interview setting or satisficing (shortcutting the response process) in the Internet survey. The share of “don't knows”, zeros and protest responses to the WTP question with a payment card is very similar between modes and equality of mean WTP cannot be rejected. Results are fairly encouraging for the use of Internet in CV as stated preferences do not seem to be significantly different or biased compared to face-to-face interviews.     

Revisiting the inflation perception conundrum

Households' inflation perceptions and expectations play a key role in many dynamic macroeconomic and monetary models and are important for the ability of central banks to reach their objective of price stability. This paper revisits the issue of overestimation bias in inflation perceptions and expectations based on new and unique microdata from the Danish part of the EU-Harmonised Consumer Expectations Survey linked to rich household-level data from administrative registers. The analysis shows that accounting for even several of the household characteristics and social gradients usually addressed in the literature is far from sufficient to explain the inflation perception bias. Furthermore, we find that respondents participating in the survey more than once tend to be persistent in their degree of perception bias and that overpessimistic households have larger perception bias than other households. This indicates that inflation perception bias is related to fundamental personality traits. Finally, households' expectations of the future inflation level tend to be mean reverting and associated with the same types of bias as inflation perceptions.     

Do retirement planning strategies alter the effect of time preference on retirement wealth?

An individual’s willingness to accumulate retirement wealth is influenced by their preference for intertemporal consumption. People with a strong preference for current consumption (high personal discount rate) may choose to save less and face the risk of decreased retirement preparedness. A negative relation between a high personal discount rate and retirement wealth may be reduced when individuals engage in some form of retirement planning. Using the National Longitudinal Survey of Youth, we provide evidence that respondents with a high personal discount rate accumulated 37% less retirement wealth, on average, between 2004 and 2008, when compared with respondents with a low personal discount rate. However, when retirement planning strategies were included in the model, there was no statistical difference in retirement wealth between people with high and low personal discount rates. The retirement planning strategies included calculating a retirement income need, hiring a financial planner for retirement or engaging in both of these activities.     

Estimating the public's social preference function between inflation and unemployment using survey data: The survey research center versus Gallup

Economists often use Gallup Poll data on presidential performance to analyze the interaction between politics and the state of the macroeconomy. The household survey undertaken by the Survey Research Center (SRC) of the University of Michigan provides an alternative data base. The SRC asks respondents about the government's performance specifically with respect to inflation and unemployment. We compare whether the Gallup or SRC data are the more useful for estimating the public's social preference function between inflation and unemployment for the Carter, Reagan, Bush and Clinton presidencies. The estimates that use Gallup Poll data are unsatisfactory because for two of the periods the coefficients of inflation and unemployment are not well estimated and for one period there is serial correlation of the residuals. The estimates using the SRC data set are satisfactory and the results are consistent with economic theory. We conclude that a researcher using survey data to estimate the public's reaction to varying rates of inflation and unemployment should prefer the SRC series when it is available. First version received: October 1995/final version received: July 1998     

The prevalence of hyperbolic discounting: some European evidence

Experimental matching data are used from the 2000 Bank of Italy Survey of Household Income and Wealth (SHIW) and the 2000 wave of the Center for Economic Research (CentER) Savings Survey at Tilburg University to compare the relative frequencies of hyperbolic and exponential discounters. Among 3200 Italian respondents and 1400 Dutch respondents, less than a quarter exhibited hyperbolic discounting. This finding is both statistically significant and robust with respect to various assumptions regarding utility; moreover, it holds across a wide variety of economic, social and demographic characteristics. The youngest, poorest, most urban and least educated individuals are the most likely to be hyperbolic discounters. In addition, it is found that hyperbolic discounters accumulate less wealth and are somewhat less likely than exponential discounters to utilize commitment devices to constrain their future choices.     

Using Quality of Interview Information to Assess Nonrandom Attrition Bias in Developing-Country Panel Data

Panel data often provide an understanding of household behavior not possible with cross‐sectional information alone. However, a disturbing feature of such data is that there can be substantial, nonrandom attrition and many analysts share the concern that this inhibits the ability to make accurate inferences. The author examines attrition in the KwaZulu–Natal Income Dynamics Study 1993–1998, assesses the extent of attrition bias for a specific empirical example, and proposes and implements a selection correction methodology using quality of first round interview variables as identifying instruments. The results show that attrition does lead to statistical bias in the “behavioral” coefficients in estimation of household‐level expenditure functions. Since it is typically difficult to determine the bias for a particular analysis a priori, and such bias is by its nature model‐specific, it behooves researchers using panel data to evaluate the effects of attrition in their analyses.     

Conceptualization and measurement of disability in studies on subjective well-being: a critical review and evidence from the Italian Health Surveys

The main aim of this study is to assess, through a wide literature review, whether the concept of “disability,” as variously formulated, can be considered a good foundation for scientific research on happiness and subjective well-being, as well as the effect of some conceptualizations on the understanding of the relationship between happiness and disability. The literature review includes longitudinal population studies, cross-sectional surveys and longitudinal clinical researches. The empirical part of the study, based on the 2013 Italian Health Interview Survey, shows some examples of the impact of different definitions of disability on the subjective well-being variability. The Italian Health Interview Survey is conducted every 5 years and carried out on a sample of about 60,000 households and 162,000 respondents distributed in 1456 municipalities. Some suggestions for future research, based on a vision of the multifaceted nature of disability, are proposed.