Quantile-based nonparametric inference for first-price auctions

We propose a quantile-based nonparametric approach to inference on the probability density function (PDF) of the private values in first-price sealed-bid auctions with independent private values. Our method of inference is based on a fully nonparametric kernel-based estimator of the quantiles and PDF of observable bids. Our estimator attains the optimal rate of Guerre et al. (2000), and is also asymptotically normal with an appropriate choice of the bandwidth.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

Structural measurement errors in nonseparable models

This paper considers measurement error from a new perspective. In surveys, response errors are often caused by the fact that respondents recall past events and quantities imperfectly. We explore the consequences of limited recall for the identification of marginal effects. Our identification approach is entirely nonparametric, using Matzkin-type nonseparable models that nest a large class of potential structural models. We show that measurement error due to limited recall will generally exhibit nonstandard behavior, in particular be nonclassical and differential, even for left-hand side variables in linear models. We establish that information reduction by individuals is the critical issue for the severity of recall measurement error. In order to detect information reduction, we propose a nonparametric test statistic. Finally, we propose bounds to address identification problems resulting from recall errors. We illustrate our theoretical findings using real-world data on food consumption.     

Density estimation in the uniform deconvolution model

We consider the problem of estimating a probability density function based on data that are corrupted by noise from a uniform distribution. The (nonparametric) maximum likelihood estimator for the corresponding distribution function is well defined. For the density function this is not the case. We study two nonparametric estimators for this density. The first is a type of kernel density estimate based on the empirical distribution function of the observable data. The second is a kernel density estimate based on the MLE of the distribution function of the unobservable (uncorrupted) data.     

Relevance weighted likelihood for dependent data

The relevance-weighted likelihood function weights individual contributions to the likelihood according to their relevance for the inferential problem of interest. Consistency and asymptotic normality of the weighted maximum likelihood estimator were previously proved for independent sequences of random variables. We extend these results to apply to dependent sequences, and, in so doing, provide a unified approach to a number of diverse problems in dependent data. In particular, we provide a heretofore unknown approach for dealing with heterogeneity in adaptive designs, and unify the smoothing approach that appears in many foundational papers for independent data. Applications are given in clinical trials, psychophysics experiments, time series models, transition models, and nonparametric regression. Received: April 2000     

An efficient nonparametric estimator for models with nonlinear dependence

We provide a convenient econometric framework for the analysis of nonlinear dependence in financial applications. We introduce models with constrained nonparametric dependence, which specify the conditional distribution or the copula in terms of a one-dimensional functional parameter. Our approach is intermediate between standard parametric specifications (which are in general too restrictive) and the fully unrestricted approach (which suffers from the curse of dimensionality). We introduce a nonparametric estimator defined by minimizing a chi-square distance between the constrained densities in the family and an unconstrained kernel estimator of the density. We derive the nonparametric efficiency bound for linear forms and show that the minimum chi-square estimator is nonparametrically efficient for linear forms.     

Semi-parametric estimation of American option prices

We introduce a novel semi-parametric estimator of American option prices in discrete time. The specification is based on a parameterized stochastic discount factor and is nonparametric w.r.t. the historical dynamics of the Markovian state variables. The historical transition density estimator minimizes a distance built on the Kullback–Leibler divergence from a kernel transition density, subject to the no-arbitrage restrictions for a non-defaultable bond, the underlying asset and some American option prices. We use dynamic programming to make explicit the nonlinear restrictions on the Euclidean and functional parameters coming from option data. We study asymptotic and finite sample properties of the estimators.     

FRED-SD: A real-time database for state-level data with forecasting applications

We construct a real-time dataset (FRED-SD) with vintage data for the U.S. states that can be used to forecast both state-level and national-level variables. Our dataset includes approximately 28 variables per state, including labor-market, production, and housing variables. We conduct two sets of real-time forecasting exercises. The first forecasts state-level labor-market variables using five different models and different levels of industrially disaggregated data. The second forecasts a national-level variable exploiting the cross-section of state data. The state-forecasting experiments suggest that large models with industrially disaggregated data tend to have higher predictive ability for industrially diversified states. For national-level data, we find that forecasting and aggregating state-level data can outperform a random walk but not an autoregression. We compare these real-time data experiments with forecasting experiments using final-vintage data and find very different results. Because these final-vintage results are obtained with revised data that would not have been available at the time the forecasts would have been made, we conclude that the use of real-time data is essential for drawing proper conclusions about state-level forecasting models.     

Instrumental variables estimators of nonparametric models with discrete endogenous regressors

This paper discusses estimation of nonparametric models whose regressor vectors consist of a vector of exogenous variables and a univariate discrete endogenous regressor with finite support. Both identification and estimators are derived from a transform of the model that evaluates the nonparametric structural function via indicator functions in the support of the discrete regressor. A two-step estimator is proposed where the first step constitutes nonparametric estimation of the instrument and the second step is a nonparametric version of two-stage least squares. Linear functionals of the model are shown to be asymptotically normal, and a consistent estimator of the asymptotic covariance matrix is described. For the binary endogenous regressor case, it is shown that one functional of the model is a conditional (on covariates) local average treatment effect, that permits both unobservable and observable heterogeneity in treatments. Finite sample properties of the estimators from a Monte Carlo simulation study illustrate the practicability of the proposed estimators.     

Direct and indirect effects of continuous treatments based on generalized propensity score weighting

This paper proposes semi- and nonparametric methods for disentangling the total causal effect of a continuous treatment on an outcome variable into its natural direct effect and the indirect effect that operates through one or several intermediate variables called mediators jointly. Our approach is based on weighting observations by the inverse of two versions of the generalized propensity score (GPS), namely the conditional density of treatment either given observed covariates or given covariates and the mediator. Our effect estimators are shown to be asymptotically normal when the GPS is estimated by either a parametric or a nonparametric kernel-based method. We also provide a simulation study and an empirical illustration based on the Job Corps experimental study.     

A Bayesian mixed logit–probit model for multinomial choice

In this paper, we introduce a new flexible mixed model for multinomial discrete choice where the key individual- and alternative-specific parameters of interest are allowed to follow an assumption-free nonparametric density specification, while other alternative-specific coefficients are assumed to be drawn from a multivariate Normal distribution, which eliminates the independence of irrelevant alternatives assumption at the individual level. A hierarchical specification of our model allows us to break down a complex data structure into a set of submodels with the desired features that are naturally assembled in the original system. We estimate the model, using a Bayesian Markov Chain Monte Carlo technique with a multivariate Dirichlet Process (DP) prior on the coefficients with nonparametrically estimated density. We employ a “latent class” sampling algorithm, which is applicable to a general class of models, including non-conjugate DP base priors. The model is applied to supermarket choices of a panel of Houston households whose shopping behavior was observed over a 24-month period in years 2004–2005. We estimate the nonparametric density of two key variables of interest: the price of a basket of goods based on scanner data, and driving distance to the supermarket based on their respective locations. Our semi-parametric approach allows us to identify a complex multi-modal preference distribution, which distinguishes between inframarginal consumers and consumers who strongly value either lower prices or shopping convenience.     

Selection correction and sensitivity analysis for ordered treatment effect on count response

In estimating the effect of an ordered treatment τ on a count response y with an observational data where τ is self‐selected (not randomized), observed variables x and unobserved variables ε can be unbalanced across the control group (τ = 0) and the treatment groups (τ = 1, …, J). While the imbalance in x causes ‘overt bias’ which can be removed by controlling for x, the imbalance in ε causes ‘covert (hidden or selection) bias’ which cannot be easily removed. This paper makes three contributions. First, a proper counter‐factual causal framework for ordered treatment effect on count response is set up. Second, with no plausible instrument available for τ, a selection correction approach is proposed for the hidden bias. Third, a nonparametric sensitivity analysis is proposed where the treatment effect is nonparametrically estimated under no hidden bias first, and then a sensitivity analysis is conducted to see how sensitive the nonparametric estimate is to the assumption of no hidden bias. The analytic framework is applied to data from the Health and Retirement Study: the treatment is ordered exercise levels in five categories and the response is doctor office visits per year. The selection correction approach yields very large effects, which are however ruled out by the nonparametric sensitivity analysis. This finding suggests a good deal of caution in using selection correction approaches. Copyright © 2004 John Wiley & Sons, Ltd.     

Probabilistic forecasting of industrial electricity load with regime switching behavior

This paper suggests a novel inhomogeneous Markov switching approach for the probabilistic forecasting of industrial companies’ electricity loads, for which the load switches at random times between production and standby regimes. The model that we propose describes the transitions between the regimes using a hidden Markov chain with time-varying transition probabilities that depend on calendar variables. We model the demand during the production regime using an autoregressive moving-average (ARMA) process with seasonal patterns, whereas we use a much simpler model for the standby regime in order to reduce the complexity. The maximum likelihood estimation of the parameters is implemented using a differential evolution algorithm. Using the continuous ranked probability score (CRPS) to evaluate the goodness-of-fit of our model for probabilistic forecasting, it is shown that this model often outperforms classical additive time series models, as well as homogeneous Markov switching models. We also propose a simple procedure for classifying load profiles into those with and without regime-switching behaviors.     

Efficient estimation in dynamic conditional quantile models

In this paper we consider the problem of semiparametric efficient estimation in conditional quantile models with time series data. We construct an M-estimator which achieves the semiparametric efficiency bound recently derived by Komunjer and Vuong (forthcoming). Our efficient M-estimator is obtained by minimizing an objective function which depends on a nonparametric estimator of the conditional distribution of the variable of interest rather than its density. The estimator is new and not yet seen in the literature. We illustrate its performance through a Monte Carlo experiment.     

The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions

This paper computes the semiparametric efficiency bound for finite dimensional parameters identified by models of sequential moment restrictions containing unknown functions. Our results extend those of Chamberlain (1992b) and Ai and Chen (2003) for semiparametric conditional moment restrictions with identical information sets to the case of nested information sets, and those of Chamberlain (1992a) and Brown and Newey (1998) for models of sequential moment restrictions without unknown functions to cases with unknown functions of possibly endogenous variables. Our results are applicable to semiparametric panel data models and two stage plug-in problems. As an important example, we compute the efficiency bound for a weighted average derivative of a nonparametric instrumental variables regression (NPIV), and find that simple plug-in NPIV estimators are not efficient. We present an optimally weighted, orthogonalized, sieve minimum distance estimator that achieves the semiparametric efficiency bound.     

Estimating Long-term Trends in Tropospheric Ozone Levels

This paper develops Bayesian methodology for estimating long-term trends in the daily maxima of tropospheric ozone. The methods are then applied to study long-term trends in ozone at six monitoring sites in the state of Texas. The methodology controls for the effects of meteorological variables because it is known that variables such as temperature, wind speed and humidity substantially affect the formation of tropospheric ozone. A semiparametric regression model is estimated in which a nonparametric trivariate surface is used to model the relationship between ozone and these meteorological variables because, while it is known that the relatinship is a complex nonlinear one, its functional form is unknown. The model also allows for the effects of wind direction and seasonality. The errors are modeled as an autoregression, which is methodologically challenging because the observations are unequally spaced over time. Each function in the model is represented as a linear combination of basis functions located at all of the design points. We also estimate an appropriate data transformation simulataneously with the functions. The functions are estimated nonparametrically by a Bayesian hierarchical model that uses indicator variables to allow a non-zero probability that the coefficient of each basis term is zero. The entire model, including the nonparametric surfaces, data transformation and autoregression for the unequally spaced errors, is estimated using a Markov chain Monte Carlo sampling scheme with a computationally efficient transition kernel for generating the indicator variables. The empirical results indicate that key meteorological variables explain most of the variation in daily ozone maxima through a nonlinear interaction and that their effects are consistent across the six sites. However, the estimated trends vary considerably from site to site, even within the same city.     

Estimation of dynamic models with nonparametric simulated maximum likelihood

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump-diffusion models.     

Identification in nonparametric limited dependent variable models with simultaneity and unobserved heterogeneity

We extend the identification results for nonparametric simultaneous equations models in Matzkin (2008) to situations where the observations on the vector of dependent variables might be limited, and where the number of exogenous unobservable variables is larger than the number of dependent variables.     

On the efficiency of least squares estimators in non-linear models

Summary  The identity of least squares estimators å and maximum likelihood estimators â is studied in non-linear models of the type z = g ( a ), where z are observable quantities with a probability density function pr ( z ). This identity was proved for independent random variables z and for distributions pr ( z ), of which the arithmetic sample mean is an optimal estimate.