Nonparametric estimation in case of endogenous selection

This paper addresses the problem of estimation of a nonparametric regression function from selectively observed data when selection is endogenous. Our approach relies on independence between covariates and selection conditionally on potential outcomes. Endogeneity of regressors is also allowed for. In the exogenous and endogenous case, consistent two-step estimation procedures are proposed and their rates of convergence are derived. Pointwise asymptotic distribution of the estimators is established. In addition, bootstrap uniform confidence bands are obtained. Finite sample properties are illustrated in a Monte Carlo simulation study and an empirical illustration.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

Statistical inference and nonparametric efficiency: A selective survey

The purpose of this paper is to provide a brief and selective survey of statistical inference in nonparametric, deterministic, linear programming-based frontier models. The survey starts with nonparametric regularity tests, sensitivity analysis, two-stage analysis with regression, and nonparametric statistical tests. It then turns to the more recent literature which shows that DEA-type estimators are maximum likelihood, and, more importantly the results concerning the asymptotic properties of these estimators. Also included is a discussion of recent attempts to employ resampling methods to derive empirical distributions for hypothesis testing.     

Instrumental variables estimators of nonparametric models with discrete endogenous regressors

This paper discusses estimation of nonparametric models whose regressor vectors consist of a vector of exogenous variables and a univariate discrete endogenous regressor with finite support. Both identification and estimators are derived from a transform of the model that evaluates the nonparametric structural function via indicator functions in the support of the discrete regressor. A two-step estimator is proposed where the first step constitutes nonparametric estimation of the instrument and the second step is a nonparametric version of two-stage least squares. Linear functionals of the model are shown to be asymptotically normal, and a consistent estimator of the asymptotic covariance matrix is described. For the binary endogenous regressor case, it is shown that one functional of the model is a conditional (on covariates) local average treatment effect, that permits both unobservable and observable heterogeneity in treatments. Finite sample properties of the estimators from a Monte Carlo simulation study illustrate the practicability of the proposed estimators.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

Calibration Estimation in Survey Sampling

Calibration estimation, where the sampling weights are adjusted to make certain estimators match known population totals, is commonly used in survey sampling. The generalized regression estimator is an example of a calibration estimator. Given the functional form of the calibration adjustment term, we establish the asymptotic equivalence between the functional-form calibration estimator and an instrumental variable calibration estimator where the instrumental variable is directly determined from the functional form in the calibration equation. Variance estimation based on linearization is discussed and applied to some recently proposed calibration estimators. The results are extended to the estimator that is a solution to the calibrated estimating equation. Results from a limited simulation study are presented.     

Nonparametric estimation of structural change points in volatility models for time series

We propose a hybrid estimation procedure that combines the least squares and nonparametric methods to estimate change points of volatility in time series models. Its main advantage is that it does not require any specific form of marginal or transitional densities of the process. We also establish the asymptotic properties of the estimators when the regression and conditional volatility functions are not known. The proposed tests for change points of volatility are shown to be consistent and more powerful than the nonparametric ones in the literature. Finally, we provide simulations and empirical results using the Hong Kong stock market index (HSI) series.     

Nonparametric identification and estimation of sample selection models under symmetry

Under a conditional mean restriction Das et al. (2003) considered nonparametric estimation of sample selection models. However, their method can only identify the outcome regression function up to a constant. In this paper we strengthen the conditional mean restriction to a symmetry restriction under which selection biases due to selection on unobservables can be eliminated through proper matching of propensity scores; consequently we are able to identify and obtain consistent estimators for the average treatment effects and the structural regression functions. The results from a simulation study suggest that our estimators perform satisfactorily.     

Model-calibration estimation of the distribution function using nonparametric regression

Nonparametric regression has only recently been employed in the estimation of finite population parameters in a model-assisted framework. This paper proposes a new calibration estimator for the distribution function using nonparametric methods to obtain the fitted values on which to calibrate. The proposed estimator is a genuine distribution function that presents several attractive features. In terms of relative efficiency and relative bias, the behaviour of the proposed estimator is compared to other known estimators in a limited simulation study on real populations.     

On the Generalized Bootstrap for Sample Surveys with Special Attention to Poisson Sampling

We study the generalized bootstrap technique under general sampling designs. We focus mainly on bootstrap variance estimation but we also investigate the empirical properties of bootstrap confidence intervals obtained using the percentile method. Generalized bootstrap consists of randomly generating bootstrap weights so that the first two (or more) design moments of the sampling error are tracked by the corresponding bootstrap moments. Most bootstrap methods in the literature can be viewed as special cases. We discuss issues such as the choice of the distribution used to generate bootstrap weights, the choice of the number of bootstrap replicates, and the potential occurrence of negative bootstrap weights. We first describe the generalized bootstrap for the linear Horvitz‐Thompson estimator and then consider non‐linear estimators such as those defined through estimating equations. We also develop two ways of bootstrapping the generalized regression estimator of a population total. We study in greater depth the case of Poisson sampling, which is often used to select samples in Price Index surveys conducted by national statistical agencies around the world. For Poisson sampling, we consider a pseudo‐population approach and show that the resulting bootstrap weights capture the first three design moments of the sampling error. A simulation study and an example with real survey data are used to illustrate the theory.     

New Model-assisted Estimators for the Distribution Function Using the Pseudo Empirical Likelihood Method

This paper proposes using a model-assisted approach based on the pseudo empirical likelihood method to construct estimators for the finite population distribution function. It shows that the proposed sample-based estimators are genuine distribution functions that exhibit several attractive features, such as the fact that they do not depend on unknown parameters, and good performance at any argument is expected to be obtained. Consequently, estimation of other measures, such as quantiles, is a problem that is efficiently addressed by the proposed methodology and applications in various areas are therefore derived. Simulation studies based upon real and artificial populations show that the proposed estimators perform better than the existing ones. A practical situation in which the proposed estimators can be applied is also described.     

Nonparametric function estimation subject to monotonicity, convexity and other shape constraints

This paper uses free-knot and fixed-knot regression splines in a Bayesian context to develop methods for the nonparametric estimation of functions subject to shape constraints in models with log-concave likelihood functions. The shape constraints we consider include monotonicity, convexity and functions with a single minimum. A computationally efficient MCMC sampling algorithm is developed that converges faster than previous methods for non-Gaussian models. Simulation results indicate the monotonically constrained function estimates have good small sample properties relative to (i) unconstrained function estimates, and (ii) function estimates obtained from other constrained estimation methods when such methods exist. Also, asymptotic results show the methodology provides consistent estimates for a large class of smooth functions. Two detailed illustrations exemplify the ideas.     

Semiparametric quantile regression estimation in dynamic models with partially varying coefficients

We study quantile regression estimation for dynamic models with partially varying coefficients so that the values of some coefficients may be functions of informative covariates. Estimation of both parametric and nonparametric functional coefficients are proposed. In particular, we propose a three stage semiparametric procedure. Both consistency and asymptotic normality of the proposed estimators are derived. We demonstrate that the parametric estimators are root-n$n$ consistent and the estimation of the functional coefficients is oracle. In addition, efficiency of parameter estimation is discussed and a simple efficient estimator is proposed. A simple and easily implemented test for the hypothesis of a varying-coefficient is proposed. A Monte Carlo experiment is conducted to evaluate the performance of the proposed estimators.     

Inference on stochastic time-varying coefficient models

Recently, there has been considerable work on stochastic time-varying coefficient models as vehicles for modelling structural change in the macroeconomy with a focus on the estimation of the unobserved paths of random coefficient processes. The dominant estimation methods, in this context, are based on various filters, such as the Kalman filter, that are applicable when the models are cast in state space representations. This paper introduces a new class of autoregressive bounded processes that decompose a time series into a persistent random attractor, a time varying autoregressive component, and martingale difference errors. The paper examines, rigorously, alternative kernel based, nonparametric estimation approaches for such models and derives their basic properties. These estimators have long been studied in the context of deterministic structural change, but their use in the presence of stochastic time variation is novel. The proposed inference methods have desirable properties such as consistency and asymptotic normality and allow a tractable studentization. In extensive Monte Carlo and empirical studies, we find that the methods exhibit very good small sample properties and can shed light on important empirical issues such as the evolution of inflation persistence and the purchasing power parity (PPP) hypothesis.     

Estimation in Surveys Using Conditional Inclusion Probabilities: Simple Random Sampling

In survey sampling, auxiliary information on the population is often available. The aim of this paper is to develop a method which allows one to take into account such auxiliary information at the estimation stage by means of conditional bias adjustment. The basic idea is to attempt to construct a conditionally unbiased estimator. Four estimators that have a small conditional bias with respect to a statistic are proposed. It is shown that many of the estimators used in the literature in the case of simple random sampling can be obtained by using this estimation principle. The problem of simple random sampling with replacement, poststratification, and adjustment of a 2 x 2 dimensional contingency table to marginal totals are discussed in the conditional framework. Finally it is shown that the regression estimator can be viewed as an approximation of an application of the conditional principle.     

On the role of weights rounding in applications of resampling based on pseudopopulations

Resampling methods are widely studied and increasingly employed in applied research and practice. When dealing with complex sampling designs, common resampling techniques require adjusting noninteger sampling weights in order to construct the so called “pseudopopulation” in order to perform the actual resampling. The practice of rounding, however, has been empirically shown to be harmful under general designs. In this paper, we present asymptotic results concerning, in particular, the practice of rounding resampling weights to the nearest integer, an approach that is commonly adopted by virtue of its reduced computational burden, as opposed to randomization‐based alternatives. We prove that such approach leads to nonconsistent estimation of the distribution function of the survey variable; we provide empirical evidence of the practical consequences of the nonconsistency when the point estimation of the variance of complex estimators is of interest.     

Method of moments estimation and identifiability of semiparametric nonlinear errors-in-variables models

This paper deals with a nonlinear errors-in-variables model where the distributions of the unobserved predictor variables and of the measurement errors are nonparametric. Using the instrumental variable approach, we propose method of moments estimators for the unknown parameters and simulation-based estimators to overcome the possible computational difficulty of minimizing an objective function which involves multiple integrals. Both estimators are consistent and asymptotically normally distributed under fairly general regularity conditions. Moreover, root-n consistent semiparametric estimators and a rank condition for model identifiability are derived using the combined methods of the nonparametric technique and Fourier deconvolution.     

Nonlinear regression models with single‐index heteroscedasticity

We consider nonlinear heteroscedastic single‐index models where the mean function is a parametric nonlinear model and the variance function depends on a single‐index structure. We develop an efficient estimation method for the parameters in the mean function by using the weighted least squares estimation, and we propose a “delete‐one‐component” estimator for the single‐index in the variance function based on absolute residuals. Asymptotic results of estimators are also investigated. The estimation methods for the error distribution based on the classical empirical distribution function and an empirical likelihood method are discussed. The empirical likelihood method allows for incorporation of the assumptions on the error distribution into the estimation. Simulations illustrate the results, and a real chemical data set is analyzed to demonstrate the performance of the proposed estimators.