On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Spatial local M-estimation under association

We investigate the asymptotic behavior of a robust version of local linear regression estimators with variable bandwidth for spatial associated processes. The weak consistency of the proposed estimators is given under appropriate conditions. Furthermore, we establish the asymptotic normality of the estimators, from which expressions for the asymptotic bias and variance can be derived.     

Partial rank estimation of duration models with general forms of censoring

In this paper we propose estimators for the regression coefficients in censored duration models which are distribution free, impose no parametric specification on the baseline hazard function, and can accommodate general forms of censoring. The estimators are shown to have desirable asymptotic properties and Monte Carlo simulations demonstrate good finite sample performance. Among the data features the new estimators can accommodate are covariate-dependent censoring, double censoring, and fixed (individual or group specific) effects. We also examine the behavior of the estimator in an empirical illustration.     

Functional-coefficient models for nonstationary time series data

This paper studies functional coefficient regression models with nonstationary time series data, allowing also for stationary covariates. A local linear fitting scheme is developed to estimate the coefficient functions. The asymptotic distributions of the estimators are obtained, showing different convergence rates for the stationary and nonstationary covariates. A two-stage approach is proposed to achieve estimation optimality in the sense of minimizing the asymptotic mean squared error. When the coefficient function is a function of a nonstationary variable, the new findings are that the asymptotic bias of its nonparametric estimator is the same as the stationary covariate case but convergence rate differs, and further, the asymptotic distribution is a mixed normal, associated with the local time of a standard Brownian motion. The asymptotic behavior at boundaries is also investigated.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

The smoothing dichotomy in nonparametric regression under long-memory errors

The phenomenon of smoothing dichotomy in random-design nonparametric regression is exposed in nontechnical terms from two recent papers published jointly with Jan Mielniczuk. This concerns the asymptotic distribution of kernel estimators when the errors exhibit long-range dependence, being instantaneous functions either of Gaussian sequences or of infinite-order moving averages, depending on the amount of smoothing.     

Subsampling realised kernels

In a recent paper we have introduced the class of realised kernel estimators of the increments of quadratic variation in the presence of noise. We showed that this estimator is consistent and derived its limit distribution under various assumptions on the kernel weights. In this paper we extend our analysis, looking at the class of subsampled realised kernels and we derive the limit theory for this class of estimators. We find that subsampling is highly advantageous for estimators based on discontinuous kernels, such as the truncated kernel. For kinked kernels, such as the Bartlett kernel, we show that subsampling is impotent, in the sense that subsampling has no effect on the asymptotic distribution. Perhaps surprisingly, for the efficient smooth kernels, such as the Parzen kernel, we show that subsampling is harmful as it increases the asymptotic variance. We also study the performance of subsampled realised kernels in simulations and in empirical work.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

Estimating the conditional mode of a stationary stochastic process from noisy observations

Let {(X _i, Y _i,)}, i≥1, be a strictly stationary process from noisy observations. We examine the effect of the noise in the response Y and the covariates X on the nonparametric estimation of the conditional mode function. To estimate this function we are using deconvoluting kernel estimators. The asymptotic behavior of these estimators depends on the smoothness of the noise distribution, which is classified as either ordinary smooth or super smooth. Uniform convergence with almost sure convergence rates is established for strongly mixing stochastic processes, when the noise distribution is ordinary smooth. Received: April 1998     

Blockwise bootstrap wavelet in nonparametric regression model with weakly dependent processes

In this paper, we suggest a blockwise bootstrap wavelet to estimate the regression function in the nonparametric regression models with weakly dependent processes for both designs of fixed and random. We obtain the asymptotic orders of the biases and variances of the estimators and establish the asymptotic normality for a modified version of the estimators. We also introduce a principle to select the length of data block. These results show that the blockwise bootstrap wavelet is valid for general weakly dependent processes such as α-mixing, φ-mixing and ρ-mixing random variables.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

A consistent model specification test with mixed discrete and continuous data

In this paper we propose a nonparametric kernel-based model specification test that can be used when the regression model contains both discrete and continuous regressors. We employ discrete variable kernel functions and we smooth both the discrete and continuous regressors using least squares cross-validation (CV) methods. The test statistic is shown to have an asymptotic normal null distribution. We also prove the validity of using the wild bootstrap method to approximate the null distribution of the test statistic, the bootstrap being our preferred method for obtaining the null distribution in practice. Simulations show that the proposed test has significant power advantages over conventional kernel tests which rely upon frequency-based nonparametric estimators that require sample splitting to handle the presence of discrete regressors.     

Identification and estimation of polynomial errors-in-variables models

Methods of estimation of regression coefficients are proposed when the regression function includes a polynomial in a ‘true’ regressor which is measured with error. Two sources of additional information concerning the unobservable regressor are considered: either an additional indicator of the regressor (itself measured with error) or instrumental variables which characterize the systematic variation in the true regressor. In both cases, estimators are constructed by relating moments involving the unobserved variables to moments of observables; these relations lead to recursion formulae for computation of the regression coefficients and nuisance parameters (e.g., moments of the measurement error). Consistency and asymptotic normality of the estimated coefficients is demonstrated, and consistent estimators of the asymptotic covariant matrices are provided.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

Regression models with mixed sampling frequencies

We study regression models that involve data sampled at different frequencies. We derive the asymptotic properties of the NLS estimators of such regression models and compare them with the LS estimators of a traditional model that involves aggregating or equally weighting data to estimate a model at the same sampling frequency. In addition we propose new tests to examine the null hypothesis of equal weights in aggregating time series in a regression model. We explore the above theoretical aspects and verify them via an extensive Monte Carlo simulation study and an empirical application.     

Weighted least squares estimators in possibly misspecified nonlinear regression

The behavior of estimators for misspecified parametric models has been well studied. We consider estimators for misspecified nonlinear regression models, with error and covariates possibly dependent. These models are described by specifying a parametric model for the conditional expectation of the response given the covariates. This is a parametric family of conditional constraints, which makes the model itself close to nonparametric. We study the behavior of weighted least squares estimators both when the regression function is correctly specified, and when it is misspecified and also involves possible additional covariates.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

A note on autoregressive error components models

The purpose of this paper is to shed some light on the asymptotic behavior of a wide class of estimators for a dynamic error components model when only the number of individuals tends to infinity, the number of time periods being kept fixed. In particular, it is shown that this asymptotic behavior is highly dependent on the assumption about the initial observations and that it offers very good approximations to the small sample behavior of the various estimators under consideration.     

Relative error prediction in nonparametric deconvolution regression model

In this paper, we studied an alternative estimator of the regression function when the covariates are observed with error. It is based on the minimization of the relative mean squared error. We obtain expressions for its asymptotic bias and variance together with an asymptotic normality result. Our technique is illustrated on simulation studies. Numerical results suggest that the studied estimator can lead to tangible improvements in prediction over the usual kernel deconvolution regression estimator, particularly in the presence of several outliers in the dataset.