Subsampling realised kernels

In a recent paper we have introduced the class of realised kernel estimators of the increments of quadratic variation in the presence of noise. We showed that this estimator is consistent and derived its limit distribution under various assumptions on the kernel weights. In this paper we extend our analysis, looking at the class of subsampled realised kernels and we derive the limit theory for this class of estimators. We find that subsampling is highly advantageous for estimators based on discontinuous kernels, such as the truncated kernel. For kinked kernels, such as the Bartlett kernel, we show that subsampling is impotent, in the sense that subsampling has no effect on the asymptotic distribution. Perhaps surprisingly, for the efficient smooth kernels, such as the Parzen kernel, we show that subsampling is harmful as it increases the asymptotic variance. We also study the performance of subsampled realised kernels in simulations and in empirical work.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Density estimation in the uniform deconvolution model

We consider the problem of estimating a probability density function based on data that are corrupted by noise from a uniform distribution. The (nonparametric) maximum likelihood estimator for the corresponding distribution function is well defined. For the density function this is not the case. We study two nonparametric estimators for this density. The first is a type of kernel density estimate based on the empirical distribution function of the observable data. The second is a kernel density estimate based on the MLE of the distribution function of the unobservable (uncorrupted) data.     

Estimation of dynamic models with nonparametric simulated maximum likelihood

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump-diffusion models.     

k‐Nearest neighbors local linear regression for functional and missing data at random

We combine the k‐Nearest Neighbors (kNN) method to the local linear estimation (LLE) approach to construct a new estimator (LLE‐kNN) of the regression operator when the regressor is of functional type and the response variable is a scalar but observed with some missing at random (MAR) observations. The resulting estimator inherits many of the advantages of both approaches (kNN and LLE methods). This is confirmed by the established asymptotic results, in terms of the pointwise and uniform almost complete consistencies, and the precise convergence rates. In addition, a numerical study (i) on simulated data, then (ii) on a real dataset concerning the sugar quality using fluorescence data, were conducted. This practical study clearly shows the feasibility and the superiority of the LLE‐kNN estimator compared to competitive estimators.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Iterative Density Estimation from Contaminated Observations

We introduce an iterative procedure for estimating the unknown density of a random variable X from n independent copies of Y=X+ɛ, where ɛ is normally distributed measurement error independent of X. Mean integrated squared error convergence rates are studied over function classes arising from Fourier conditions. Minimax rates are derived for these classes. It is found that the sequence of estimators defined by the iterative procedure attains the optimal rates. In addition, it is shown that the sequence of estimators converges exponentially fast to an estimator within the class of deconvoluting kernel density estimators. The iterative scheme shows how, in practice, density estimation from indirect observations may be performed by simply correcting an appropriate ordinary density estimator. This allows to assess the effect that the perturbation due to contamination by ɛ has on the density to be estimated. We also suggest a method to select the smoothing parameter required by the iterative approach and, utilizing this method, perform a simulation study.     

Smoothing histograms by means of lattice-and continuous distributions

Summary Using lattice distributions or an auxiliary density function each satisfying certain moment conditions a general type of estimator for a one dimensional density functionf is developed. This estimator can be looked at as a smoothed histogram. As a measure of quality the exact order of magnitude for the mean squared error is established (pointwise and uniformly) in terms of the size of an iid sample drawn fromf and depending on a design parameter. The methods in deriving the asymptotic behaviour of the mean squared error are based on Edgeworth expansions for the auxiliary distributions.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

Semi-parametric estimation of American option prices

We introduce a novel semi-parametric estimator of American option prices in discrete time. The specification is based on a parameterized stochastic discount factor and is nonparametric w.r.t. the historical dynamics of the Markovian state variables. The historical transition density estimator minimizes a distance built on the Kullback–Leibler divergence from a kernel transition density, subject to the no-arbitrage restrictions for a non-defaultable bond, the underlying asset and some American option prices. We use dynamic programming to make explicit the nonlinear restrictions on the Euclidean and functional parameters coming from option data. We study asymptotic and finite sample properties of the estimators.     

Kernel estimation of a smooth distribution function based on censored data

The problem of estimating a smooth distribution functionF at a pointτ based on randomly right censored data is treated under certain smoothness conditions onF. The asymptotic performance of a certain class of kernel estimators is compared to that of the Kaplan-Meier estimator ofF(τ). It is shown that the relative deficiency of the Kaplan-Meier estimator ofF(τ) with respect to the appropriately chosen kernel type estimator tends to infinity as the sample sizen increases to infinity. Strong uniform consistency and the weak convergence of the normalized process are also proved. Research Surported in part by NIH grant 1R01GM28405.     

A fast resample method for parametric and semiparametric models

We propose a fast resample method for two step nonlinear parametric and semiparametric models, which does not require recomputation of the second stage estimator during each resample iteration. The fast resample method directly exploits the score function representations computed on each bootstrap sample, thereby reducing computational time considerably. This method is used to approximate the limit distribution of parametric and semiparametric estimators, possibly simulation based, that admit an asymptotic linear representation. Monte Carlo experiments demonstrate the desirable performance and vast improvement in the numerical speed of the fast bootstrap method.     

Large sample estimation and testing procedures for dynamic equation systems

Joint two-step estimation procedures which have the same asymptotic properties as the maximum likelihood (ML) estimator are developed for the final equation, transfer function and structural form of a multivariate dynamic model with normally distributed vector-moving average errors. The ML estimator under fixed and known initial values is obtained by iterating the procedure until convergence. The asymptotic distribution of the two-step estimators is used to construct large sample testing procedures for the different forms of the model.     

Robust explicit estimators of Weibull parameters

The Weibull distribution plays a central role in modeling duration data. Its maximum likelihood estimator is very sensitive to outliers. We propose three robust and explicit Weibull parameter estimators: the quantile least squares, the repeated median and the median/Q _n estimator. We derive their breakdown point, influence function, asymptotic variance and study their finite sample properties in a Monte Carlo study. The methods are illustrated on real lifetime data affected by a recording error.     

Robust estimators for estimating discontinuous functions

We study the asymptotic behavior of a wide class of kernel estimators for estimating an unknown regression function. In particular we derive the asymptotic behavior at discontinuity points of the regression function. It turns out that some kernel estimators based on outlier robust estimators are consistent at jumps.     

Remarks on the strong law of large numbers for a triangular array of associated random variables

A strong law of large numbers for a triangular array of strictly stationary associated random variables is proved. It is used to derive the pointwise strong consistency of kernel type density estimator of the one-dimensional marginal density function of a strictly stationary sequence of associated random variables, and to obtain an improved version of a result by Van Ryzin (1969) on the strong consistency of density estimator for a sequence of independent and identically distributed random variables.     

Estimating the conditional mode of a stationary stochastic process from noisy observations

Let {(X _i, Y _i,)}, i≥1, be a strictly stationary process from noisy observations. We examine the effect of the noise in the response Y and the covariates X on the nonparametric estimation of the conditional mode function. To estimate this function we are using deconvoluting kernel estimators. The asymptotic behavior of these estimators depends on the smoothness of the noise distribution, which is classified as either ordinary smooth or super smooth. Uniform convergence with almost sure convergence rates is established for strongly mixing stochastic processes, when the noise distribution is ordinary smooth. Received: April 1998     

Cointegration Vector Estimation by Panel DOLS and Long‐run Money Demand*

We study the panel dynamic ordinary least square (DOLS) estimator of a homogeneous cointegration vector for a balanced panel of N individuals observed over T time periods. Allowable heterogeneity across individuals include individual‐specific time trends, individual‐specific fixed effects and time‐specific effects. The estimator is fully parametric, computationally convenient, and more precise than the single equation estimator. For fixed N as T→∞, the estimator converges to a function of Brownian motions and the Wald statistic for testing a set of s linear constraints has a limiting χ²(s) distribution. The estimator also has a Gaussian sequential limit distribution that is obtained first by letting T→∞ and then letting N→∞. In a series of Monte‐Carlo experiments, we find that the asymptotic distribution theory provides a reasonably close approximation to the exact finite sample distribution. We use panel DOLS to estimate coefficients of the long‐run money demand function from a panel of 19 countries with annual observations that span from 1957 to 1996. The estimated income elasticity is 1.08 (asymptotic s.e. = 0.26) and the estimated interest rate semi‐elasticity is ?0.02 (asymptotic s.e. = 0.01).     

Two-dimensional Bernstein polynomial density estimators

A Bernstein polynomial estimator for f_nN(x, y) for an unknown probability density functionf(x, y) concentrated on the triangle ={(x, y): 0x, y<1,x+y<1} or on the square =(x, y):0 x, y 1 is developed. As a measure of quality the exact order of magnitude for the pointwise mean squared error is established. It is seen that the quality of these Bernstein polynomial estimators is comparable with the quality of the so-called kernel estimators. Further for such estimators uniform weak consistency results and central limit theorems are developed.