Density estimation in the uniform deconvolution model

We consider the problem of estimating a probability density function based on data that are corrupted by noise from a uniform distribution. The (nonparametric) maximum likelihood estimator for the corresponding distribution function is well defined. For the density function this is not the case. We study two nonparametric estimators for this density. The first is a type of kernel density estimate based on the empirical distribution function of the observable data. The second is a kernel density estimate based on the MLE of the distribution function of the unobservable (uncorrupted) data.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

A goodness-of-fit test for GARCH innovation density

We prove asymptotic normality of a suitably standardized integrated square difference between a kernel type error density estimator based on residuals and the expected value of the error density estimator based on innovations in GARCH models. This result is similar to that of Bickel–Rosenblatt under i.i.d. set up. Consequently the goodness-of-fit test for the innovation density of GARCH processes based on this statistic is asymptotically distribution free, unlike the tests based on the residual empirical process. A simulation study comparing the finite sample behavior of this test with Kolmogorov–Smirnov test and the test based on integrated square difference between the kernel density estimate and null density shows some superiority of the proposed test.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Kernel estimation of a smooth distribution function based on censored data

The problem of estimating a smooth distribution functionF at a pointτ based on randomly right censored data is treated under certain smoothness conditions onF. The asymptotic performance of a certain class of kernel estimators is compared to that of the Kaplan-Meier estimator ofF(τ). It is shown that the relative deficiency of the Kaplan-Meier estimator ofF(τ) with respect to the appropriately chosen kernel type estimator tends to infinity as the sample sizen increases to infinity. Strong uniform consistency and the weak convergence of the normalized process are also proved. Research Surported in part by NIH grant 1R01GM28405.     

Local minimax pointwise estimation of a multivariate density

We consider the problem of the nonparametric minimax estimation of a multivariate density at a given point. A concept of smoothness classes in nonparametric minimax estimation problems is proposed. The smoothness of a function is characterized by the approximability of the function at a point by an integral of the product of this function with an approximate identity. We propose a singular integral estimator, an integral of this approximate identity with respect to the empirical distribution function. Under some assumptions on the approximate identity, the bias of the estimator is shown to be of smaller order asymptotically than the variance, and the estimator itself is shown to be asymptotically locally minimax with respect to the quadratic risk in a proper topology.     

High-frequency returns,jumps and the mixture of normals hypothesis

Previous empirical studies find both evidence of jumps in asset prices and that returns standardized by ‘realized volatility’ are approximately standard normal. These findings appear to be contradictory. Using a sample of high-frequency returns for 20 heavily traded US stocks, we show how microstructure noise distorts the standard deviation and kurtosis of returns normalized using realized variance. When returns are standardized using a recently developed realized kernel estimator, the resulting series is clearly platykurtotic and the standard normal distribution is soundly rejected. Moreover, daily returns standardized using realized bipower variation, an estimator for integrated variance that is robust to the presence of jumps, are more consistent with the standard normal distribution. These results suggest that there is no empirical contradiction: jumps should be included in stock price models.     

Semiparametric efficient adaptive estimation of asymmetric GARCH models

In this paper we derive a semiparametric efficient adaptive estimator of an asymmetric GARCH model. Applying some general results from Drost et al. [1997. The Annals of Statistics 25, 786–818], we first estimate the unknown density function of the disturbances by kernel methods, then apply a one-step Newton–Raphson method to obtain a more efficient estimator than the quasi-maximum likelihood estimator. The proposed semiparametric estimator is adaptive for parameters appearing in the conditional standard deviation model with respect to the unknown distribution of the disturbances.     

Partial parametric estimation for nonstationary nonlinear regressions

This paper proposes an estimation method for a partial parametric model with multiple integrated time series. Our estimation procedure is based on the decomposition of the nonparametric part of the regression function into homogeneous and integrable components. It consists of two steps: In the first step we parameterize and fit the homogeneous component of the nonparametric part by the nonlinear least squares with other parametric terms in the model, and use in the second step the standard kernel method to nonparametrically estimate the integrable component of the nonparametric part from the residuals in the first step. We establish consistency and obtain the asymptotic distribution of our estimator. A simulation shows that our estimator performs well in finite samples. For the empirical illustration, we estimate the money demand functions for the US and Japan using our model and methodology.     

On efficient estimation of the ordered response model

In this paper, we derive efficiency bounds for the ordered response model when the distribution of the errors is unknown. Furthermore, we develop an estimator that is efficient under suitable conditions. Interestingly, neither the bounds nor the estimator are trivial extensions of what has been proposed in the literature for the binary response model. The estimator is composed of quadratic B-splines, and estimation is performed by the method of sieves. In addition, the estimator of the distribution function is restricted to be a proper distribution function. An empirical example on the effect of fees on attendance rates at universities and community colleges is also included; we get substantively different results by relaxing the assumption that the distribution of the errors is normal.     

Conditional empirical likelihood for quantile regression models

In this paper, we propose a new Bayesian quantile regression estimator using conditional empirical likelihood as the working likelihood function. We show that the proposed estimator is asymptotically efficient and the confidence interval constructed is asymptotically valid. Our estimator has low computation cost since the posterior distribution function has explicit form. The finite sample performance of the proposed estimator is evaluated through Monte Carlo studies.     

Nonparametric estimation of distribution functions

Summary Using Silverman and Young’s (1987) idea of rescaling a rescaled smoothed empirical distribution function is defined and investigated when the smoothing parameter depends on the data. The rescaled smoothed estimator is shown to be often better than the commonly used ordinary smoothed estimator.     

Subsampling realised kernels

In a recent paper we have introduced the class of realised kernel estimators of the increments of quadratic variation in the presence of noise. We showed that this estimator is consistent and derived its limit distribution under various assumptions on the kernel weights. In this paper we extend our analysis, looking at the class of subsampled realised kernels and we derive the limit theory for this class of estimators. We find that subsampling is highly advantageous for estimators based on discontinuous kernels, such as the truncated kernel. For kinked kernels, such as the Bartlett kernel, we show that subsampling is impotent, in the sense that subsampling has no effect on the asymptotic distribution. Perhaps surprisingly, for the efficient smooth kernels, such as the Parzen kernel, we show that subsampling is harmful as it increases the asymptotic variance. We also study the performance of subsampled realised kernels in simulations and in empirical work.     

Remarks on the strong law of large numbers for a triangular array of associated random variables

A strong law of large numbers for a triangular array of strictly stationary associated random variables is proved. It is used to derive the pointwise strong consistency of kernel type density estimator of the one-dimensional marginal density function of a strictly stationary sequence of associated random variables, and to obtain an improved version of a result by Van Ryzin (1969) on the strong consistency of density estimator for a sequence of independent and identically distributed random variables.     

Estimation of dynamic models with nonparametric simulated maximum likelihood

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump-diffusion models.     

Multivariate realised kernels: Consistent positive semi-definite estimators of the covariation of equity prices with noise and non-synchronous trading

We propose a multivariate realised kernel to estimate the ex-post covariation of log-prices. We show this new consistent estimator is guaranteed to be positive semi-definite and is robust to measurement error of certain types and can also handle non-synchronous trading. It is the first estimator which has these three properties which are all essential for empirical work in this area. We derive the large sample asymptotics of this estimator and assess its accuracy using a Monte Carlo study. We implement the estimator on some US equity data, comparing our results to previous work which has used returns measured over 5 or 10 min intervals. We show that the new estimator is substantially more precise.     

Estimation of inefficiency in stochastic frontier models: a Bayesian kernel approach

We propose a kernel-based Bayesian framework for the analysis of stochastic frontiers and efficiency measurement. The primary feature of this framework is that the unknown distribution of inefficiency is approximated by a transformed Rosenblatt-Parzen kernel density estimator. To justify the kernel-based model, we conduct a Monte Carlo study and also apply the model to a panel of U.S. large banks. Simulation results show that the kernel-based model is capable of providing more precise estimation and prediction results than the commonly-used exponential stochastic frontier model. The Bayes factor also favors the kernel-based model over the exponential model in the empirical application.

     

Random walk or chaos: A formal test on the Lyapunov exponent

A formal test on the Lyapunov exponent is developed to distinguish a random walk model from a chaotic system, which is based on the Nadaraya–Watson kernel estimator of the Lyapunov exponent. The asymptotic null distribution of our test statistic is free of nuisance parameter, and simply given by the range of standard Brownian motion on the unit interval. The test is consistent against the chaotic alternatives. A simulation study shows that the test performs reasonably well in finite samples. We apply our test to some of the standard macro and financial time series, finding no significant empirical evidence of chaos.     

Differences and derivatives in kernel estimation

Estimators of derivatives of a density function based on differences of the empirical distribution function (Maltz 1974) are identified as derivatives of kernel density estimators using particular kernel functions. Properties of this family of kernels are investigated.