Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Estimation of dynamic models with nonparametric simulated maximum likelihood

We propose an easy-to-implement simulated maximum likelihood estimator for dynamic models where no closed-form representation of the likelihood function is available. Our method can handle any simulable model without latent dynamics. Using simulated observations, we nonparametrically estimate the unknown density by kernel methods, and then construct a likelihood function that can be maximized. We prove that this nonparametric simulated maximum likelihood (NPSML) estimator is consistent and asymptotically efficient. The higher-order impact of simulations and kernel smoothing on the resulting estimator is also analyzed; in particular, it is shown that the NPSML does not suffer from the usual curse of dimensionality associated with kernel estimators. A simulation study shows good performance of the method when employed in the estimation of jump-diffusion models.     

Nonparametric model validations for hidden Markov models with applications in financial econometrics

We address the nonparametric model validation problem for hidden Markov models with partially observable variables and hidden states. We achieve this goal by constructing a nonparametric simultaneous confidence envelope for transition density function of the observable variables and checking whether the parametric density estimate is contained within such an envelope. Our specification test procedure is motivated by a functional connection between the transition density of the observable variables and the Markov transition kernel of the hidden states. Our approach is applicable for continuous-time diffusion models, stochastic volatility models, nonlinear time series models, and models with market microstructure noise.     

Partial parametric estimation for nonstationary nonlinear regressions

This paper proposes an estimation method for a partial parametric model with multiple integrated time series. Our estimation procedure is based on the decomposition of the nonparametric part of the regression function into homogeneous and integrable components. It consists of two steps: In the first step we parameterize and fit the homogeneous component of the nonparametric part by the nonlinear least squares with other parametric terms in the model, and use in the second step the standard kernel method to nonparametrically estimate the integrable component of the nonparametric part from the residuals in the first step. We establish consistency and obtain the asymptotic distribution of our estimator. A simulation shows that our estimator performs well in finite samples. For the empirical illustration, we estimate the money demand functions for the US and Japan using our model and methodology.     

Nonparametric discrimination of time series data

A normality assumption is usually made for the discrimination between two stationary time series processes. A nonparametric approach is desirable whenever there is doubt concerning the validity of this normality assumption. In this paper a nonparametric approach is suggested based on kernel density estimation firstly on (p+1) sample autocorrelations and secondly on (p+1) consecutive observations. A numerical comparison is made between Fishers linear discrimination based on sample autocorrelations and kernel density discrimination for AR and MA processes with and without Gaussian noise. The methods are applied to some seismological data.     

A Bayesian mixed logit–probit model for multinomial choice

In this paper, we introduce a new flexible mixed model for multinomial discrete choice where the key individual- and alternative-specific parameters of interest are allowed to follow an assumption-free nonparametric density specification, while other alternative-specific coefficients are assumed to be drawn from a multivariate Normal distribution, which eliminates the independence of irrelevant alternatives assumption at the individual level. A hierarchical specification of our model allows us to break down a complex data structure into a set of submodels with the desired features that are naturally assembled in the original system. We estimate the model, using a Bayesian Markov Chain Monte Carlo technique with a multivariate Dirichlet Process (DP) prior on the coefficients with nonparametrically estimated density. We employ a “latent class” sampling algorithm, which is applicable to a general class of models, including non-conjugate DP base priors. The model is applied to supermarket choices of a panel of Houston households whose shopping behavior was observed over a 24-month period in years 2004–2005. We estimate the nonparametric density of two key variables of interest: the price of a basket of goods based on scanner data, and driving distance to the supermarket based on their respective locations. Our semi-parametric approach allows us to identify a complex multi-modal preference distribution, which distinguishes between inframarginal consumers and consumers who strongly value either lower prices or shopping convenience.     

Implied risk aversion and pricing kernel in the FTSE 100 index

This paper studies the estimation of the pricing kernel and explains the pricing kernel puzzle found in the FTSE 100 index. We use prices of options and futures on the FTSE 100 index to derive the risk neutral density (RND). The option-implied RND is inverted by using two nonparametric methods: the implied-volatility surface interpolation method and the positive convolution approximation (PCA) method. The actual density distribution is estimated from the historical data of the FTSE 100 index by using the threshold GARCH (TGARCH) model. The results show that the RNDs derived from the two methods above are relatively negatively skewed and fat-tailed, compared to the actual probability density, that is consistent with the phenomenon of “volatility smile.” The derived risk aversion is found to be locally increasing at the center, but decreasing at both tails asymmetrically. This is the so-called pricing kernel puzzle. The simulation results based on a representative agent model with two state variables show that the pricing kernel is locally increasing with the wealth at the level of 1 and is consistent with the empirical pricing kernel in shape and magnitude.     

Bias-corrected smoothed score function for single-index models

We in this paper investigate smoothed score function based confidence regions for parameters in single-index models. Because a plug-in estimator of nonparametric link function causes the bias of smoothed score function to be non-negligible, the limit of the score function is asymptotically normal with a non-zero mean due to the slow convergence rate of nonparametric estimation. A bias-corrected smoothed score function is recommended for achieving centered normal limit without under-smoothing or high order kernel, and then the confidence region can be constructed by chi-square distribution. Simulation studies are carried out to assess the performance of bias-corrected local likelihood, and to compare with normal approximation approach.     

A goodness-of-fit test for GARCH innovation density

We prove asymptotic normality of a suitably standardized integrated square difference between a kernel type error density estimator based on residuals and the expected value of the error density estimator based on innovations in GARCH models. This result is similar to that of Bickel–Rosenblatt under i.i.d. set up. Consequently the goodness-of-fit test for the innovation density of GARCH processes based on this statistic is asymptotically distribution free, unlike the tests based on the residual empirical process. A simulation study comparing the finite sample behavior of this test with Kolmogorov–Smirnov test and the test based on integrated square difference between the kernel density estimate and null density shows some superiority of the proposed test.     

An efficient nonparametric estimator for models with nonlinear dependence

We provide a convenient econometric framework for the analysis of nonlinear dependence in financial applications. We introduce models with constrained nonparametric dependence, which specify the conditional distribution or the copula in terms of a one-dimensional functional parameter. Our approach is intermediate between standard parametric specifications (which are in general too restrictive) and the fully unrestricted approach (which suffers from the curse of dimensionality). We introduce a nonparametric estimator defined by minimizing a chi-square distance between the constrained densities in the family and an unconstrained kernel estimator of the density. We derive the nonparametric efficiency bound for linear forms and show that the minimum chi-square estimator is nonparametrically efficient for linear forms.     

Differences and derivatives in kernel estimation

Estimators of derivatives of a density function based on differences of the empirical distribution function (Maltz 1974) are identified as derivatives of kernel density estimators using particular kernel functions. Properties of this family of kernels are investigated.     

Estimating the conditional mode of a stationary stochastic process from noisy observations

Let {(X _i, Y _i,)}, i≥1, be a strictly stationary process from noisy observations. We examine the effect of the noise in the response Y and the covariates X on the nonparametric estimation of the conditional mode function. To estimate this function we are using deconvoluting kernel estimators. The asymptotic behavior of these estimators depends on the smoothness of the noise distribution, which is classified as either ordinary smooth or super smooth. Uniform convergence with almost sure convergence rates is established for strongly mixing stochastic processes, when the noise distribution is ordinary smooth. Received: April 1998     

Semi-parametric estimation of American option prices

We introduce a novel semi-parametric estimator of American option prices in discrete time. The specification is based on a parameterized stochastic discount factor and is nonparametric w.r.t. the historical dynamics of the Markovian state variables. The historical transition density estimator minimizes a distance built on the Kullback–Leibler divergence from a kernel transition density, subject to the no-arbitrage restrictions for a non-defaultable bond, the underlying asset and some American option prices. We use dynamic programming to make explicit the nonlinear restrictions on the Euclidean and functional parameters coming from option data. We study asymptotic and finite sample properties of the estimators.     

A test for multimodality of regression derivatives with application to nonparametric growth regressions

This paper presents a method to test for multimodality of an estimated kernel density of derivative estimates from a nonparametric regression. The test is included in a study of nonparametric growth regressions. The results show that in the estimation of unconditional β‐convergence the distribution of the partial effects is multimodal, with one mode in the negative region (primarily OECD economies) and possibly two modes in the positive region (primarily non‐OECD economies) of the estimates. The results for conditional β‐convergence show that the density is predominantly negative and there is mixed evidence that the distribution is unimodal. Copyright © 2009 John Wiley & Sons, Ltd.     

Three Sides of Smoothing: Categorical Data Smoothing, Nonparametric Regression, and Density Estimation

The past forty years have seen a great deal of research into the construction and properties of nonparametric estimates of smooth functions. This research has focused primarily on two sides of the smoothing problem: nonparametric regression and density estimation. Theoretical results for these two situations are similar, and multivariate density estimation was an early justification for the Nadaraya-Watson kernel regression estimator.
A third, less well-explored, strand of applications of smoothing is to the estimation of probabilities in categorical data. In this paper the position of categorical data smoothing as a bridge between nonparametric regression and density estimation is explored. Nonparametric regression provides a paradigm for the construction of effective categorical smoothing estimates, and use of an appropriate likelihood function yields cell probability estimates with many desirable properties. Such estimates can be used to construct regression estimates when one or more of the categorical variables are viewed as response variables. They also lead naturally to the construction of well-behaved density estimates using local or penalized likelihood estimation, which can then be used in a regression context. Several real data sets are used to illustrate these points.     

A consistent model specification test with mixed discrete and continuous data

In this paper we propose a nonparametric kernel-based model specification test that can be used when the regression model contains both discrete and continuous regressors. We employ discrete variable kernel functions and we smooth both the discrete and continuous regressors using least squares cross-validation (CV) methods. The test statistic is shown to have an asymptotic normal null distribution. We also prove the validity of using the wild bootstrap method to approximate the null distribution of the test statistic, the bootstrap being our preferred method for obtaining the null distribution in practice. Simulations show that the proposed test has significant power advantages over conventional kernel tests which rely upon frequency-based nonparametric estimators that require sample splitting to handle the presence of discrete regressors.     

Nonparametric fixed effects model for panel data with locally stationary regressors

We develop methods for inference in nonparametric time-varying fixed effects panel data models that allow for locally stationary regressors and for the time series length $T$ and cross-section size $N$ both being large. We first develop a pooled nonparametric profile least squares dummy variable approach to estimate the nonparametric function, and establish the optimal convergence rate and asymptotic normality of the resultant estimator. We then propose a test statistic to check whether the bivariate nonparametric function is time-varying or the time effect is separable, and derive the asymptotic distribution of the proposed test statistic. We present several simulated examples and two real data analyses to illustrate the finite sample performance of the proposed methods.     

Specification of Distance Functions Using Semi- and Nonparametric Methods with an Application to the Dynamic Performance of Eastern and Western European Air Carriers

In this paper we examine the productive performance of a group of three East European carriers and compare it to thirteen of their West European competitors during the period 1977–1990. We first model the multiple output/multiple input technology with a stochastic distance frontier using recently developed semiparametric efficient methods. The endogeneity of multiple outputs is addressed in part by introducing multivariate kernel estimators for the joint distribution of the multiple outputs and potentially correlated firm random effects. We augment estimates from our semiparametric stochastic distance function with nonparametric distance function methods, using linear programming techniques, as well as with extended decomposition methods, based on the Malmquist index number. Both semi- and nonparametric methods indicate significant slack in resource utilization in the East European carriers relative to their Western counterparts, and limited convergence in efficiency or technical change between them. The implications are rather stark for the long run viability of the East European carriers in our sample.     

A Bayesian approach to bandwidth selection for multivariate kernel regression with an application to state-price density estimation

This paper presents a Bayesian approach to bandwidth selection for multivariate kernel regression. A Monte Carlo study shows that under the average squared error criterion, the Bayesian bandwidth selector is comparable to the cross-validation method and clearly outperforms the bootstrapping and rule-of-thumb bandwidth selectors. The Bayesian bandwidth selector is applied to a multivariate kernel regression model that is often used to estimate the state-price density of Arrow–Debreu securities with the S&P 500 index options data and the DAX index options data. The proposed Bayesian bandwidth selector represents a data-driven solution to the problem of choosing bandwidths for the multivariate kernel regression involved in the nonparametric estimation of the state-price density pioneered by Aït-Sahalia and Lo [Aït-Sahalia, Y., Lo, A.W., 1998. Nonparametric estimation of state-price densities implicit in financial asset prices. The Journal of Finance, 53, 499, 547.]