Semiparametric estimation of a bivariate Tobit model

The existing semiparametric estimation literature has mainly focused on univariate Tobit models and no semiparametric estimation has been considered for bivariate Tobit models. In this paper, we consider semiparametric estimation of the bivariate Tobit model proposed by Amemiya (1974), under the independence condition without imposing any parametric restriction on the error distribution. Our estimator is shown to be consistent and asymptotically normal, and simulation results show that our estimator performs well in finite samples. It is also worth noting that while Amemiya’s (1974) instrumental variables estimator (IV) requires the normality assumption, our semiparametric estimator actually outperforms his IV estimator even when normality holds. Our approach can be extended to higher dimensional multivariate Tobit models.     

Relative error prediction in nonparametric deconvolution regression model

In this paper, we studied an alternative estimator of the regression function when the covariates are observed with error. It is based on the minimization of the relative mean squared error. We obtain expressions for its asymptotic bias and variance together with an asymptotic normality result. Our technique is illustrated on simulation studies. Numerical results suggest that the studied estimator can lead to tangible improvements in prediction over the usual kernel deconvolution regression estimator, particularly in the presence of several outliers in the dataset.     

Functional partially linear quantile regression model

This paper considers estimation of a functional partially quantile regression model whose parameters include the infinite dimensional function as well as the slope parameters. We show asymptotical normality of the estimator of the finite dimensional parameter, and derive the rate of convergence of the estimator of the infinite dimensional slope function. In addition, we show the rate of the mean squared prediction error for the proposed estimator. A simulation study is provided to illustrate the numerical performance of the resulting estimators.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Optimal convergence rates,Bahadur representation,and asymptotic normality of partitioning estimators

This paper studies the asymptotic properties of partitioning estimators of the conditional expectation function and its derivatives. Mean-square and uniform convergence rates are established and shown to be optimal under simple and intuitive conditions. The uniform rate explicitly accounts for the effect of moment assumptions, which is useful in semiparametric inference. A general asymptotic integrated mean-square error approximation is obtained and used to derive an optimal plug-in tuning parameter selector. A uniform Bahadur representation is developed for linear functionals of the estimator. Using this representation, asymptotic normality is established, along with consistency of a standard-error estimator. The finite-sample performance of the partitioning estimator is examined and compared to other nonparametric techniques in an extensive simulation study.     

A goodness-of-fit test for GARCH innovation density

We prove asymptotic normality of a suitably standardized integrated square difference between a kernel type error density estimator based on residuals and the expected value of the error density estimator based on innovations in GARCH models. This result is similar to that of Bickel–Rosenblatt under i.i.d. set up. Consequently the goodness-of-fit test for the innovation density of GARCH processes based on this statistic is asymptotically distribution free, unlike the tests based on the residual empirical process. A simulation study comparing the finite sample behavior of this test with Kolmogorov–Smirnov test and the test based on integrated square difference between the kernel density estimate and null density shows some superiority of the proposed test.     

Asymptotics and smoothing parameter selection for penalized spline regression with various loss functions

Penalized splines are used in various types of regression analyses, including non‐parametric quantile, robust and the usual mean regression. In this paper, we focus on the penalized spline estimator with general convex loss functions. By specifying the loss function, we can obtain the mean estimator, quantile estimator and robust estimator. We will first study the asymptotic properties of penalized splines. Specifically, we will show the asymptotic bias and variance as well as the asymptotic normality of the estimator. Next, we will discuss smoothing parameter selection for the minimization of the mean integrated squares error. The new smoothing parameter can be expressed uniquely using the asymptotic bias and variance of the penalized spline estimator. To validate the new smoothing parameter selection method, we will provide a simulation. The simulation results show that the consistency of the estimator with the proposed smoothing parameter selection method can be confirmed and that the proposed estimator has better behavior than the estimator with generalized approximate cross‐validation. A real data example is also addressed.     

Asymptotics of SIMEX-based variance estimation

In this paper, we study the asymptotic properties of simulation extrapolation (SIMEX) based variance estimation that was proposed by Wang et al. (J R Stat Soc Series B 71:425–445, 2009). We first investigate the asymptotic normality of the parameter estimator in general parametric variance function and the local linear estimator for nonparametric variance function when permutation SIMEX (PSIMEX) is used. The asymptotic optimal bandwidth selection with respect to approximate mean integrated squared error (AMISE) for nonparametric estimator is also studied. We finally discuss constructing confidence intervals/bands of the parameter/function of interest. Other than applying the asymptotic results so that normal approximation can be used, we recommend a nonparametric Monte Carlo algorithm to avoid estimating the asymptotic variance of estimator. Simulation studies are carried out for illustration.     

Parametric estimation of hidden stochastic model by contrast minimization and deconvolution

We study a new parametric approach for particular hidden stochastic models. This method is based on contrast minimization and deconvolution and can be applied, for example, for ecological and financial state space models. After proving consistency and asymptotic normality of the estimation leading to asymptotic confidence intervals, we provide a thorough numerical study, which compares most of the classical methods that are used in practice (Quasi-Maximum Likelihood estimator, Simulated Expectation Maximization Likelihood estimator and Bayesian estimators) to estimate the Stochastic Volatility model. We prove that our estimator clearly outperforms the Maximum Likelihood Estimator in term of computing time, but also most of the other methods. We also show that this contrast method is the most robust with respect to non Gaussianity of the error and also does not need any tuning parameter.     

Asymptotic properties of the maximum likelihood estimator in dichotomous logit models

The existence and strong consistency of the maximum likelihood estimator are analyzed in the context of dichotomous logit models. Sufficient conditions are given for the asymptotic normality of this estimator.     

ON THE FIRST–ORDER EFFICIENCY AND ASYMPTOTIC NORMALITY OF MAXIMUM LIKELIHOOD ESTIMATORS OBTAINED FROM DEPENDENT OBSERVATIONS

Abstract. In this paper we study the first–order efficiency and asymptotic normality of the maximum likelihood estimator obtained from dependent observations. Our conditions are weaker than usual, in that we do not require convergences in probability to be uniform or third–order derivatives to exist.
The paper builds on Witting and Nolle's result concerning the asymptotic normality of the maximum likelihood estimator obtained from independent and identically distributed observations, and on a martingale theorem by McLeish.     

Estimators of Regression Parameters for Truncated and Censored Data

Estimators of parameters in semi-parametric left truncated and right censored regression models are proposed. In contrast to the majority of existing estimators, the proposed estimators do not require the error term of the regression model to have a symmetric distribution. In addition the estimators use asymmetric “trimming” of observations. Consistency and asymptotic normality of the estimators are shown. Finite sample properties are considered in a small simulation study. For the left truncated case, an empirical application illustrates the usefulness of the estimator.     

A consistent estimator in general functional errors-in-variables models

The problem of estimation in nonlinear functional errors-in-variables model is considered. A modified least squares estimator is studied, its consistency and asymptotic normality is established. Simulation results are also presented showing the performance of the estimator in comparison with the naive ordinary least squares estimator. Received: June 1999     

A Simple Improvement of the IV‐estimator for the Classical Errors‐in‐Variables Problem

Two measures of an error‐ridden variable make it possible to solve the classical errors‐in‐Variable problem by using one measure as an instrument for the other. It is well known that a second IV‐estimate can be obtained by reversing the roles of the two measures. We explore the optimal linear combination of these two estimates. In a Monte Carlo study, we show that the gain in precision is significant. The proposed estimator also compares well with full information maximum likelihood under normality. We illustrate the method by estimating the capital elasticity in the Norwegian ICT‐industry.     

Quadratic risk domination of restricted least squares estimators via Stein-ruled auxiliary constraints

This paper develops an estimator that under the standard assumption of the General Linear Model, including normality of disturbances, can be designed to dominate the Restricted Least Squares estimator in quadratic risk under very general conditions. The domination is achieved for any choice of symmetric positive definite weighting matrix used in defining the quadratic risk function, regardless of the correctness of the constraints used to define the restricted least squares estimator. The general problem conditions under which the estimator exists, and the risk behavior of the estimator over the parameter space are identified.     

Extreme value statistics for censored data with heavy tails under competing risks

This paper addresses the problem of estimating, from randomly censored data subject to competing risks, the extreme value index of the (sub)-distribution function associated to one particular cause, in a heavy-tail framework. Asymptotic normality of the proposed estimator is established. This estimator has the form of an Aalen-Johansen integral and is the first estimator proposed in this context. Estimation of extreme quantiles of the cumulative incidence function is then addressed as a consequence. A small simulation study exhibits the performances for finite samples.     

An efficient GMM estimator of spatial autoregressive models

In this paper, we consider GMM estimation of the regression and MRSAR models with SAR disturbances. We derive the best GMM estimator within the class of GMM estimators based on linear and quadratic moment conditions. The best GMM estimator has the merit of computational simplicity and asymptotic efficiency. It is asymptotically as efficient as the ML estimator under normality and asymptotically more efficient than the Gaussian QML estimator otherwise. Monte Carlo studies show that, with moderate-sized samples, the best GMM estimator has its biggest advantage when the disturbances are asymmetrically distributed. When the diagonal elements of the spatial weights matrix have enough variation, incorporating kurtosis of the disturbances in the moment functions will also be helpful.     

Asymptotic normality of the NPMLE of linear functionals for interval censored data, case 1

We give a new proof of the asymptotic normality of a class of linear functionals of the nonparametric maximum likelihood estimator (NPMLE) of a distribution function with "case 1" interval censored data. In particular our proof simplifies the proof of asymptotic normality of the mean given in Groeneboom and Wellner (1992). The proof relies strongly on a rate of convergence result due to van de Geer (1993), and methods from empirical process theory.     

Local GMM estimation of time series models with conditional moment restrictions

This paper investigates statistical properties of the local generalized method of moments (LGMM) estimator for some time series models defined by conditional moment restrictions. First, we consider Markov processes with possible conditional heteroskedasticity of unknown forms and establish the consistency, asymptotic normality, and semi-parametric efficiency of the LGMM estimator. Second, we undertake a higher-order asymptotic expansion and demonstrate that the LGMM estimator possesses some appealing bias reduction properties for positively autocorrelated processes. Our analysis of the asymptotic expansion of the LGMM estimator reveals an interesting contrast with the OLS estimator that helps to shed light on the nature of the bias correction performed by the LGMM estimator. The practical importance of these findings is evaluated in terms of a bond and option pricing exercise based on a diffusion model for spot interest rate.     

Estimating the Weight Undersize Distribution for the Wicksell problem

In Wicksell's corpuscle problem one is interested in estimating the distribution of sphere diameters from the diameters of circle profiles obtained by a random section of the body containing the sphericle particles. The problem is known to be an ill posed inverse problem. Several regularization techniques have been applied to find solutions. We will review some of these in this article. In practical situations one often is more interested in the distribution of weight rather than the distribution of diameters. In estimating the weight undersite distribution similar problems are encountered. We will consider an estimator that is obtained by smoothing the distribution function of the circle diameters locally. It will be shown how the bandwidth must be chosen to obtain consistency and mean square error optirnality. Also asymptotic normality will be shown.