Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Long difference instrumental variables estimation for dynamic panel models with fixed effects

This paper proposes a new instrumental variables estimator for a dynamic panel model with fixed effects with good bias and mean squared error properties even when identification of the model becomes weak near the unit circle. We adopt a weak instrument asymptotic approximation to study the behavior of various estimators near the unit circle. We show that an estimator based on long differencing the model is much less biased than conventional implementations of the GMM estimator for the dynamic panel model. We also show that under the weak instrument approximation conventional GMM estimators are dominated in terms of mean squared error by an estimator with far less moment conditions. The long difference (LD) estimator mimics the infeasible optimal procedure through its reliance on a small set of moment conditions.     

Quasi-maximum likelihood estimation for conditional quantiles

In this paper, we construct a new class of estimators for conditional quantiles in possibly misspecified nonlinear models with time series data. Proposed estimators belong to the family of quasi-maximum likelihood estimators (QMLEs) and are based on a new family of densities which we call ‘tick-exponential’. A well-known member of the tick-exponential family is the asymmetric Laplace density, and the corresponding QMLE reduces to the Koenker and Bassett's (Econometrica 46 (1978) 33) nonlinear quantile regression estimator. We derive primitive conditions under which the tick-exponential QMLEs are consistent and asymptotically normally distributed with an asymptotic covariance matrix that accounts for possible conditional quantile model misspecification and which can be consistently estimated by using the tick-exponential scores and Hessian matrix. Despite its non-differentiability, the tick-exponential quasi-likelihood is easy to maximize by using a ‘minimax’ representation not seen in the earlier work on conditional quantile estimation.     

Robust estimation of scale of an exponential distribution

We consider the standardized median as an estimator of scale for exponential samples which is most B-robust in the sense of H ampel et al. (1986). This estimator is compared with two other estimators which were proposed to R ousseeuw and C roux (1993) but for a Gaussian model. All three estimators have the same breakdown point, but their bias curves are different. It is shown that under a gross error model the explosion bias curve of the most B-robust estimator performs better than the bias curves of the other estimators. But this estimator is worse than the two estimators proposed by R ousseeuw and C roux (1993) if the implosion bias curve is considered.     

Estimating Mann–Whitney‐type Causal Effects

Mann–Whitney‐type causal effects are generally applicable to outcome variables with a natural ordering, have been recommended for clinical trials because of their clinical relevance and interpretability and are particularly useful in analysing an ordinal composite outcome that combines an original primary outcome with death and possibly treatment discontinuation. In this article, we consider robust and efficient estimation of such causal effects in observational studies and clinical trials. For observational studies, we propose and compare several estimators: regression estimators based on an outcome regression (OR) model or a generalised probabilistic index (GPI) model, an inverse probability weighted estimator based on a propensity score model and two doubly robust (DR), locally efficient estimators. One of the DR estimators involves a propensity score model and an OR model, is consistent and asymptotically normal under the union of the two models and attains the semiparametric information bound when both models are correct. The other DR estimator has the same properties with the OR model replaced by a GPI model. For clinical trials, we extend an existing augmented estimator based on a GPI model and propose a new one based on an OR model. The methods are evaluated and compared in simulation experiments and applied to a clinical trial in cardiology and an observational study in obstetrics.     

Exponential deconvolution: two asymptotically equivalent estimators

Two isotonic estimators for the distribution function in a specific deconvolution model, the exponential deconvolution model, are considered. The first estimator is a least squares projection of a naive estimator for the distribution function on the set of distribution functions. The second estimator is the well known maximum likelihood estimator. The two estimators are shown to be first order asymptotically equivalent at a fixed point.     

Statistical Inference in Nonparametric Frontier Models: The State of the Art

Efficiency scores of firms are measured by their distance to an estimated production frontier. The economic literature proposes several nonparametric frontier estimators based on the idea of enveloping the data (FDH and DEA-type estimators). Many have claimed that FDH and DEA techniques are non-statistical, as opposed to econometric approaches where particular parametric expressions are posited to model the frontier. We can now define a statistical model allowing determination of the statistical properties of the nonparametric estimators in the multi-output and multi-input case. New results provide the asymptotic sampling distribution of the FDH estimator in a multivariate setting and of the DEA estimator in the bivariate case. Sampling distributions may also be approximated by bootstrap distributions in very general situations. Consequently, statistical inference based on DEA/FDH-type estimators is now possible. These techniques allow correction for the bias of the efficiency estimators and estimation of confidence intervals for the efficiency measures. This paper summarizes the results which are now available, and provides a brief guide to the existing literature. Emphasizing the role of hypotheses and inference, we show how the results can be used or adapted for practical purposes.     

Model reference adaptive systems applied to regression analyses

The adaptive estimation procedure of model reference adaptive systems is modified and applied to linear models. In general the principle can be used for almost any time series model. Because of the recursive nature of the resulting estimator, it is computationally appealing, especially when a time series is considered as a flow of data. In addition, the estimator turns out to have certain statistical optimality properties.
In the linear regression setting, Ridge estimators turn out to constitute a subclass of the adaptive estimators considered, whereas for unknown measurement variance, the resulting estimators are related to J ames -S tkin type estimators, and have better properties than the latter. The estimator is shown to be strongly consistent and to converge in law to a normal variate under the standard assumptions of linear models. Further it is shown to be admissible and minimax in restricted parameter spaces. The connection between K alman filters and the classical least-squares estimator is also pointed out.     

Instrumental variables estimation of a nearly nonstationary,heterogeneous error component model

This paper studies instrumental variables (IV) estimation for an error component model with stationary and nearly nonstationary regressors. It is assumed that the numbers of cross section and time series observations are infinite. Furthermore, autoregressive disturbances are assumed for the error component model, the structure of which may vary with individuals. The estimators considered are the Within-IV-OLS, Within-IV-GLS and IV-GLS estimators. The GLS estimators use Gohberg's formula, which is particularly useful when autoregressive structures are imposed on the disturbance terms. Sequential limit theories for the estimators are derived, and it is shown that all of the estimators have normal distributions in the limit. Additionally, Wald tests for coefficient vectors are shown to have chi-square distributions in the limit. Simulation results regarding the estimator efficiency and the size of the Wald tests are also reported. The results show that the Within-IV-GLS and IV-GLS estimators are more efficient than the Within-IV-OLS estimator in most cases and that the Wald tests keep nominal size reasonably well. The relation between the trade and budget deficits of 23 OECD nations is examined using the panel IV estimators. The empirical results support the view that the budget and trade deficits move in the same direction.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

An unexpected property of minimax estimation in the relative squared error approach to linear regression analysis

An unexpected property of the relative squared error approach to linear regression analysis is derived: It is shown that an estimator being minimax among all linear affine estimators is also minimax in the set of all estimators. Two illustrative special cases are mentioned, where a generalized least squares estimator and a general ridge or Kuks-Olman estimator turn out to be minimax.     

On the estimation of multinomial logit models from relative frequency data

Standard estimators for the binomial logit model and for the multinomial logit model allow for an error arising from the use of relative frequencies instead of the true probabilities as the dependent variable. Recently Amemiya and Nold (1975) have considered the effect of the presence of an additional specification error in the binomial logit model and have proposed a modified logit estimation scheme to take the additional error variance into account. This paper extends their idea to the multinomial logit model and proposes an estimator that is consistent and asymptotically more efficient than the standard multinomial logit estimator. The paper presents a comparison of the results of applying the new estimator and existing estimators to a logit model for the choice of automobile ownership in the United States.     

Kantorovich inequalities and efficiency comparisons for several classes of estimators in linear models

New matrix, determinant and trace versions of the Kantorovich inequality (KI) involving two positive definite matrices are presented. Some of these are used to study the efficiencies of minimum-distance (MD) estimators, generalized method-of-moments (GMM) estimators and several estimators specific to longitudinal or panel-data analysis. They are also used to give upper bounds for the determinant and trace of the asymptotic variance matrix of a weighted least-squares (WLS) estimator in the generalized linear model.     

Determination of Discrete Spectrum in a Random Field

We consider a two dimensional frequency model in a random field, which can be used to model textures and also has wide applications in Statistical Signal Processing. First we consider the usual least squares estimators and obtain the consistency and the asymptotic distribution of the least squares estimators. Next we consider an estimator, which can be obtained by maximizing the periodogram function. It is observed that the least squares estimators and the estimators obtained by maximizing the periodogram function are asymptotically equivalent. Some numerical experiments are performed to see how the results work for finite samples. We apply our results on simulated textures to observe how the different estimators perform in estimating the true textures from a noisy data.     

Model averaging based on James–Stein estimators

Existing model averaging methods are generally based on ordinary least squares (OLS) estimators. However, it is well known that the James–Stein (JS) estimator dominates the OLS estimator under quadratic loss, provided that the dimension of coefficient is larger than two. Thus, we focus on model averaging based on JS estimators instead of OLS estimators. We develop a weight choice method and prove its asymptotic optimality. A simulation experiment shows promising results for the proposed model average estimator.     

Are robust estimation methods useful in the structural errors-in-variables model?

Summary In this paper it is investigated whether robust estimation procedures for the parameters of a regression model are also applicable when the observations are generated by the errors-in-variables model. Specifically, attention is paid to bounded-influence estimators, i.e. estimators that are constructed in such a way that the influence of a single observation on the outcome of the estimator is bounded. Both the classical errors-in-variables model and models with contaminated observational errors are considered.The authors are indebted to a referee for his valuable comments on an earlier version of this paper.     

Semiparametric econometric estimators for a truncated regression model: a review with an extension

Econometric estimators for a truncated regression model are reviewed. For each estimator, the motivations, the key assumptions, the asymptotic distribution and estimates for the asymptotic variance matrix are presented; also a new estimator is suggested. We select five practical estimators among those, and compare them through a Monte Carlo study where the response variable is simulated but the covariates are drawn from a real data set. Some practical and computational issues are addressed as well.     

Semiparametric estimation of logistic regression model with missing covariates and outcome

We consider a semiparametric method to estimate logistic regression models with missing both covariates and an outcome variable, and propose two new estimators. The first, which is based solely on the validation set, is an extension of the validation likelihood estimator of Breslow and Cain (Biometrika 75:11–20, 1988). The second is a joint conditional likelihood estimator based on the validation and non-validation data sets. Both estimators are semiparametric as they do not require any model assumptions regarding the missing data mechanism nor the specification of the conditional distribution of the missing covariates given the observed covariates. The asymptotic distribution theory is developed under the assumption that all covariate variables are categorical. The finite-sample properties of the proposed estimators are investigated through simulation studies showing that the joint conditional likelihood estimator is the most efficient. A cable TV survey data set from Taiwan is used to illustrate the practical use of the proposed methodology.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.