Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Repeated substitution method: The ratio estimator for the population variance

This paper proposes a new unbiased estimator for the population variance in finite population sample surveys using auxiliary information. This estimator has a smaller mean squared error than the conventional unbiased estimator, the ratio estimator established by Isaki (1983) and it has the same precision than the regression estimator. Furthermore, it is a much more interesting estimator from the computation viewpoint.     

Asymptotic distributions of smoothed histograms

As an estimator for an unknown probability density functionf, concentrated on a known intervalI, one can use a histogram smoothed by a suitable family of lattice distributions. For such an estimator a uniform weak consistency result and a central limit theorem with an error bound are given. Further for the global deviation of fromf the asymptotic distribution is developed.Partially supported by the Natural Sciences and Engineering Research Council of Canada, grant A 2983, A4806, and A3988.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

A note on a mixing problem and the schützenberger inequality

Summary In a Bayesian context a lower bound for the mean squared error of an estimator of the unknown proportion in the mixture of two distributions is considered, which involve the symmetrized Kullback “distance” between the distributions of the mixture. Conditions under which Schützenberger’s inequality holds are then examined.     

Iterative Density Estimation from Contaminated Observations

We introduce an iterative procedure for estimating the unknown density of a random variable X from n independent copies of Y=X+ɛ, where ɛ is normally distributed measurement error independent of X. Mean integrated squared error convergence rates are studied over function classes arising from Fourier conditions. Minimax rates are derived for these classes. It is found that the sequence of estimators defined by the iterative procedure attains the optimal rates. In addition, it is shown that the sequence of estimators converges exponentially fast to an estimator within the class of deconvoluting kernel density estimators. The iterative scheme shows how, in practice, density estimation from indirect observations may be performed by simply correcting an appropriate ordinary density estimator. This allows to assess the effect that the perturbation due to contamination by ɛ has on the density to be estimated. We also suggest a method to select the smoothing parameter required by the iterative approach and, utilizing this method, perform a simulation study.     

Variance estimation using auxiliary information: An almost unbiased multivariate ratio estimator

The goal of this paper is to investigate the repeated substitution method (seeSrivastava, 1967) estimating population variance in finite population sample surveys. We propose an almost unbiased multivariate ratio estimator that has a smaller mean squared error than the conventional biased multivariate ratio estimator (established byIsaki (1983)) and with the same precision as the multivariate regression estimator. Furthermore, it is a computationally much more interesting estimator since to compute it we only need to have knowledge of correlation among available variables, which it is common to have in several practical situations. A comparison of the multivariate ratio estimator proposed and the multivariate regression estimator is given.     

Zur Schätzung eines Dichtefunktionals

Summary Fór the estimation of the functional (f)=f ²(x)dx Bhattacharyya andRoussas [1969] proposed an estimator based on the kernel-technique for density estimation. This paper describes a method, which rests on density estimations by orthogonal expansions. In the main we show the considered estimator to be consistent in the quadratic mean.     

On Estimators of the Nearest Neighbour Distance Distribution Function for Stationary Point Processes

There are three approaches for the estimation of the distribution function D(r) of distance to the nearest neighbour of a stationary point process: the border method, the Hanisch method and the Kaplan-Meier approach. The corresponding estimators and some modifications are compared with respect to bias and mean squared error (mse). Simulations for Poisson, cluster and hard-core processes show that the classical border estimator has good properties; still better is the Hanisch estimator. Typically, mse depends on r, having small values for small and large r and a maximum in between. The mse is not reduced if the exact intensity λ (if known) or intensity estimators from larger windows are built in the estimators of D(r); in contrast, the intensity estimator should have the same precision as that of λ D(r). In the case of replicated estimation from more than one window the best way of pooling the subwindow estimates is averaging by weights which are proportional to squared point numbers.     

Estimation of Fisher information using model selection

In the paper the problem of estimation of Fisher information I _f for a univariate density supported on [0, 1] is discussed. A starting point is an observation that when the density belongs to an exponential family of a known dimension, an explicit formula for I _f there allows for its simple estimation. In a general case, for a given random sample, a dimension of an exponential family which approximates it best is sought and then estimator of I _f is constructed for the chosen family. As a measure of quality of fit a modified Bayes Information Criterion is used. The estimator, which is an instance of Post Model Selection Estimation method is proved to be consistent and asymptotically normal when the density belongs to the exponential family. Its consistency is also proved under misspecification when the number of exponential models under consideration increases in a suitable way. Moreover we provide evidence that in most of considered parametric cases the small sample performance of proposed estimator is superior to that of kernel estimators.     

Long difference instrumental variables estimation for dynamic panel models with fixed effects

This paper proposes a new instrumental variables estimator for a dynamic panel model with fixed effects with good bias and mean squared error properties even when identification of the model becomes weak near the unit circle. We adopt a weak instrument asymptotic approximation to study the behavior of various estimators near the unit circle. We show that an estimator based on long differencing the model is much less biased than conventional implementations of the GMM estimator for the dynamic panel model. We also show that under the weak instrument approximation conventional GMM estimators are dominated in terms of mean squared error by an estimator with far less moment conditions. The long difference (LD) estimator mimics the infeasible optimal procedure through its reliance on a small set of moment conditions.     

Minimax estimation of constrained parametric functions for discrete families of distributions

For a vast class of discrete model families where the natural parameter is constrained to an interval, we give conditions for which the Bayes estimator with respect to a boundary supported prior is minimax under squared error loss type functions. Building on a general development of éric Marchand and Ahmad Parsian, applicable to squared error loss, we obtain extensions to various parametric functions and squared error loss type functions. We provide illustrations for various distributions and parametric functions, and these include examples for many common discrete distributions, as well as when the parametric function is a zero-count probability, an odds-ratio, a Binomial variance, and a Negative Binomial variance, among others. The Research of M. Jafari Jozani is supported by a grant of the Institute for Research and Planning in Higher Education, Ministry of Science, Research and Technology, Iran. The Research of é. Marchand is supported by NSERC of Canada.     

Plug‐in bandwidth selector for recursive kernel regression estimators defined by stochastic approximation method

In this paper, we propose an automatic selection of the bandwidth of the recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and the stepsize which minimize the mean weighted integrated squared error, the recursive estimator will be better than the non‐recursive one for small sample setting in terms of estimation error and computational costs. We corroborated these theoretical results through simulation study and a real dataset.     

On estimating the reliability after sequentially estimating the mean: The exponential case

Sequential estimation problems for the mean parameter of an exponential distribution has received much attention over the years. Purely sequential and accelerated sequential estimators and their asymptotic second-order characteristics have been laid out in the existing literature, both for minimum risk point as well as bounded length confidence interval estimation of the mean parameter. Having obtained a data set from such sequentially designed experiments, the paper investigates estimation problems for the associatedreliability function. Second-order approximations are provided for the bias and mean squared error of the proposed estimator of the reliability function, first under a general setup. An ad hoc bias-corrected version is also introduced. Then, the proposed estimator is investigated further under some specific sequential sampling strategies, already available in the literature. In the end, simulation results are presented for comparing the proposed estimators of the reliability function for moderate sample sizes and various sequential sampling strategies.     

Shrinkage estimation of the proportion in randomized response

This article considers the asymptotic estimation theory for the proportion in randomized response survey usinguncertain prior information (UPI) about the true proportion parameter which is assumed to be available on the basis of some sort of realistic conjecture. Three estimators, namely, the unrestricted estimator, the shrinkage restricted estimator and an estimator based on a preliminary test, are proposed. Their asymptotic mean squared errors are derived and compared. The relative dominance picture of the estimators is presented.     

Two-dimensional Bernstein polynomial density estimators

A Bernstein polynomial estimator for f_nN(x, y) for an unknown probability density functionf(x, y) concentrated on the triangle ={(x, y): 0x, y<1,x+y<1} or on the square =(x, y):0 x, y 1 is developed. As a measure of quality the exact order of magnitude for the pointwise mean squared error is established. It is seen that the quality of these Bernstein polynomial estimators is comparable with the quality of the so-called kernel estimators. Further for such estimators uniform weak consistency results and central limit theorems are developed.     

Finite sample properties for the semiparametric estimation of the intercept of a censored regression model

Financial support for this paper was provided by a C.A. Anderson Fellowship of the Cowles Foundation. I wish to thank Donald Andrews, Moshe Buchinsky, Oliver Linton, and Peter Robinson for helpful discussions. I also wish to thank three anonymous referees for their comments and suggestions. I am, of course, responsible for any remaining errors. A popular two-step estimator of the intercept of a censored regression model is compared with consistent asymptotically normal semiparametric alternatives. Using a root mean squared error criterion, the semiparametric estimators perform better for a range of bandwidth parameter choices for a variety of distributions of the errors and regressors. For error distributions that are close to the normal, however, the two-step parametric estimator performs better.     

Semiparametric deconvolution with unknown error variance

Deconvolution is a useful statistical technique for recovering an unknown density in the presence of measurement error. Typically, the method hinges on stringent assumptions about the nature of the measurement error, more specifically, that the distribution is entirely known. We relax this assumption in the context of a regression error component model and develop an estimator for the unknown density. We show semi-uniform consistency of the estimator and provide an application to the stochastic frontier model.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

Relative error prediction in nonparametric deconvolution regression model

In this paper, we studied an alternative estimator of the regression function when the covariates are observed with error. It is based on the minimization of the relative mean squared error. We obtain expressions for its asymptotic bias and variance together with an asymptotic normality result. Our technique is illustrated on simulation studies. Numerical results suggest that the studied estimator can lead to tangible improvements in prediction over the usual kernel deconvolution regression estimator, particularly in the presence of several outliers in the dataset.