Determination of Discrete Spectrum in a Random Field

We consider a two dimensional frequency model in a random field, which can be used to model textures and also has wide applications in Statistical Signal Processing. First we consider the usual least squares estimators and obtain the consistency and the asymptotic distribution of the least squares estimators. Next we consider an estimator, which can be obtained by maximizing the periodogram function. It is observed that the least squares estimators and the estimators obtained by maximizing the periodogram function are asymptotically equivalent. Some numerical experiments are performed to see how the results work for finite samples. We apply our results on simulated textures to observe how the different estimators perform in estimating the true textures from a noisy data.     

Reduced-bias tail index estimation and the jackknife methodology

In the context of regularly varying tails, we first analyze a generalization of the classical Hill estimator of a positive tail index, with members that are not asymptotically more efficient than the original one. This has led us to propose alternative classical tail index estimators, that may perform asymptotically better than the Hill estimator. As the improvement is not really significant, we also propose generalized jackknife estimators based on any two members of these two classes. These generalized jackknife estimators are compared with the Hill estimator and other reduced-bias estimators available in the literature, asymptotically, and for finite samples, through the use of Monte Carlo simulation. The finite-sample behaviour of the new reduced-bias estimators is also illustrated through a practical example in the field of finance.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

Semiparametric robust estimation of truncated and censored regression models

Many estimation methods of truncated and censored regression models such as the maximum likelihood and symmetrically censored least squares (SCLS) are sensitive to outliers and data contamination as we document. Therefore, we propose a semiparametric general trimmed estimator (GTE) of truncated and censored regression, which is highly robust but relatively imprecise. To improve its performance, we also propose data-adaptive and one-step trimmed estimators. We derive the robust and asymptotic properties of all proposed estimators and show that the one-step estimators (e.g., one-step SCLS) are as robust as GTE and are asymptotically equivalent to the original estimator (e.g., SCLS). The finite-sample properties of existing and proposed estimators are studied by means of Monte Carlo simulations.     

Calibration Estimation in Survey Sampling

Calibration estimation, where the sampling weights are adjusted to make certain estimators match known population totals, is commonly used in survey sampling. The generalized regression estimator is an example of a calibration estimator. Given the functional form of the calibration adjustment term, we establish the asymptotic equivalence between the functional-form calibration estimator and an instrumental variable calibration estimator where the instrumental variable is directly determined from the functional form in the calibration equation. Variance estimation based on linearization is discussed and applied to some recently proposed calibration estimators. The results are extended to the estimator that is a solution to the calibrated estimating equation. Results from a limited simulation study are presented.     

Mean square error estimation in multi-stage sampling

Summary: Suppose for a homogeneous linear unbiased function of the sampled first stage unit (fsu)-values taken as an estimator of a survey population total, the sampling variance is expressed as a homogeneous quadratic function of the fsu-values. When the fsu-values are not ascertainable but unbiased estimators for them are separately available through sampling in later stages and substituted into the estimator, Raj (1968) gave a simple variance estimator formula for this multi-stage estimator of the population total. He requires that the variances of the estimated fsu-values in sampling at later stages and their unbiased estimators are available in certain `simple forms'. For the same set-up Rao (1975) derived an alternative variance estimator when the later stage sampling variances have more ‘complex forms’. Here we pursue with Raj's (1968) simple forms to derive a few alternative variance and mean square error estimators when the condition of homogeneity or unbiasedness in the original estimator of the total is relaxed and the variance of the original estimator is not expressed as a quadratic form.  We illustrate a particular three-stage sampling strategy and present a simulation-based numerical exercise showing the relative efficacies of two alternative variance estimators. Received: 19 February 1999     

Nonparametric estimators of the bivariate survival function under random censoring

A large number of proposals for estimating the bivariate survival function under random censoring have been made. In this paper we discuss the most prominent estimators, where prominent is meant in the sense that they are best for practical use; Dabrowska's estimator, the Prentice–Cai estimator, Pruitt's modified EM-estimator, and the reduced data NPMLE of van der Laan. We show how these estimators are computed and present their intuitive background. The asymptotic results are summarized. Furthermore, we give a summary of the practical performance of the estimators under different levels of dependence and censoring based on extensive simulation results. This leads also to a practical advise.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Model averaging based on James–Stein estimators

Existing model averaging methods are generally based on ordinary least squares (OLS) estimators. However, it is well known that the James–Stein (JS) estimator dominates the OLS estimator under quadratic loss, provided that the dimension of coefficient is larger than two. Thus, we focus on model averaging based on JS estimators instead of OLS estimators. We develop a weight choice method and prove its asymptotic optimality. A simulation experiment shows promising results for the proposed model average estimator.     

Variance estimation for unequal probability sampling

In this paper, we discuss the optimality of the variance estimator of the Horvitz-Thompson estimator proposed by Kott (1988) in the class of model-unbiased quadratic estimators. We also propose some improved estimators over Kott's estimator in the class of general quadratic estimators. Received: February 1999     

Mostly harmless simulations? Using Monte Carlo studies for estimator selection

We consider two recent suggestions for how to perform an empirically motivated Monte Carlo study to help select a treatment effect estimator under unconfoundedness. We show theoretically that neither is likely to be informative except under restrictive conditions that are unlikely to be satisfied in many contexts. To test empirical relevance, we also apply the approaches to a real‐world setting where estimator performance is known. Both approaches are worse than random at selecting estimators that minimize absolute bias. They are better when selecting estimators that minimize mean squared error. However, using a simple bootstrap is at least as good and often better. For now, researchers would be best advised to use a range of estimators and compare estimates for robustness.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Jackknife estimators of a relative risk in 2×2 and 2×2×K contingency tables

Several jackknife estimators of a relative risk in a single 2×2 contingency table and of a common relative risk in a 2×2× K contingency table are presented. The estimators are based on the maximum likelihood estimator in a single table and on an estimator proposed by Tarone (1981) for stratified samples, respectively. For the stratified case, a sampling scheme is assumed where the number of observations within each table tends to infinity but the number of tables remains fixed. The asymptotic properties of the above estimators are derived. Especially, we present two general results which under certain regularity conditions yield consistency and asymptotic normality of every jackknife estimator of a bunch of functions of binomial probabilities.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

An application of approximate finite sample results to parameter estimation in a linear errors-in-variables model

In the simple errors-in-variables model the least squares estimator of the slope coefficient is known to be biased towards zero for finite sample size as well as asymptotically. In this paper we suggest a new corrected least squares estimator, where the bias correction is based on approximating the finite sample bias by a lower bound. This estimator is computationally very simple. It is compared with previously proposed corrected least squares estimators, where the correction aims at removing the asymptotic bias or the exact finite sample bias. For each type of corrected least squares estimators we consider the theoretical form, which depends on an unknown parameter, as well as various feasible forms. An analytical comparison of the theoretical estimators is complemented by a Monte Carlo study evaluating the performance of the feasible estimators. The new estimator proposed in this paper proves to be superior with respect to the mean squared error.     

Estimating Mann–Whitney‐type Causal Effects

Mann–Whitney‐type causal effects are generally applicable to outcome variables with a natural ordering, have been recommended for clinical trials because of their clinical relevance and interpretability and are particularly useful in analysing an ordinal composite outcome that combines an original primary outcome with death and possibly treatment discontinuation. In this article, we consider robust and efficient estimation of such causal effects in observational studies and clinical trials. For observational studies, we propose and compare several estimators: regression estimators based on an outcome regression (OR) model or a generalised probabilistic index (GPI) model, an inverse probability weighted estimator based on a propensity score model and two doubly robust (DR), locally efficient estimators. One of the DR estimators involves a propensity score model and an OR model, is consistent and asymptotically normal under the union of the two models and attains the semiparametric information bound when both models are correct. The other DR estimator has the same properties with the OR model replaced by a GPI model. For clinical trials, we extend an existing augmented estimator based on a GPI model and propose a new one based on an OR model. The methods are evaluated and compared in simulation experiments and applied to a clinical trial in cardiology and an observational study in obstetrics.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

Robust estimation of scale of an exponential distribution

We consider the standardized median as an estimator of scale for exponential samples which is most B-robust in the sense of H ampel et al. (1986). This estimator is compared with two other estimators which were proposed to R ousseeuw and C roux (1993) but for a Gaussian model. All three estimators have the same breakdown point, but their bias curves are different. It is shown that under a gross error model the explosion bias curve of the most B-robust estimator performs better than the bias curves of the other estimators. But this estimator is worse than the two estimators proposed by R ousseeuw and C roux (1993) if the implosion bias curve is considered.     

An unexpected property of minimax estimation in the relative squared error approach to linear regression analysis

An unexpected property of the relative squared error approach to linear regression analysis is derived: It is shown that an estimator being minimax among all linear affine estimators is also minimax in the set of all estimators. Two illustrative special cases are mentioned, where a generalized least squares estimator and a general ridge or Kuks-Olman estimator turn out to be minimax.     

Exponential deconvolution: two asymptotically equivalent estimators

Two isotonic estimators for the distribution function in a specific deconvolution model, the exponential deconvolution model, are considered. The first estimator is a least squares projection of a naive estimator for the distribution function on the set of distribution functions. The second estimator is the well known maximum likelihood estimator. The two estimators are shown to be first order asymptotically equivalent at a fixed point.