Efficiency comparisons between two estimators based on matrix determinant Kantorovich-type inequalities

We first establish two matrix determinant Kantorovich-type inequalities. Then, based on these two and other inequalities, we introduce new efficiency criteria and present their upper bounds to make efficiency comparisons between the ordinary least squares estimator and the best linear unbiased estimator in the general linear model. We provide numerical examples to examine the upper bounds of some new and old efficiency criteria. Received: June 1999     

On the performance of the ordinary least squares method under an error component model

Starting from the one-dimensional results by Wang et al (1994) we consider the performance of the ordinary least squares estimator in comparison to the best linear unbiased estimator under an error component model with random effects in units and time. Upper bounds are derived for the first-order approximation to the difference between both estimators and for the spectral norm of the difference between their dispersion matrices.     

On Limits of Uniquely Best Linear Estimators

In a general linear model, it is shown that all admissible linear estimators are limits of linear estimators that are uniquely best at some point in an extended parameter set. The principal result shows that a linear estimator that is uniquely best at a pointW ₂ among multiple linear estimators that are best at a pointW ₁ is the limit of uniquely best estimators at points approachingW ₁ along the line joiningW ₁ andW ₂. Research supported in part by U.S.A.F. Aerospace Research Laboratories under contract F33615-71-C-1463, summer 1973, and in part by Grant DMS-9104811 from the National Science Foundation.     

Estimating a restricted normal mean

Let X ₁, X ₂, ..., X _n be a random sample from a normal distribution with unknown mean μ and known variance σ ². In many practical situations, μ is known a priori to be restricted to a bounded interval, say [−m, m] for some m > 0. The sample mean , then, becomes an inadmissible estimator for μ. It is also not minimax with respect to the squared error loss function. Minimax and other estimators for this problem have been studied by Casella and Strawderman (Ann Stat 9:870–878, 1981), Bickel (Ann Stat 9:1301–1309, 1981) and Gatsonis et al. (Stat Prob Lett 6:21–30, 1987) etc. In this paper, we obtain some new estimators for μ. The case when the variance σ ² is unknown is also studied and various estimators for μ are proposed. Risk performance of all estimators is numerically compared for both the cases when σ ² may be known and unknown.     

Simultaneous estimation of hazard rates of several exponential populations

Suppose independent random samples are drawn from k (2) populations with a common location parameter and unequal scale parameters. We consider the problem of estimating simultaneously the hazard rates of these populations. The analogues of the maximum likelihood (ML), uniformly minimum variance unbiased (UMVU) and the best scale equivariant (BSE) estimators for the one population case are improved using Rao‐Blackwellization. The improved version of the BSE estimator is shown to be the best among these estimators. Finally, a class of estimators that dominates this improved estimator is obtained using the differential inequality approach.     

Estimation and forecasting in vector autoregressive moving average models for rich datasets

We address the issue of modelling and forecasting macroeconomic variables using rich datasets by adopting the class of Vector Autoregressive Moving Average (VARMA) models. We overcome the estimation issue that arises with this class of models by implementing an iterative ordinary least squares (IOLS) estimator. We establish the consistency and asymptotic distribution of the estimator for weak and strong VARMA(p,q) models. Monte Carlo results show that IOLS is consistent and feasible for large systems, outperforming the MLE and other linear regression based efficient estimators under alternative scenarios. Our empirical application shows that VARMA models are feasible alternatives when forecasting with many predictors. We show that VARMA models outperform the AR(1), ARMA(1,1), Bayesian VAR, and factor models, considering different model dimensions.     

Heteroskedasticity-consistent covariance matrix estimators for spatial autoregressive models

In the presence of heteroskedasticity, conventional test statistics based on the ordinary least squares (OLS) estimator lead to incorrect inference results for the linear regression model. Given that heteroskedasticity is common in cross-sectional data, the test statistics based on various forms of heteroskedasticity-consistent covariance matrices (HCCMs) have been developed in the literature. In contrast to the standard linear regression model, heteroskedasticity is a more serious problem for spatial econometric models, generally causing inconsistent extremum estimators of model coefficients. This paper investigates the finite sample properties of the heteroskedasticity-robust generalized method of moments estimator (RGMME) for a spatial econometric model with an unknown form of heteroskedasticity. In particular, it develops various HCCM-type corrections to improve the finite sample properties of the RGMME and the conventional Wald test. The Monte Carlo results indicate that the HCCM-type corrections can produce more accurate results for inference on model parameters and the impact effects estimates in small samples.     

Statistical inference on restricted partial linear regression models with partial distortion measurement errors

We consider the estimation and hypothesis testing problems for the partial linear regression models when some variables are distorted with errors by some unknown functions of commonly observable confounding variable. The proposed estimation procedure is designed to accommodate undistorted as well as distorted variables. To test a hypothesis on the parametric components, a restricted least squares estimator is proposed under the null hypothesis. Asymptotic properties for the estimators are established. A test statistic based on the difference between the residual sums of squares under the null and alternative hypotheses is proposed, and we also obtain the asymptotic properties of the test statistic. A wild bootstrap procedure is proposed to calculate critical values. Simulation studies are conducted to demonstrate the performance of the proposed procedure, and a real example is analyzed for an illustration.     

Estimation and optimal designs for linear Haar-wavelet models

This paper gives an analytical expression for the best linear unbiased estimator (BLUE) of the unknown parameters in the linear Haar-wavelet model. From the analytical expression, we solve for the eigenvalues of the covariance matrix of the BLUE in analytical form. Further, we use these eigenvalues to construct some conventional discrete optimal designs for the model. The equivalences among these optimal designs are demonstrated and some examples are also given.      

Estimation in monotone single‐index models

Single‐index models are popular regression models that are more flexible than linear models and still maintain more structure than purely nonparametric models. We consider the problem of estimating the regression parameters under a monotonicity constraint on the unknown link function. In contrast to the standard approach of using smoothing techniques, we review different “non‐smooth” estimators that avoid the difficult smoothing parameter selection. For about 30 years, one has had the conjecture that the profile least squares estimator is an ‐consistent estimator of the regression parameter, but the only non‐smooth argmin/argmax estimators that are actually known to achieve this ‐rate are not based on the nonparametric least squares estimator of the link function. However, solving a score equation corresponding to the least squares approach results in ‐consistent estimators. We illustrate the good behavior of the score approach via simulations. The connection with the binary choice and current status linear regression models is also discussed.     

Application of one‐step method to parameter estimation in ODE models

In this paper, we study application of Le Cam's one‐step method to parameter estimation in ordinary differential equation models. This computationally simple technique can serve as an alternative to numerical evaluation of the popular non‐linear least squares estimator, which typically requires the use of a multistep iterative algorithm and repetitive numerical integration of the ordinary differential equation system. The one‐step method starts from a preliminary ‐consistent estimator of the parameter of interest and next turns it into an asymptotic (as the sample size n →∞ ) equivalent of the least squares estimator through a numerically straightforward procedure. We demonstrate performance of the one‐step estimator via extensive simulations and real data examples. The method enables the researcher to obtain both point and interval estimates. The preliminary ‐consistent estimator that we use depends on non‐parametric smoothing, and we provide a data‐driven methodology for choosing its tuning parameter and support it by theory. An easy implementation scheme of the one‐step method for practical use is pointed out.     

On equalities of estimations of parametric functions under a general linear model and its restricted models

Estimations of parametric functions under a general linear model and its restricted models involve some complicated operations of matrices and their generalized inverses. In the past several years, a powerful tool—the matrix rank method was utilized to manipulate various complicated matrix expressions that involve generalized inverses of matrices. In this paper, we use this method to derive necessary and sufficient conditions for six equalities of the ordinary least-squares estimators and the best linear unbiased estimators of parametric functions to equal under a general linear model and its corresponding restricted model.     

Randomized response: Estimating mean square errors of linear estimators and finding optimal unbiased strategies

Summary General procedures are described to generate quantitative randomized response (RR) required to estimate the finite population total of a sensitive variable. Permitting sample selection with arbitrary probabilities a formula for the mean square error (MSE) of a linear estimator of total based on RR is noted indicating the simple modification over one that might be based on direct response (DR) if the latter were available. A general formula for an unbiased estimator of the MSE is presented. A simple approximation is proposed in case the RR ratio estimator is employed based on a simple random sample (SRS) taken without replacement (WOR). Among sampling strategies employing unbiased but not necessarily linear estimators based on RR, certain optimal ones are identified under two alternative models analogously to well-known counterparts based on DR, if available. Unlike Warner’s (1965) treatment of categorical RR we consider quantitative RR here.     

Zur Parameter- und Prozentpunktschätzung von Lebensdauerverteilungen bei kleinem Stichprobenumfang

Summary Some of the many methods developed for estimating parameters or percentage points of the Weibull distribution are compared. It is shown that the known estimation of the reciprocal shape parameter with the aid of a straight line in the extremal probability paper is rather biased for small sample sizes. To avoid the bias, correction factors are given, and the efficiency of the resulting unbiased estimator is calculated for sample sizesn=2, 3, …, 9. Results ofJ. Lieblein concerning the double exponential distribution are slightly modified in order to get best linear unbiased estimators for parameters and for the logarithms of percentage points of the Weibull distribution. Other methods are shortly discussed and a median-unbiased estimator for the shape parameter is derived.      

On the estimation ofPr{Y<X} for the two-parameter exponential distribution

In this paper the Blackwell-Rao and Lehmann-Scheffé theorems are used to derive the minimum variance unbiased estimator ofP=Pr{Y when the independent random variablesX andY follow the two-parameter exponential distribution. Following a Bayesian approach, an estimator ofP is also obtained for this distribution. These results are extended for the case of censored samples.