Sufficiency and unbiased estimation

Summary The aim of this paper is to give criteria of the sufficiency of certain complete -algebras occurring in the theory of unbiased estimation by means of minimal unbiased estimators. The class ofYoung-functions is used to construct a large class of convex loss functions and a theorem ofBahadur based on quadratic loss is generalized to this general class of loss functions.     

Multilinear estimation of skewness and kutosis in linear models

Summary Estimation of the coefficients of skewness and kurtosis in a classical linear model situation is presented as an application of multilinear algebra and standard theory of mean estimation. The resulting estimators have optimality properties among all estimators that are invariant under mean translations, polynomials of degree three (skewness) or four (kurtosis) in the observations, and unbiased.     

Optimal tests and estimators for truncated exponential families

Blackwell-Rao-Lehmann-Scheffe' theory is used to derive the minimum variance unbiased estimators for the functions of scale and truncation parameters as well as the reliability function of the truncated exponential family distribution. Uniformly most powerful unbiased tests of hypotheses are formulated. Finally, a particular model of this family, viz., the truncated exponential model is discussed.     

Some Decompositions of OLSEs and BLUEs Under a Partitioned Linear Model

We consider in this paper a partitioned linear model { y , X ₁ β ₁ + X ₂ β ₂ , σ ² σ } and two corresponding small models { y , X ₁ β ₁ , σ ² σ } and { y , X ₂ β ₂ , σ ² σ } . We derive necessary and sufficient conditions for (i) the ordinary least squares estimator under the full model to be the sum of the ordinary least squares estimators under the two small models; (ii) the best linear unbiased estimator under the full model to be the sum of the best linear unbiased estimators under the two small models; (iii) the best linear unbiased estimator under the full model to be the sum of the ordinary least squares estimators under the two small models. The proofs of the main results in this paper also demonstrate how to use the matrix rank method for characterizing various equalities of estimators under general linear models.     

Imputation methods of missing data for estimating the population mean using simple random sampling with known correlation coefficient

This paper considers three ratio estimators of the population mean using known correlation coefficient between the study and auxiliary variables in simple random sample when some sample observations are missing. The suggested estimators are compared with the estimators of Singh and Horn (Metrika 51:267–276, 2000), Singh and Deo (Stat Pap 44:555–579, 2003) and Kadilar and Cingi (Commun Stat Theory Methods 37:2226–2236, 2008). They are compared with other imputation estimators based on the mean or a ratio. It is found that the suggested estimators are approximately unbiased for the population mean. Also, it turns out that the suggested estimators perform well when compared with the other estimators considered in this study.     

Mean square error estimation in multi-stage sampling

Summary: Suppose for a homogeneous linear unbiased function of the sampled first stage unit (fsu)-values taken as an estimator of a survey population total, the sampling variance is expressed as a homogeneous quadratic function of the fsu-values. When the fsu-values are not ascertainable but unbiased estimators for them are separately available through sampling in later stages and substituted into the estimator, Raj (1968) gave a simple variance estimator formula for this multi-stage estimator of the population total. He requires that the variances of the estimated fsu-values in sampling at later stages and their unbiased estimators are available in certain `simple forms'. For the same set-up Rao (1975) derived an alternative variance estimator when the later stage sampling variances have more ‘complex forms’. Here we pursue with Raj's (1968) simple forms to derive a few alternative variance and mean square error estimators when the condition of homogeneity or unbiasedness in the original estimator of the total is relaxed and the variance of the original estimator is not expressed as a quadratic form.  We illustrate a particular three-stage sampling strategy and present a simulation-based numerical exercise showing the relative efficacies of two alternative variance estimators. Received: 19 February 1999     

Ratio cum product method of estimation

Summary In this paper methods of estimation which may be considered as combination of ratio and product methods have been suggested. The mean square errors of these estimators utilizing two supplementary variables are compared with (i) simple unbiased estimator (p=0), (ii) usual ratio and product methods of estimation (p=1) and (iii) multivariate ratio and multivariate product estimators (p=2), wherep is the number of supplementary variables utilized. Conditions for their efficient use have been obtained for each case. Extension to general case ofp-variables has been briefly discussed. A new criteria for the efficient use of product estimator have been obtained.     

Estimating the Kullback–Liebler risk based on multifold cross‐validation

This paper concerns a class of model selection criteria based on cross‐validation techniques and estimative predictive densities. Both the simple or leave‐one‐out and the multifold or leave‐m‐out cross‐validation procedures are considered. These cross‐validation criteria define suitable estimators for the expected Kullback–Liebler risk, which measures the expected discrepancy between the fitted candidate model and the true one. In particular, we shall investigate the potential bias of these estimators, under alternative asymptotic regimes for m. The results are obtained within the general context of independent, but not necessarily identically distributed, observations and by assuming that the candidate model may not contain the true distribution. An application to the class of normal regression models is also presented, and simulation results are obtained in order to gain some further understanding on the behavior of the estimators.     

On the existence of locally mvu estimators

It is proved that there exists an unbiased estimator for some real parameter of a class of distributions, which has minimal variance for some fixed distribution among all corresponding unbiased estimators, if and. only if the corresponding minimal variances for all related unbiased estimation problems concerning finite subsets of the underlying family of distributions are bounded. As an application it is shown that there does not exist some unbiased estimator for θ^k+c(ε≥0) with minimal variance for θ =0 among all corresponding unbiased estimators on the base of k i.i.d. random variables with a Cauchy-distribution, where θ denotes some location parameter.     

Stratification,midzuno-sen strategy and nonnegative unbiased variance estimation

When the ratio method is appropriate for estimating the population total one is faced with the problem of nonavailability of uniformly nonnegative unbiased variance estimators (nnuve). Here we highlight the twofold role of stratification in that it not only improves the efficiency of the ratio method of estimation but it also enhances the chances of getting uniformly nonnegative unbiased variance estimators.     

Use of minimum risk approach in the estimation of regression models with missing observations

This article considers a linear regression model with some missing observations on the response variable and presents two estimators of regression coefficients employing the approach of minimum risk estimation. Small disturbance asymptotic properties of these estimators along with the traditional unbiased estimator are analyzed and conditions, that are easy to check in practice, for the superiority of one estimator over the other are derived. Received May 2001     

On equalities of estimations of parametric functions under a general linear model and its restricted models

Estimations of parametric functions under a general linear model and its restricted models involve some complicated operations of matrices and their generalized inverses. In the past several years, a powerful tool—the matrix rank method was utilized to manipulate various complicated matrix expressions that involve generalized inverses of matrices. In this paper, we use this method to derive necessary and sufficient conditions for six equalities of the ordinary least-squares estimators and the best linear unbiased estimators of parametric functions to equal under a general linear model and its corresponding restricted model.     

Estimation procedures for a family of density functions representing various life-testing models

A family of density functions is considered which contains several life-testing models as specific cases. Uniformly minimum variance unbiased estimators are obtained for the positive and negative powers of the parameter, moments and reliability function. These general results provide the estimators for the specific models.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

Percentile estimators in location-scale parameter families under absolute loss

Estimators of percentiles of location-scale parameter families are optimized based on median unbiasedness and absolute risk. Median unbiased estimators and minimum absolute risk estimators are shown to exist within a class of equivariant estimators and depend upon medians of two completely specified distributions. This work extends earlier findings to a larger class of equivariant estimators. These estimators are illustrated in the normal and exponential distributions.     

On the performance of the ordinary least squares method under an error component model

Starting from the one-dimensional results by Wang et al (1994) we consider the performance of the ordinary least squares estimator in comparison to the best linear unbiased estimator under an error component model with random effects in units and time. Upper bounds are derived for the first-order approximation to the difference between both estimators and for the spectral norm of the difference between their dispersion matrices.     

The UMVUE ofP(X<Y) based on type-II censored samples from Weinman multivariate exponential distributions

Based on two independent samples from Weinman multivariate exponential distributions with unknown scale parameters, uniformly minimum variance unbiased estimators ofP(X<Y) are obtained for both, unknown and known common location parameter. The samples are permitted to be Type-II censored with possibly different numbers of observations. Since sampling from two-parameter exponential distributions is contained in the model as a particular case, known results for complete and censored samples are generalized. In the case of an unknown common location parameter with a certain restriction of the model, the UMVUE is shown to have a Gauss hypergeometric distribution, which is further examined. Moreover, explicit expressions for the variances of the estimators are derived and used to calculate the relative efficiency.     

Small sample corrections for LTS and MCD

The least trimmed squares estimator and the minimum covariance determinant estimator [6] are frequently used robust estimators of regression and of location and scatter. Consistency factors can be computed for both methods to make the estimators consistent at the normal model. However, for small data sets these factors do not make the estimator unbiased. Based on simulation studies we therefore construct formulas which allow us to compute small sample correction factors for all sample sizes and dimensions without having to carry out any new simulations. We give some examples to illustrate the effect of the correction factor.     

Panel cointegration with global stochastic trends

This paper studies estimation of panel cointegration models with cross-sectional dependence generated by unobserved global stochastic trends. The standard least squares estimator is, in general, inconsistent owing to the spuriousness induced by the unobservable I(1) trends. We propose two iterative procedures that jointly estimate the slope parameters and the stochastic trends. The resulting estimators are referred to respectively as CupBC (continuously-updated and bias-corrected) and the CupFM (continuously-updated and fully-modified) estimators. We establish their consistency and derive their limiting distributions. Both are asymptotically unbiased and (mixed) normal and permit inference to be conducted using standard test statistics. The estimators are also valid when there are mixed stationary and non-stationary factors, as well as when the factors are all stationary.