Bayes Convolution

A general convolution theorem within a Bayesian framework is presented. Consider estimation of the Euclidean parameter θ by an estimator T within a parametric model. Let W be a prior distribution for θ and define G as the W -average of the distribution of T - θ under θ . In some cases, for any estimator T the distribution G can be written as a convolution G = K * L with K a distribution depending only on the model, i.e. on W and the distributions under θ of the observations. In such a Bayes convolution result optimal estimators exist, satisfying G = K . For location models we show that finite sample Bayes convolution results hold in the normal, loggamma and exponential case. Under regularity conditions we prove that normal and loggamma are the only smooth location cases. We also discuss relations with classical convolution theorems.     

Bias in estimation from type I censored samples

Summary
Let be a family of probability distributions on R¹. This paper raises the question whether a parameter θ=θ (P), Pt, is estimable on the basis of a type I censored sample (i.e. censored on a fixed set C). Two theorems are given that state conditions on θ and C that ensure that θ is not estimable. The results are applied to estimation problems for the normal and POISSON distributions; it turns out that unbiased estimation is impossible in the majority of practical cases.     

Estimation of spatial autoregressive panel data models with fixed effects

This paper establishes asymptotic properties of quasi-maximum likelihood estimators for SAR panel data models with fixed effects and SAR disturbances. A direct approach is to estimate all the parameters including the fixed effects. Because of the incidental parameter problem, some parameter estimators may be inconsistent or their distributions are not properly centered. We propose an alternative estimation method based on transformation which yields consistent estimators with properly centered distributions. For the model with individual effects only, the direct approach does not yield a consistent estimator of the variance parameter unless T is large, but the estimators for other common parameters are the same as those of the transformation approach. We also consider the estimation of the model with both individual and time effects.     

Simultaneous estimation of hazard rates of several exponential populations

Suppose independent random samples are drawn from k (2) populations with a common location parameter and unequal scale parameters. We consider the problem of estimating simultaneously the hazard rates of these populations. The analogues of the maximum likelihood (ML), uniformly minimum variance unbiased (UMVU) and the best scale equivariant (BSE) estimators for the one population case are improved using Rao‐Blackwellization. The improved version of the BSE estimator is shown to be the best among these estimators. Finally, a class of estimators that dominates this improved estimator is obtained using the differential inequality approach.     

Mean square error estimation in multi-stage sampling

Summary: Suppose for a homogeneous linear unbiased function of the sampled first stage unit (fsu)-values taken as an estimator of a survey population total, the sampling variance is expressed as a homogeneous quadratic function of the fsu-values. When the fsu-values are not ascertainable but unbiased estimators for them are separately available through sampling in later stages and substituted into the estimator, Raj (1968) gave a simple variance estimator formula for this multi-stage estimator of the population total. He requires that the variances of the estimated fsu-values in sampling at later stages and their unbiased estimators are available in certain `simple forms'. For the same set-up Rao (1975) derived an alternative variance estimator when the later stage sampling variances have more ‘complex forms’. Here we pursue with Raj's (1968) simple forms to derive a few alternative variance and mean square error estimators when the condition of homogeneity or unbiasedness in the original estimator of the total is relaxed and the variance of the original estimator is not expressed as a quadratic form.  We illustrate a particular three-stage sampling strategy and present a simulation-based numerical exercise showing the relative efficacies of two alternative variance estimators. Received: 19 February 1999     

Likelihood estimation and inference in threshold regression

This paper studies likelihood-based estimation and inference in parametric discontinuous threshold regression models with i.i.d. data. The setup allows heteroskedasticity and threshold effects in both mean and variance. By interpreting the threshold point as a “middle” boundary of the threshold variable, we find that the Bayes estimator is asymptotically efficient among all estimators in the locally asymptotically minimax sense. In particular, the Bayes estimator of the threshold point is asymptotically strictly more efficient than the left-endpoint maximum likelihood estimator and the newly proposed middle-point maximum likelihood estimator. Algorithms are developed to calculate asymptotic distributions and risk for the estimators of the threshold point. The posterior interval is proved to be an asymptotically valid confidence interval and is attractive in both length and coverage in finite samples.     

Design and estimation problems when estimating a regression coefficient from survey data

Summary The values of a variablex are assumed known for all elements in a finite population. Between this variable and another variableY, whose values are registered in a sample survey, there is the usual linear regression relationship. This paper considers problems of design and of estimation of the regression coefficienta and the interceptb. The followingGodambe type theorem is proved: There exists no minimum variance unbiased linear estimator ofa andb. We also derive that the usual estimators ofa andb have minimum variance if attention is restricted to the class of linear estimators unbiased in any given sample.     

On the admissibility of estimators for the finite population variance

Summary With each unti of a finite population is associated an unknown variate value. We are interested in the variance of these values and consider (1) simple random sampling without replacement. (2) quadratic loss and (3) a one parameter class of estimators. We determine all admissible elements of the class. The usual unbiased estimator for the variance which is an element of the class considered turns out to be inadmissible.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

Shortest confidence intervals and UMVU estimators for families of distributions involving truncation parameters

Summary In this paper, using the pivotal quantity method, new shortest-length confidence intervals and uniformly minimum variance unbiased (UMVU) estimators are constructed, where two independent random samples are available from families of distributions involving truncation parameters. Also, in the case of one sample, we give, for some uniform distributions, confidence intervals which are the shortest among all known confidence intervals.     

Shrinkage estimation of <Emphasis Type="Italic">P</Emphasis>(<Emphasis Type="Italic">X</Emphasis><<Emphasis Type="Italic">Y</Emphasis>) in the exponential case with common location parameter

We consider the problem of estimating R=P(X<Y) where X and Y have independent exponential distributions with parameters and respectively and a common location parameter . Assuming that there is a prior guess or estimate R₀, we develop various shrinkage estimators of R that incorporate this prior information. The performance of the new estimators is investigated and compared with the maximum likelihood estimator using Monte Carlo methods. It is found that some of these estimators are very successful in taking advantage of the prior estimate available.Acknowledgments. The authors are grateful to the editor and to the referees for their constructive comments that resulted in a substantial improvement of the paper.     

Shrinkage estimation for the mean of the inverse Gaussian population

We consider improved estimation strategies for a two-parameter inverse Gaussian distribution and use a shrinkage technique for the estimation of the mean parameter. In this context, two new shrinkage estimators are suggested and demonstrated to dominate the classical estimator under the quadratic risk with realistic conditions. Furthermore, based on our shrinkage strategy, a new estimator is proposed for the common mean of several inverse Gaussian distributions, which uniformly dominates the Graybill–Deal type unbiased estimator. The performance of the suggested estimators is examined by using simulated data and our shrinkage strategies are shown to work well. The estimation methods and results are illustrated by two empirical examples.     

Admissibility of generalized Bayes estimators in an one parameter nonregular family

Consider an estimation problem under squared error loss in an one parameter nonregular family of distributions with the lower endpoint of the support depending on an unknown parameter. Using Karlin's ([3]) method, sufficient conditions are given for generalized Bayes estimators to be admissible for estimating an arbitrary nonnegative, differentiable, monotone parametric function. The results are then applied to the case when both endpoints of the support of the distribution depend on the parameter . Finally, some examples are subsequently given.Research supported by a grant from Hanyang University, 1989.     

Christofides’ randomized response technique in complex sample surveys

Christofides (2003) has given an improved modification of Warners (1965) pioneering randomized response (RR) technique in estimating an unknown proportion of people bearing a sensitive characteristic in a given community. As both these RR devices are shown to yield unbiased estimators based only on simple random sampling (SRS) with replacement (WR) but in practice samples are mostly taken with unequal selection probabilities without replacement (WOR), here we present methods of estimation when Christofides RR data are available from unequal probability samples. Warners (1965) RR device was earlier shown by Chaudhuri (2001) to be applicable in complex surveys. For completeness we present estimators for the variance of our estimator and also describe what to do if some people opt to divulge truths.This research is partially supported by CSIR grant No. 21(0539)/02/EMR-II     

The UMVUE ofP(X<Y) based on type-II censored samples from Weinman multivariate exponential distributions

Based on two independent samples from Weinman multivariate exponential distributions with unknown scale parameters, uniformly minimum variance unbiased estimators ofP(X<Y) are obtained for both, unknown and known common location parameter. The samples are permitted to be Type-II censored with possibly different numbers of observations. Since sampling from two-parameter exponential distributions is contained in the model as a particular case, known results for complete and censored samples are generalized. In the case of an unknown common location parameter with a certain restriction of the model, the UMVUE is shown to have a Gauss hypergeometric distribution, which is further examined. Moreover, explicit expressions for the variances of the estimators are derived and used to calculate the relative efficiency.     

Estimators for particulate sampling derived from a multinomial distribution

Counting the number of units is not always practical during the sampling of particulate materials: it is often much easier to sample a fixed volume or fixed mass of particles. Hence, a class of sampling designs is proposed which leads to samples that have approximately a constant mass or a constant volume. For these sampling designs, estimators were derived which are a ratio of arbitrary sample totals. A Taylor expansion was used to obtain a first-order approximation for the expected value and variance in the limit of a large batch-to-sample size ratio. Furthermore, a π -estimator for a ratio of batch totals was found by deriving expressions for the first- and second-order inclusion probabilities. Practical application of the π -estimator is limited because it requires inaccessible batch information. However, when the denominator of the estimated batch ratio is the batch size, the π -estimator becomes equal to a sample total divided by the sample size in the limit of a large sample-to-particle size ratio. As a consequence, the obtained sample ratio becomes an unbiased estimator for the corresponding batch ratio. Retaining unbiasedness, the Horvitz–Thompson estimator for the variance, which also contains inaccessible batch information, is replaced by an estimator containing sample information only. Practical application of this estimator is illustrated for the sampling of slag, produced during the production of steel.     

Estimation from two-stage unequal probability sampling with missing units

A formula is presented for an unbiased estimator for the variance of an unbiased estimator of a survey population total as well as for an unbiased estimator of its variance based on sampling in two-stages following Rao et al. J Roy Stat Soc B 24: 482–491 (1962) scheme in both stages when the originally selected units in both stages cannot be fully covered in the survey but are to be randomly sub-sampled. The development is helpful to tackle non-responses if assumed to have occurred at random in either or both the stages     

Simultaneous optimal estimation in linear mixed models

Simultaneous optimal estimation in linear mixed models is considered. A necessary and sufficient condition is presented for the least squares estimator of the fixed effects and the analysis of variance estimator of the variance components to be of uniformly minimum variance simultaneously in a general variance components model. That is, the matrix obtained by orthogonally projecting the covariance matrix onto the orthogonal complement space of the column space of the design matrix is symmetric, each eigenvalue of the matrix is a linear combinations of the variance components and the number of all distinct eigenvalues of the matrix is equal to the the number of the variance components. Under this condition, uniformly optimal unbiased tests and uniformly most accurate unbiased confidence intervals are constructed for the parameters of interest. A necessary and sufficient condition is also given for the equivalence of several common estimators of variance components. Two examples of their application are given.     

Some Decompositions of OLSEs and BLUEs Under a Partitioned Linear Model

We consider in this paper a partitioned linear model { y , X ₁ β ₁ + X ₂ β ₂ , σ ² σ } and two corresponding small models { y , X ₁ β ₁ , σ ² σ } and { y , X ₂ β ₂ , σ ² σ } . We derive necessary and sufficient conditions for (i) the ordinary least squares estimator under the full model to be the sum of the ordinary least squares estimators under the two small models; (ii) the best linear unbiased estimator under the full model to be the sum of the best linear unbiased estimators under the two small models; (iii) the best linear unbiased estimator under the full model to be the sum of the ordinary least squares estimators under the two small models. The proofs of the main results in this paper also demonstrate how to use the matrix rank method for characterizing various equalities of estimators under general linear models.     

Estimation of quantities determined as implicit functions of unknown parameters

Consider a family of distribution functions ${\{F(x, \theta),\,\theta \in \Theta\}}Consider a family of distribution functions {F(x, q), q ? Q}{\{F(x, \theta),\,\theta \in \Theta\}} . Suppose that there exists an estimator of the unknown parameter vector θ based on given data set. Then it is readily to obtain an estimator of any quantity given as an explicit function g(θ). Particularly, it is the case when the maximum likelihood estimator of θ is available. However, often some quantities of interest can not be expressed as an explicit function, rather it is determined as an implicit function of θ. The present article studies this problem. Sufficient conditions are given for deriving estimators of these quantities. The results are then applied to estimate change point of failure rate function, and change point of mean residual life function.