The density of the parameter estimators when the observations are distributed exponentially

We present the probability density of parameter estimators whenN independent variables are observed, each of them distributed according to the exponential low (with some parameters to be estimated). The numberN is supposed to be small. Typically, such an experimental situation arises in problems of software reliability, another case is a small sample in the GLIM modeling. The considered estimator is defined by the maximum of the posterior probability density; it is equal to the maximum likelihood estimator when the prior is uniform. The exact density is obtained, and its approximation is discussed in accordance with some information-geometric considerations. The main body of the paper has been prepared during the author’s visit in LMC/IMAG Grenoble, France, on the invitation of Université Joseph Fourier in January 1994.     

Estimation of multiple poisson means: A compromise between maximum likelihood and empirical bayes estimators

For estimatingp(⩾ 2) independent Poisson means, the paper considers a compromise between maximum likelihood and empirical Bayes estimators. Such compromise estimators enjoy both good componentwise as well as ensemble properties. Research supported by the NSF Grant Number MCS-8218091.     

Smooth estimators for estimating order restricted scale parameters of two gamma distributions

We consider the problem of component-wise estimation of ordered scale parameters of two gamma populations, when it is known apriori which population corresponds to each ordered parameter. Under the scale equivariant squared error loss function, smooth estimators that improve upon the best scale equivariant estimators are derived. These smooth estimators are shown to be generalized Bayes with respect to a non-informative prior. Finally, using Monte Carlo simulations, these improved smooth estimators are compared with the best scale equivariant estimators, their non-smooth improvements obtained in Vijayasree, Misra & Singh (1995), and the restricted maximum likelihood estimators. Acknowledgments. Authors are thankful to a referee for suggestions leading to improved presentation.     

Decision theoretic estimation using record statistics

We consider the problem of estimating the scale parameter θ of the shifted exponential distribution with unknown shift based on a set of observed records drawn from a sequential sample of independent and identically distributed random variables. Under a large class of bowl-shaped loss functions, the best affine equivariant estimator (BAEE) of θ is shown to be inadmissible. Two dominating procedures are proposed. A numerical study is performed to show the extent of risk reduction that the improved estimators provide over the BAEE.     

On maximum likelihood prediction based on Type II doubly censored exponential data

In this paper, the maximum likelihood predictor (MLP) of the kth ordered observation, t _k, in a sample of size n from a two-parameter exponential distribution as well as the predictive maximum likelihood estimators (PMLE's) of the location and scale parameters, θ and β, based on the observed values t _r, …, t _s (1≤r≤s<k≤n), are obtained in closed forms, contrary to the belief they cannot be so expressed. When θ is known, however, the PMLE of β and MLP of t _k do not admit explicit expressions. It is shown here that they exist and are unique; sharp lower and upper bounds are also provided. The derived predictors and estimators are reasonable and also have good asymptotic properties. As applications, the total duration time in a life test and the failure time of a k-out-of-n system may be predicted. Finally, an illustrative example is included. Received: August 1999     

Bayesian estimation and prediction based on Rayleigh sample quantiles

Ordered data arise naturally in many fields of statistical practice. Often some sample values are unknown or disregarded due to various reasons. On the basis of some sample quantiles from the Rayleigh distribution, the problems of estimating the Rayleigh parameter, hazard rate and reliability function, and predicting future observations are addressed using a Bayesian perspective. The construction of β-content and β-expectation Bayes tolerance limits is also tackled. Under squared-error loss, Bayes estimators and predictors are deduced analytically. Exact tolerance limits are derived by solving simple nonlinear equations. Highest posterior density estimators and credibility intervals, as well as Bayes estimators and predictors under linear loss, can easily be computed iteratively.     

Gamma-admissibility of estimators in the one-parameter exponential family

Summary Admissibility of estimators under vague prior information on the distribution of the unknown parameter is studied which leads to the notion of gamma-admissibility. A sufficient condition for an estimator of the formδ(x)=(ax+b)/(cx+d) to be gamma-admissible in the one-parameter exponential family under squared error loss is established. As an application of this result two equalizer rules are shown to be unique gamma-minimax estimators by proving their gamma-admissibility.     

Iterative Density Estimation from Contaminated Observations

We introduce an iterative procedure for estimating the unknown density of a random variable X from n independent copies of Y=X+ɛ, where ɛ is normally distributed measurement error independent of X. Mean integrated squared error convergence rates are studied over function classes arising from Fourier conditions. Minimax rates are derived for these classes. It is found that the sequence of estimators defined by the iterative procedure attains the optimal rates. In addition, it is shown that the sequence of estimators converges exponentially fast to an estimator within the class of deconvoluting kernel density estimators. The iterative scheme shows how, in practice, density estimation from indirect observations may be performed by simply correcting an appropriate ordinary density estimator. This allows to assess the effect that the perturbation due to contamination by ɛ has on the density to be estimated. We also suggest a method to select the smoothing parameter required by the iterative approach and, utilizing this method, perform a simulation study.     

On selecting the best ofk lognormal distributions

Summary Fork lognormal populations, which differ only in one certain parameter Ϙ, the problem of finding the population with the largest value ofϑ is considered. For two-parameter lognormal families, several natural choices ofϑ are treated, where the problem can be solved, through logarithmic transformation of the observations, within the framework of estimating parameters ink, possibly restricted, normal populations. For three-parameter lognormal families, this standard approach of selecting in terms of natural estimators fails to work ifϑ is the “guaranteed lifetime”. For this case, a selection procedure is derived which is based on anL-statistic which has the smallest asymptotic variance. Of importance here is that it is location equivariant, whereas it does not matter what it actually estimates. Comparisons are made with other suitable selection rules, through the asymptotic relative efficiencies, as well as in an example of intermediate sample sizes. It is shown that only in the latter, the selection rule, which is based on the sample minima, compares favorably. The research of this author was supported by the Office of Naval Research Contract N00014-88-K-0170 and NSF Grant Number DMS-8606964 at Purdue University. Reproduction in whole or in part is permitted for any purpose of the United States Government. The research of this author was supported by the Air Force Office of Scientific Research Grant 85-0347 at the University of Illinois at Chicago.     

On the existence of locally mvu estimators

It is proved that there exists an unbiased estimator for some real parameter of a class of distributions, which has minimal variance for some fixed distribution among all corresponding unbiased estimators, if and. only if the corresponding minimal variances for all related unbiased estimation problems concerning finite subsets of the underlying family of distributions are bounded. As an application it is shown that there does not exist some unbiased estimator for θ^k+c(ε≥0) with minimal variance for θ =0 among all corresponding unbiased estimators on the base of k i.i.d. random variables with a Cauchy-distribution, where θ denotes some location parameter.     

Asymptotic expansion of the minimax value in survey sampling

Summary Suppose that a real numbery _u is associated with each unitu of a populationU and that the functiony:u →y _u onU is known to be an element of the parameter space Θ. The statistician has to select a samples ⊂U ofn units and to employy _u;u ∈s to estimate the arithmetic mean of ally _u,u ∈U. The performance of such a strategy is assessed by its mean square error or, more simply, by the supremum of the mean square error. This supremum cannot be determined exactly for the parameter space of Scott/Smith (1975). We propose, therefore, an asymptotic approximation; this approximation is based on the assumption, that the sample sizen is fixed and that linear estimators have to be used.     

Preliminary test ridge regression estimators with student’s <Emphasis Type="Italic">t</Emphasis> errors and conflicting test-statistics

The preliminary test ridge regression estimators (PTRRE) based on the Wald (W), Likelihood Ratio (LR) and Lagrangian Multiplier (LM) tests for estimating the regression parameters has been considered in this paper. Here we consider the multiple regression model with student t error distribution. The bias and the mean square errors (MSE) of the proposed estimators are derived under both null and alternative hypothesis. By studying the MSE criterion, the regions of optimality of the estimators are determined. Under the null hypothesis, the PTRRE based on LM test has the smallest risk followed by the estimators based on LR and W tests. However, the PTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimators for both shrinkage parameter, k and the departure parameter, are provided. Some tables for the maximum and minimum guaranteed efficiency of the proposed estimators have been given, which allows us to determine the optimum level of significance corresponding to the optimum estimator. Finally, we conclude that the estimator based on Wald test dominates the other two estimators in the sense of having highest minimum guaranteed efficiency.     

Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators

Subsampling and the m out of n bootstrap have been suggested in the literature as methods for carrying out inference based on post-model selection estimators and shrinkage estimators. In this paper we consider a subsampling confidence interval (CI) that is based on an estimator that can be viewed either as a post-model selection estimator that employs a consistent model selection procedure or as a super-efficient estimator. We show that the subsampling CI (of nominal level 1−α for any α(0,1)) has asymptotic confidence size (defined to be the limit of finite-sample size) equal to zero in a very simple regular model. The same result holds for the m out of n bootstrap provided m²/n→0 and the observations are i.i.d. Similar zero-asymptotic-confidence-size results hold in more complicated models that are covered by the general results given in the paper and for super-efficient and shrinkage estimators that are not post-model selection estimators. Based on these results, subsampling and the m out of n bootstrap are not recommended for obtaining inference based on post-consistent model selection or shrinkage estimators.     

Estimation of the scale matrix of a multivariate t-model under entropy loss

This paper deals with the estimation of the scale matrix of a multivariatet-model with unknown location vector and scale matrix to improve upon the usual estimators based on the sample sum of product matrix. The well-known results of the estimation of the scale matrix of the multivariate normal model under the assumption of entropy loss function have been generalized to that of a multivariatet-model. The paper is based on the first author’s unpublished Ph.D. dissertation ‘Estimation of the Scale Matrix of a Multivariate T-model’, University of Western Ontario, Canada. Present address: School of Mathematics and Statistics, The University of Sydney, NSW 2006, Australia.     

Natural estimation of variances in a general finite discrete spectrum linear regression model

The method of “natural” estimation of variances in a general (orthogonal or nonorthogonal) finite discrete spectrum linear regression model of time series is suggested. Using geometrical language of the theory of projectors a form and properties of the estimators are investigated. Obtained results show that in describing the first and second moment properties of the new estimators the central role plays a matrix known in linear algebra as the Schur complement. Illustrative examples with particular regressors demonstrate direct applications of the results.     

Estimating a restricted normal mean

Let X ₁, X ₂, ..., X _n be a random sample from a normal distribution with unknown mean μ and known variance σ ². In many practical situations, μ is known a priori to be restricted to a bounded interval, say [−m, m] for some m > 0. The sample mean , then, becomes an inadmissible estimator for μ. It is also not minimax with respect to the squared error loss function. Minimax and other estimators for this problem have been studied by Casella and Strawderman (Ann Stat 9:870–878, 1981), Bickel (Ann Stat 9:1301–1309, 1981) and Gatsonis et al. (Stat Prob Lett 6:21–30, 1987) etc. In this paper, we obtain some new estimators for μ. The case when the variance σ ² is unknown is also studied and various estimators for μ are proposed. Risk performance of all estimators is numerically compared for both the cases when σ ² may be known and unknown.     

Nonparametric maximum likelihood estimation in a non locally compact setting

Maximum likelihood estimation is considered in the context of infinite dimensional parameter spaces. It is shown that in some locally convex parameter spaces sequential compactness of the bounded sets ensures the existence of minimizers of objective functions and the consistency of maximum likelihood estimators in an appropriate topology. The theory is applied to revisit some classical problems of nonparametric maximum likelihood estimation, to study location parameters in Banach spaces, and finally to obtain Varadarajan’s theorem on the convergence of empirical measures in the form of a consistency result for a sequence of maximum likelihood estimators. Several parameter spaces sharing the crucial compactness property are identified. This research was supported by grants from the National Sciences and Engineering Research Council of Canada and the Fonds FCAR de la Province de Québec.     

THE BIVARIATE EXPONENTIAL DISTRIBUTION; A REVIEW AND SOME NEW RESULTS

Various models have been proposed as bivariate forms of the exponential distribution. A brief but comprehensive review is presented which classifies, interrelates and contrasts the different models and outlines what is known about distributional properties, applicability and estimation and testing of parameters (particularly the association parameter). Some new results are presented for one particular model. Maximum likelihood, and moment–type, estimators of the association parameter are examined. Asymptotic variances are derived and attention is given to the relative efficiency of the estimators and to problems of their evaluation.     

Moment consistency of estimators in partially linear models under NA samples

Consider the heteroscedastic regression model Y ^(j)(x _in , t _in ) = t _in β + g(x _in ) + σ _in e ^(j)(x _in ), 1 ≤ j ≤ m, 1 ≤ i ≤ n, where s_in²=f(u_in){\sigma_{in}^{2}=f(u_{in})}, (x _in , t _in , u _in ) are fixed design points, β is an unknown parameter, g(·) and f(·) are unknown functions, and the errors {e ^(j)(x _in )} are mean zero NA random variables. The moment consistency for least-squares estimators and weighted least-squares estimators of β is studied. In addition, the moment consistency for estimators of g(·) and f(·) is investigated.