Estimating a restricted normal mean

Let X ₁, X ₂, ..., X _n be a random sample from a normal distribution with unknown mean μ and known variance σ ². In many practical situations, μ is known a priori to be restricted to a bounded interval, say [−m, m] for some m > 0. The sample mean , then, becomes an inadmissible estimator for μ. It is also not minimax with respect to the squared error loss function. Minimax and other estimators for this problem have been studied by Casella and Strawderman (Ann Stat 9:870–878, 1981), Bickel (Ann Stat 9:1301–1309, 1981) and Gatsonis et al. (Stat Prob Lett 6:21–30, 1987) etc. In this paper, we obtain some new estimators for μ. The case when the variance σ ² is unknown is also studied and various estimators for μ are proposed. Risk performance of all estimators is numerically compared for both the cases when σ ² may be known and unknown.     

Shrinkage estimation of the proportion in randomized response

This article considers the asymptotic estimation theory for the proportion in randomized response survey usinguncertain prior information (UPI) about the true proportion parameter which is assumed to be available on the basis of some sort of realistic conjecture. Three estimators, namely, the unrestricted estimator, the shrinkage restricted estimator and an estimator based on a preliminary test, are proposed. Their asymptotic mean squared errors are derived and compared. The relative dominance picture of the estimators is presented.     

Smooth estimators for estimating order restricted scale parameters of two gamma distributions

We consider the problem of component-wise estimation of ordered scale parameters of two gamma populations, when it is known apriori which population corresponds to each ordered parameter. Under the scale equivariant squared error loss function, smooth estimators that improve upon the best scale equivariant estimators are derived. These smooth estimators are shown to be generalized Bayes with respect to a non-informative prior. Finally, using Monte Carlo simulations, these improved smooth estimators are compared with the best scale equivariant estimators, their non-smooth improvements obtained in Vijayasree, Misra & Singh (1995), and the restricted maximum likelihood estimators. Acknowledgments. Authors are thankful to a referee for suggestions leading to improved presentation.     

Residual‐based IV estimation of dynamic panel data models with fixed effects

In dynamic panel regression, when the variance ratio of individual effects to disturbance is large, the system‐GMM estimator will have large asymptotic variance and poor finite sample performance. To deal with this variance ratio problem, we propose a residual‐based instrumental variables (RIV) estimator, which uses the residual from regressing Δy_i,t?1 on as the instrument for the level equation. The RIV estimator proposed is consistent and asymptotically normal under general assumptions. More importantly, its asymptotic variance is almost unaffected by the variance ratio of individual effects to disturbance. Monte Carlo simulations show that the RIV estimator has better finite sample performance compared to alternative estimators. The RIV estimator generates less finite sample bias than difference‐GMM, system‐GMM, collapsing‐GMM and Level‐IV estimators in most cases. Under RIV estimation, the variance ratio problem is well controlled, and the empirical distribution of its t‐statistic is similar to the standard normal distribution for moderate sample sizes.     

Some model-restricted shrinkage estimators for contingency tables with missing data

For contingency tables with extensive missing data, the unrestricted MLE under the saturated model, computed by the EM algorithm, is generally unsatisfactory. In this case, it may be better to fit a simpler model by imposing some restrictions on the parameter space. Perlman and Wu (1999) propose lattice conditional independence (LCI) models for contingency tables with arbitrary missing data patterns. When this LCI model fits well, the restricted MLE under the LCI model is more accurate than the unrestricted MLE under the saturated model, but not in general. Here we propose certain empirical Bayes (EB) estimators that adaptively combine the best features of the restricted and unrestricted MLEs. These EB estimators appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain. We also study a restricted EM algorithm (called the ER algorithm) with similar desirable features. Received: July 1999     

Some Decompositions of OLSEs and BLUEs Under a Partitioned Linear Model

We consider in this paper a partitioned linear model { y , X ₁ β ₁ + X ₂ β ₂ , σ ² σ } and two corresponding small models { y , X ₁ β ₁ , σ ² σ } and { y , X ₂ β ₂ , σ ² σ } . We derive necessary and sufficient conditions for (i) the ordinary least squares estimator under the full model to be the sum of the ordinary least squares estimators under the two small models; (ii) the best linear unbiased estimator under the full model to be the sum of the best linear unbiased estimators under the two small models; (iii) the best linear unbiased estimator under the full model to be the sum of the ordinary least squares estimators under the two small models. The proofs of the main results in this paper also demonstrate how to use the matrix rank method for characterizing various equalities of estimators under general linear models.     

Multivariate Hill Estimators

We propose two classes of semi‐parametric estimators for the tail index of a regular varying elliptical random vector. The first one is based on the distance between a tail probability contour and the observations outside this contour. We denote it as the class of separating estimators. The second one is based on the norm of an arbitrary order. We denote it as the class of angular estimators. We show the asymptotic properties and the finite sample performances of both classes. We also illustrate the separating estimators with an empirical application to 21 worldwide financial market indexes.     

Simultaneous estimation of hazard rates of several exponential populations

Suppose independent random samples are drawn from k (2) populations with a common location parameter and unequal scale parameters. We consider the problem of estimating simultaneously the hazard rates of these populations. The analogues of the maximum likelihood (ML), uniformly minimum variance unbiased (UMVU) and the best scale equivariant (BSE) estimators for the one population case are improved using Rao‐Blackwellization. The improved version of the BSE estimator is shown to be the best among these estimators. Finally, a class of estimators that dominates this improved estimator is obtained using the differential inequality approach.     

Diagnostic analysis for a vector autoregressive model under Student′s t‐distributions

In this paper, we use the local influence method to study a vector autoregressive model under Student^′s t‐distributions. We present the maximum likelihood estimators and the information matrix. We establish the normal curvature diagnostics for the vector autoregressive model under three usual perturbation schemes for identifying possible influential observations. The effectiveness of the proposed diagnostics is examined by a simulation study, followed by our data analysis using the model to fit the weekly log returns of Chevron stock and the Standard & Poor's 500 Index as an application.     

Asymptotic behaviour of regression pre-test estimators with minimal Bayes risk

Pre-test estimators (PTE) are considered which are optimal under a Bayes risk among PTE with general measurable sets as “regions of significance” for the test statistic t associated with the estimate of a given regression coefficient. Asymptotic and some finite sample results are stated and numerical experiments are commented on.     

Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators

Subsampling and the m out of n bootstrap have been suggested in the literature as methods for carrying out inference based on post-model selection estimators and shrinkage estimators. In this paper we consider a subsampling confidence interval (CI) that is based on an estimator that can be viewed either as a post-model selection estimator that employs a consistent model selection procedure or as a super-efficient estimator. We show that the subsampling CI (of nominal level 1−α for any α(0,1)) has asymptotic confidence size (defined to be the limit of finite-sample size) equal to zero in a very simple regular model. The same result holds for the m out of n bootstrap provided m²/n→0 and the observations are i.i.d. Similar zero-asymptotic-confidence-size results hold in more complicated models that are covered by the general results given in the paper and for super-efficient and shrinkage estimators that are not post-model selection estimators. Based on these results, subsampling and the m out of n bootstrap are not recommended for obtaining inference based on post-consistent model selection or shrinkage estimators.     

Right censoring in a discrete life model

Although there are many sophisticated models for estimation of failure rate based on censored data in continuous distributions, not much work has been done in the discrete case. We introduce a discrete model for life lengths and consider its properties. For this model, we derive the corresponding maximum likelihood estimators of the parameters under Type I and Type II right-censoring. Received May 2000     

Strong uniform convergence of the recursive regression estimator under φ-mixing conditions

Suppose the observations (X_i, Y_i) taking values in R^d×R, are -mixing. Compared with the i.i.d. case, some known strong uniform convergence results for the estimators of the regression function r(x)=E(Y_i|X_i=x) need strong moment conditions under -mixing setting. We consider the following improved kernel estimators of r(x) suggested by Cheng (1983): Qian and Mammitzsch (2000) investigated the strong uniform convergence and convergence rate for to r(x) under weaker moment conditions than those of the others in the literature, and the optimal convergence rate can be attained under almost the same conditions as stated in Theorem 3.3.2 of Györfi et al. (1989). In this paper, under the similar conditions of Qian and Mammitzsch (2000), we study the strong uniform convergence and convergence rates for (j=2,3) to r(x), which have not been discussed by Qian and Mammitzsch (2000). In contrast to , our estimators and are recursive, which is highly desirable for practical computation.     

On Estimators of the Nearest Neighbour Distance Distribution Function for Stationary Point Processes

There are three approaches for the estimation of the distribution function D(r) of distance to the nearest neighbour of a stationary point process: the border method, the Hanisch method and the Kaplan-Meier approach. The corresponding estimators and some modifications are compared with respect to bias and mean squared error (mse). Simulations for Poisson, cluster and hard-core processes show that the classical border estimator has good properties; still better is the Hanisch estimator. Typically, mse depends on r, having small values for small and large r and a maximum in between. The mse is not reduced if the exact intensity λ (if known) or intensity estimators from larger windows are built in the estimators of D(r); in contrast, the intensity estimator should have the same precision as that of λ D(r). In the case of replicated estimation from more than one window the best way of pooling the subwindow estimates is averaging by weights which are proportional to squared point numbers.     

Equilibrium exchange rates in oil-exporting countries

We assess the determinants of equilibrium real exchange rates in a sample of oil-dependent countries. Our data cover OPEC countries from 1975 to 2005. Utilising pooled mean group and mean group estimators, we find that the price of oil has a clear, statistically significant effect on real exchange rates in our group of oil-producing countries. Higher oil price lead to appreciation of the real exchange rate. Elasticity of the real exchange rate with respect to the oil price is typically between 0.4 and 0.5, but may be even larger depending on the specification. Real per capita GDP, on the other hand, does not appear to have a clear effect on real exchange rate. This latter result contrasts starkly with many earlier papers on real exchange rate determination, emphasising the unique position of oil-dependent countries.

Moment convergence of M‐estimators

This study extends the rate of convergence theorem of M‐estimators presented by van der Vaart and Wellner (weak convergence and empirical processes: with applications to statistics, Springer‐Verlag, Newyork, 1996) who gave a result of the form r  to a result of the form sup_nE | r , for any p≥1. This result is useful for deriving the moment convergence of the rescaled residual. An application to maximum likelihood estimators is discussed.     

Semiparametric estimation of a censored regression model with an unknown transformation of the dependent variable

This paper presents a method for estimating the model Λ(Y)=min(β′X+U, C), where Y is a scalar, Λ is an unknown increasing function, X is a vector of explanatory variables, β is a vector of unknown parameters, U has unknown cumulative distribution function F, and C is a censoring threshold. It is not assumed that Λ and F belong to known parametric families; they are estimated nonparametrically. This model includes many widely used models as special cases, including the proportional hazards model with unobserved heterogeneity. The paper develops n^1/2-consistent, asymptotically normal estimators of Λ and F. Estimators of β that are n^1/2-consistent and asymptotically normal already exist. The results of Monte Carlo experiments illustrate the finite-sample behavior of the estimators.     

A central limit theorem for the Hellinger loss of Grenander‐type estimators

We consider Grenander‐type estimators for a monotone function , obtained as the slope of a concave (convex) estimate of the primitive of λ. Our main result is a central limit theorem for the Hellinger loss, which applies to estimation of a probability density, a regression function or a failure rate. In the case of density estimation, the limiting variance of the Hellinger loss turns out to be independent of λ.     

Strong uniform convergence for the estimator of the regression function under ϕ-mixing conditions

Suppose the observations (X _i,Y _i), i=1,…, n, are ϕ-mixing. The strong uniform convergence and convergence rate for the estimator of the regression function was studied by serveral authors, e.g. G. Collomb (1984), L. Gy?rfi et al. (1989). But the optimal convergence rates are not reached unless the Y _i are bounded or the E exp (a|Y _i|) are bounded for some a>0. Compared with the i.i.d. case the convergence of the Nadaraya-Watson estimator under ϕ-mixing variables needs strong moment conditions. In this paper we study the strong uniform convergence and convergence rate for the improved kernel estimator of the regression function which has been suggested by Cheng P. (1983). Compared with Theorem A in Y. P. Mack and B. Silverman (1982) or Theorem 3.3.1 in L. Gy?rfi et al. (1989), we prove the convergence for this kind of estimators under weaker moment conditions. The optimal convergence rate for the improved kernel estimator is attained under almost the same conditions of Theorem 3.3.2 in L. Gy?rfi et al. (1989). Received: September 1999