Estimation of the precision matrix of multivariate Pearson type II model

In this paper, the problem of estimating the precision matrix of a multivariate Pearson type II-model is considered. A new class of estimators is proposed. Moreover, the risk functions of the usual and the proposed estimators are explicitly derived. It is shown that the proposed estimator dominates the MLE and the unbiased estimator, under the quadratic loss function. A simulation study is carried out and confirms these results. Improved estimator of tr (Σ ⁻¹) is also obtained.     

Another look at the naive estimator in a regression model

We consider the linear regression model where only a particular linear function of the dependent variables is observed, Stahlecker and Schmidt (1987) proposed a naive least squares (LS) estimator for regression coefficients in such a case. In this note we represent their estimator as a general ridge estimator. This observation leads to a view different from the previous work and provides an easy way of obtaining many important properties of the naive LS estimator. Our approach also gives some insight into the relationship between the naive LS estimator and the generalized least squares estimator.     

Kernel estimation of a smooth distribution function based on censored data

The problem of estimating a smooth distribution functionF at a pointτ based on randomly right censored data is treated under certain smoothness conditions onF. The asymptotic performance of a certain class of kernel estimators is compared to that of the Kaplan-Meier estimator ofF(τ). It is shown that the relative deficiency of the Kaplan-Meier estimator ofF(τ) with respect to the appropriately chosen kernel type estimator tends to infinity as the sample sizen increases to infinity. Strong uniform consistency and the weak convergence of the normalized process are also proved. Research Surported in part by NIH grant 1R01GM28405.     

Heteroskedasticity-robust semi-parametric GMM estimation of a spatial model with space-varying coefficients

Heteroskedasticity-robust semi-parametric GMM estimation of a spatial model with space-varying coefficients. Spatial Economic Analysis. The spatial model with space-varying coefficients proposed by Sun et al. in 2014 has proved to be useful in detecting the location effects of the impacts of covariates as well as spatial interaction in empirical analysis. However, Sun et al.’s estimator is inconsistent when heteroskedasticity is present – a circumstance that is more realistic in certain applications. In this study, we propose a kind of semi-parametric generalized method of moments (GMM) estimator that is not only heteroskedasticity robust but also takes a closed form written explicitly in terms of observed data. We derive the asymptotic distributions of our estimators. Moreover, the results of Monte Carlo experiments show that the proposed estimators perform well in finite samples.     

On classes of estimators of the variance function of a linear estimator

Summary The variance function of a linear estimator can be expressed into a quadratic form. The present paper presents classes of estimators of this quadratic form along the lines implicitly suggested byHorvitz andThompson [1952] while formulating the classes of linear estimators. Accordingly it is noted that there exist nine principal classes of estimators out of which one principal class is examined in detail. Furthermore to illustrate the theory an example is considered where the expression for a unique estimator variance of the best estimator in theT ₁ class is derived.     

On the strong uniform consistency of a new kernel density estimator

Summary A new multivariate kernel probability density estimator is introduced and its strong uniform consistency is proved under certain regularity conditions. This result is then applied particularly to a kernel estimator whose mean vector and covariance matrix areμ _n andV _n, respectively, whereμ _n is an unspecified estimator of the mean vector andV _n, up to a multiplicative constant, the sample covariance matrix of the probability density to be estimated, respectively. Work supported by the Natural Sciences and Engineering Research Council of Canada and by the Fonds F.C.A.R. of the Province of Quebec.     

A chain ratio-type estimator in finite population double sampling using two auxiliary variables

Summary In this paper we construct a chain ratio-type estimator using two auxiliary variables. The performance of the constructed estimator relative to the simple mean, ratio-type estimate based on double sampling andChand's ratio-type estimator is investigated. A numerical illustration is given.     

Two-stage point estimation with a shrinkage stopping rule

Consider the problem of estimating a mean vector in ap-variate normal distribution under two-stage sequential sampling schemes. The paper proposes a stopping rule motivated by the James-Stein shrinkage estimator, and shows that the stopping rule and the corresponding shrinkage estimator asymptotically dominate the usual two-stage procedure under a sequence of local alternatives forp3. Also the results of Monte Carlo simulation for average sample sizes and risks of estimators are stated.     

Confidence Distribution,the Frequentist Distribution Estimator of a Parameter: A Review

In frequentist inference, we commonly use a single point (point estimator) or an interval (confidence interval/“interval estimator”) to estimate a parameter of interest. A very simple question is: Can we also use a distribution function (“distribution estimator”) to estimate a parameter of interest in frequentist inference in the style of a Bayesian posterior? The answer is affirmative, and confidence distribution is a natural choice of such a “distribution estimator”. The concept of a confidence distribution has a long history, and its interpretation has long been fused with fiducial inference. Historically, it has been misconstrued as a fiducial concept, and has not been fully developed in the frequentist framework. In recent years, confidence distribution has attracted a surge of renewed attention, and several developments have highlighted its promising potential as an effective inferential tool. This article reviews recent developments of confidence distributions, along with a modern definition and interpretation of the concept. It includes distributional inference based on confidence distributions and its extensions, optimality issues and their applications. Based on the new developments, the concept of a confidence distribution subsumes and unifies a wide range of examples, from regular parametric (fiducial distribution) examples to bootstrap distributions, significance (p‐value) functions, normalized likelihood functions, and, in some cases, Bayesian priors and posteriors. The discussion is entirely within the school of frequentist inference, with emphasis on applications providing useful statistical inference tools for problems where frequentist methods with good properties were previously unavailable or could not be easily obtained. Although it also draws attention to some of the differences and similarities among frequentist, fiducial and Bayesian approaches, the review is not intended to re‐open the philosophical debate that has lasted more than two hundred years. On the contrary, it is hoped that the article will help bridge the gaps between these different statistical procedures.     

On the Lp error of the Grenander-type estimator in the Cox model

We consider the Cox regression model and study the asymptotic global behavior of the Grenander-type estimator for a monotone baseline hazard function. This model is not included in the general setting of Durot (2007). However, we show that a similar central limit theorem holds for L_p-error of the Grenander-type estimator. As an illustration of application of our main result, we propose a test procedure for a Weibull baseline distribution, based on the L_p-distance between the Grenander estimator and a parametric estimator of the baseline hazard. Simulation studies are performed to investigate the performance of this test.     

INVARIANCE OF THE UNORDERED BEST ESTIMATOR IN THE T,–CLASS FOR MIDZUNO'S AND FOR IKEDA–SEN'S SAMPLING PROCEDURES

MIDZUNO'S sampling procedure is considered where the first (n – 1) draws are carried out with simple random sampling without replacement and the nth draw with varying probabilities. It is shown that for this scheme, the best estimator in the HORVITZ–THOMPSON (1952) T_t–class of linear estimators exists and rejects the last draw. When MURTHY'S technique of unordering of an ordered estimator is employed, the rejected draw is restored and the unordered estimator is obtained. Surprisingly, this unordered estimator is the same as the unordered best estimator in the T₁–class, derived for IKEDA–SEN'S sampling procedure.     

Strong representation of the presmoothed quantile function estimator for censored data

We consider lifetime data subject to right random censorship. In this context, this paper deals with the topic of estimating the distribution function of the lifetime and the corresponding quantile function. As it has been shown that the classical Kaplan–Meier estimator of the distribution function can be improved by means of presmoothing ideas, we introduce a quantile function estimator via the presmoothed distribution function estimator studied by Cao et al. [Journal of Nonparametric statistics, Vol. 17 (2005) pp. 31–56.] The main result of this paper is an almost sure representation of this presmoothed estimator. As a consequence, its strong consistency and asymptotic normality are established. The performance of this new quantile estimator is analyzed in a simulation study and applied to a real data example.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

A new procedure for monitoring the range and standard deviation of a quality characteristic

The Shewhart and the Bonferroni-adjustment R and S chart are usually applied to monitor the range and the standard deviation of a quality characteristic. These charts are used to recognize the process variability of a quality characteristic. The control limits of these charts are constructed on the assumption that the population follows approximately the normal distribution with the standard deviation parameter known or unknown. In this article, we establish two new charts based approximately on the normal distribution. The constant values needed to construct the new control limits are dependent on the sample group size (k) and the sample subgroup size (n). Additionally, the unknown standard deviation for the proposed approaches is estimated by a uniformly minimum variance unbiased estimator (UMVUE). This estimator has variance less than that of the estimator used in the Shewhart and Bonferroni approach. The proposed approaches in the case of the unknown standard deviation, give out-of-control average run length slightly less than the Shewhart approach and considerably less than the Bonferroni-adjustment approach.     

The density of the parameter estimators when the observations are distributed exponentially

We present the probability density of parameter estimators whenN independent variables are observed, each of them distributed according to the exponential low (with some parameters to be estimated). The numberN is supposed to be small. Typically, such an experimental situation arises in problems of software reliability, another case is a small sample in the GLIM modeling. The considered estimator is defined by the maximum of the posterior probability density; it is equal to the maximum likelihood estimator when the prior is uniform. The exact density is obtained, and its approximation is discussed in accordance with some information-geometric considerations. The main body of the paper has been prepared during the author’s visit in LMC/IMAG Grenoble, France, on the invitation of Université Joseph Fourier in January 1994.     

Variance estimation using auxiliary information: An almost unbiased multivariate ratio estimator

The goal of this paper is to investigate the repeated substitution method (seeSrivastava, 1967) estimating population variance in finite population sample surveys. We propose an almost unbiased multivariate ratio estimator that has a smaller mean squared error than the conventional biased multivariate ratio estimator (established byIsaki (1983)) and with the same precision as the multivariate regression estimator. Furthermore, it is a computationally much more interesting estimator since to compute it we only need to have knowledge of correlation among available variables, which it is common to have in several practical situations. A comparison of the multivariate ratio estimator proposed and the multivariate regression estimator is given.     

Half‐panel jackknife fixed‐effects estimation of linear panels with weakly exogenous regressors

This paper considers estimation and inference in linear panel regression models with lagged dependent variables and/or other weakly exogenous regressors when N (the cross‐section dimension) is large relative to T (the time series dimension). It allows for fixed and time effects (FE‐TE) and derives a general formula for the bias of the FE‐TE estimator which generalizes the well‐known Nickell bias formula derived for the pure autoregressive dynamic panel data models. It shows that in the presence of weakly exogenous regressors inference based on the FE‐TE estimator will result in size distortions unless N/T is sufficiently small. To deal with the bias and size distortion of the FE‐TE estimator the use of a half‐panel jackknife FE‐TE estimator is considered and its asymptotic distribution is derived. It is shown that the bias of the half‐panel jackknife FE‐TE estimator is of order T^?2, and for valid inference it is only required that N/T³→0, as N,T→∞ jointly. Extension to unbalanced panel data models is also provided. The theoretical results are illustrated with Monte Carlo evidence. It is shown that the FE‐TE estimator can suffer from large size distortions when N>T, with the half‐panel jackknife FE‐TE estimator showing little size distortions. The use of half‐panel jackknife FE‐TE estimator is illustrated with two empirical applications from the literature.     

Model‐Assisted Regression Estimators for Longitudinal Data with Nonignorable Dropout

Estimation with longitudinal Y having nonignorable dropout is considered when the joint distribution of Y and covariate X is nonparametric and the dropout propensity conditional on (Y,X) is parametric. We apply the generalised method of moments to estimate the parameters in the nonignorable dropout propensity based on estimating equations constructed using an instrument Z, which is part of X related to Y but unrelated to the dropout propensity conditioned on Y and other covariates. Population means and other parameters in the nonparametric distribution of Y can be estimated based on inverse propensity weighting with estimated propensity. To improve efficiency, we derive a model‐assisted regression estimator making use of information provided by the covariates and previously observed Y‐values in the longitudinal setting. The model‐assisted regression estimator is protected from model misspecification and is asymptotically normal and more efficient when the working models are correct and some other conditions are satisfied. The finite‐sample performance of the estimators is studied through simulation, and an application to the HIV‐CD4 data set is also presented as illustration.     

CCE estimation of factor‐augmented regression models with more factors than observables

This paper considers estimation of factor‐augmented panel data regression models. One of the most popular approaches towards this end is the common correlated effects (CCE) estimator of Pesaran (Estimation and inference in large heterogeneous panels with a multifactor error structure. Econometrica, 2006, 74, 967–1012, 2006). For the pooled version of this estimator to be consistent, either the number of observables must be larger than the number of unobserved common factors, or the factor loadings must be distributed independently of each other. This is a problem in the typical application involving only a small number of regressors and/or correlated loadings. The current paper proposes a simple extension to the CCE procedure by which both requirements can be relaxed. The CCE approach is based on taking the cross‐section average of the observables as an estimator of the common factors. The idea put forth in the current paper is to consider not only the average but also other cross‐section combinations. Asymptotic properties of the resulting combination‐augmented CCE (C³E) estimator are provided and tested in small samples using both simulated and real data.     

Estimating the variance of the ratio estimator for theMidzuno-Sen sampling scheme

Summary The problem of estimating the variance of the ratio estimator for theMidzuno-Sen sampling scheme is further studied in this paper. Sufficient conditions are derived for which the suggested variance estimator is always positive definite.