Model-calibration estimation of the distribution function using nonparametric regression

Nonparametric regression has only recently been employed in the estimation of finite population parameters in a model-assisted framework. This paper proposes a new calibration estimator for the distribution function using nonparametric methods to obtain the fitted values on which to calibrate. The proposed estimator is a genuine distribution function that presents several attractive features. In terms of relative efficiency and relative bias, the behaviour of the proposed estimator is compared to other known estimators in a limited simulation study on real populations.     

Influence diagnostic in survey sampling: Estimating the conditional bias

The conditional bias has been proposed by Moreno Rebollo et al. (1999) as an influence diagnostic in survey sampling, when the inference is based on the randomization distribution generated by a random sampling. The conditional bias is a population parameter. So, from an applied point of view, it must be estimated. In this paper, we propose an estimator of the conditional bias and we study conditions that guarantee its unbiasedness. The results are applied in a Simple Random Sampling and in a Proportional Probability Aggregated Size Sampling, when the ratio estimator is used. Received October 2000     

Pseudo empirical likelihood method in the presence of missing data

In this paper, we propose an estimator for the population mean when some observations on the study and auxiliary variables are missing from the sample. The proposed estimator is valid for any unequal probability sampling design, and is based upon the pseudo empirical likelihood method. The proposed estimator is compared with other estimators in a simulation study.     

Capture–recapture estimation based upon the geometric distribution allowing for heterogeneity

Capture–Recapture methods aim to estimate the size of an elusive target population. Each member of the target population carries a count of identifications by some identifying mechanism—the number of times it has been identified during the observational period. Only positive counts are observed and inference needs to be based on the observed count distribution. A widely used assumption for the count distribution is a Poisson mixture. If the mixing distribution can be described by an exponential density, the geometric distribution arises as the marginal. This note discusses population size estimation on the basis of the zero-truncated geometric (a geometric again itself). In addition, population heterogeneity is considered for the geometric. Chao’s estimator is developed for the mixture of geometric distributions and provides a lower bound estimator which is valid under arbitrary mixing on the parameter of the geometric. However, Chao’s estimator is also known for its relatively large variance (if compared to the maximum likelihood estimator). Another estimator based on a censored geometric likelihood is suggested which uses the entire sample information but is less affected by model misspecifications. Simulation studies illustrate that the proposed censored estimator comprises a good compromise between the maximum likelihood estimator and Chao’s estimator, e.g. between efficiency and bias.     

Variance estimation using auxiliary information: An almost unbiased multivariate ratio estimator

The goal of this paper is to investigate the repeated substitution method (seeSrivastava, 1967) estimating population variance in finite population sample surveys. We propose an almost unbiased multivariate ratio estimator that has a smaller mean squared error than the conventional biased multivariate ratio estimator (established byIsaki (1983)) and with the same precision as the multivariate regression estimator. Furthermore, it is a computationally much more interesting estimator since to compute it we only need to have knowledge of correlation among available variables, which it is common to have in several practical situations. A comparison of the multivariate ratio estimator proposed and the multivariate regression estimator is given.     

An optimum sampling design to base HT-method of estimating a finite population total

The problem of constructing a sampling design with the value of the sum of second order inclusion probabilities attaining its lower bound for non-integral values of the expected effective size of a sample in the design has been considered in this paper. If the values of the characteristic of interest on all the units in the population are non-negative the design is admissible (in the sense of variance) with respect to Horvitz-Thompson estimator in the class of designs with the same set of values of the first order inclusion probabilities of the units. Again such a design is best to use Horvitz-Thompson estimator of population total in the sense of smallest average variance of the estimator under a special superpopulatio model.     

Model‐Assisted Estimation of a Spatial Population Mean

This paper deals with the estimation of the mean of a spatial population. Under a design‐based approach to inference, an estimator assisted by a penalized spline regression model is proposed and studied. Proof that the estimator is design‐consistent and has a normal limiting distribution is provided. A simulation study is carried out to investigate the performance of the new estimator and its variance estimator, in terms of relative bias, efficiency, and confidence interval coverage rate. The results show that gains in efficiency over standard estimators in classical sampling theory may be impressive.     

Distribution free estimation of heteroskedastic binary response models using Probit/Logit criterion functions

In this paper estimators for distribution free heteroskedastic binary response models are proposed. The estimation procedures are based on relationships between distribution free models with a conditional median restriction and parametric models (such as Probit/Logit) exhibiting (multiplicative) heteroskedasticity. The first proposed estimator is based on the observational equivalence between the two models, and is a semiparametric sieve estimator (see, e.g. Gallant and Nychka (1987), Ai and Chen (2003) and Chen et al. (2005)) for the regression coefficients, based on maximizing standard Logit/Probit criterion functions, such as NLLS and MLE. This procedure has the advantage that choice probabilities and regression coefficients are estimated simultaneously. The second proposed procedure is based on the equivalence between existing semiparametric estimators for the conditional median model (,  and ) and the standard parametric (Probit/Logit) NLLS estimator. This estimator has the advantage of being implementable with standard software packages such as Stata. Distribution theory is developed for both estimators and a Monte Carlo study indicates they both perform well in finite samples.     

A Predictive Estimator of the Mean with Missing Data

One of the most difficult problems confronting investigators who analyze data from surveys is how treat missing data. Many statistical procedures can not be used immediately if any values are missing. This paper considers the problem of estimating the population mean using auxiliary information when some observations on the sample are missing and the population mean of the auxiliary variable is not available. We use tools of classical statistical estimation theory to find a suitable estimator. We study the model and design properties of the proposed estimator. We also report the results of a broad-based simulation study of the efficiency of the estimator, which reveals very promising results.     

Calibration Estimation in Survey Sampling

Calibration estimation, where the sampling weights are adjusted to make certain estimators match known population totals, is commonly used in survey sampling. The generalized regression estimator is an example of a calibration estimator. Given the functional form of the calibration adjustment term, we establish the asymptotic equivalence between the functional-form calibration estimator and an instrumental variable calibration estimator where the instrumental variable is directly determined from the functional form in the calibration equation. Variance estimation based on linearization is discussed and applied to some recently proposed calibration estimators. The results are extended to the estimator that is a solution to the calibrated estimating equation. Results from a limited simulation study are presented.     

Repeated substitution method: The ratio estimator for the population variance

This paper proposes a new unbiased estimator for the population variance in finite population sample surveys using auxiliary information. This estimator has a smaller mean squared error than the conventional unbiased estimator, the ratio estimator established by Isaki (1983) and it has the same precision than the regression estimator. Furthermore, it is a much more interesting estimator from the computation viewpoint.     

On the generalization of Rao,Hartley and Cochran's scheme

Summary The problem considered in this paper is a generalization of the usual Rao, Hartley and Cochran (RHC) scheme. In the usual RHC scheme the population ofN units is randomly divided inton groups wheren is the size of the sample. In this paper we propose to divide the population under consideration into (n+k) random groups wherek is some positive integer. Then a sample ofn groups is selected by using simple random sampling without replacement (SRSWOR). The expressions for the unbiased estimator of population total, its variance and the unbiased estimate of variance have been obtained under the proposed sheme. The condition under which the proposed sheme is more efficient than the usual RHC scheme has also been investigated.     

Calibration methods for estimating quantiles

We propose a calibrated estimator of the quantiles of sample survey data and discuss the asymptotic theory behind it. This estimator is defined for any sampling design and uses the information available on J auxiliary variables. A simulation study based on a real population is used to compare the estimator with various methods proposed previously.     

Survey statisticians celebrate golden jubilee year 2003 of the linear regression estimator

In the present investigation, a general set-up for inference from survey data that covers the estimation of variance of estimators of totals and distribution functions has been considered, using known first and second order moments of auxiliary information at the estimation stage. The traditional linear regression estimator of population total owed to Hansen et al. Sample survey methods and theory. vol. 1 & 2, New York, Wiley (1953) is shown to be unique in its class of estimators, and celebrates Golden Jubilee Year-2003 for its outstanding performance in the literature by following Singh Advanced sampling theory with applications: How Michael selected Amy, vols 1 & 2, Kluwer, The Netherlands, pp 1–1247 2003. This particular paper has been designed to repair the methodology of Rao J. Off Stat 10(2):153–165 (1994) and hence that of Singh Ann Ins Stat Math 53(2):404–417 (2001). Although there is no need of simulation study to demonstrate the superiority of the proposed technique, because the theoretical results are crystal clear, but a small scale level simulation study have been designed to show the performance of the proposed estimators over the existing estimators in the literature.     

Properties of the CUE estimator and a modification with moments

In this paper, we analyze properties of the Continuous Updating Estimator (CUE) proposed by Hansen et al. (1996), which has been suggested as a solution to the finite sample bias problems of the two-step GMM estimator. We show that the estimator should be expected to perform poorly in finite samples under weak identification, in particular, the estimator is not guaranteed to have finite moments of any order. We propose the Regularized CUE (RCUE) as a solution to this problem. The RCUE solves a modification of the first-order conditions for the CUE estimator and is shown to be asymptotically equivalent to CUE under many weak moment asymptotics. Our theoretical findings are confirmed by extensive Monte Carlo studies.     

A new procedure for monitoring the range and standard deviation of a quality characteristic

The Shewhart and the Bonferroni-adjustment R and S chart are usually applied to monitor the range and the standard deviation of a quality characteristic. These charts are used to recognize the process variability of a quality characteristic. The control limits of these charts are constructed on the assumption that the population follows approximately the normal distribution with the standard deviation parameter known or unknown. In this article, we establish two new charts based approximately on the normal distribution. The constant values needed to construct the new control limits are dependent on the sample group size (k) and the sample subgroup size (n). Additionally, the unknown standard deviation for the proposed approaches is estimated by a uniformly minimum variance unbiased estimator (UMVUE). This estimator has variance less than that of the estimator used in the Shewhart and Bonferroni approach. The proposed approaches in the case of the unknown standard deviation, give out-of-control average run length slightly less than the Shewhart approach and considerably less than the Bonferroni-adjustment approach.     

Model assisted survey sampling strategy in two phases

Postulating a super-population regression model connecting a size variable, a cheaply measurable variable and an expensively observable variable of interest, an asymptotically optimal double sampling strategy to estimate the survey population total of the third variable is specified. To render it practicable, unknown model-parameters in the optimal estimator are replaced by appropriate statistics. The resulting generalized regression estimator is then shown to have a model-cum-asymptotic design based expected square error equal to that of the asymptotically optimum estimator itself. An estimator for design variance of the estimator is also proposed.     

Semiparametric estimation of a bivariate Tobit model

The existing semiparametric estimation literature has mainly focused on univariate Tobit models and no semiparametric estimation has been considered for bivariate Tobit models. In this paper, we consider semiparametric estimation of the bivariate Tobit model proposed by Amemiya (1974), under the independence condition without imposing any parametric restriction on the error distribution. Our estimator is shown to be consistent and asymptotically normal, and simulation results show that our estimator performs well in finite samples. It is also worth noting that while Amemiya’s (1974) instrumental variables estimator (IV) requires the normality assumption, our semiparametric estimator actually outperforms his IV estimator even when normality holds. Our approach can be extended to higher dimensional multivariate Tobit models.     

Extreme value statistics for censored data with heavy tails under competing risks

This paper addresses the problem of estimating, from randomly censored data subject to competing risks, the extreme value index of the (sub)-distribution function associated to one particular cause, in a heavy-tail framework. Asymptotic normality of the proposed estimator is established. This estimator has the form of an Aalen-Johansen integral and is the first estimator proposed in this context. Estimation of extreme quantiles of the cumulative incidence function is then addressed as a consequence. A small simulation study exhibits the performances for finite samples.     

Randomized response: Estimating mean square errors of linear estimators and finding optimal unbiased strategies

Summary General procedures are described to generate quantitative randomized response (RR) required to estimate the finite population total of a sensitive variable. Permitting sample selection with arbitrary probabilities a formula for the mean square error (MSE) of a linear estimator of total based on RR is noted indicating the simple modification over one that might be based on direct response (DR) if the latter were available. A general formula for an unbiased estimator of the MSE is presented. A simple approximation is proposed in case the RR ratio estimator is employed based on a simple random sample (SRS) taken without replacement (WOR). Among sampling strategies employing unbiased but not necessarily linear estimators based on RR, certain optimal ones are identified under two alternative models analogously to well-known counterparts based on DR, if available. Unlike Warner’s (1965) treatment of categorical RR we consider quantitative RR here.