Randomized response: Estimating mean square errors of linear estimators and finding optimal unbiased strategies

Summary General procedures are described to generate quantitative randomized response (RR) required to estimate the finite population total of a sensitive variable. Permitting sample selection with arbitrary probabilities a formula for the mean square error (MSE) of a linear estimator of total based on RR is noted indicating the simple modification over one that might be based on direct response (DR) if the latter were available. A general formula for an unbiased estimator of the MSE is presented. A simple approximation is proposed in case the RR ratio estimator is employed based on a simple random sample (SRS) taken without replacement (WOR). Among sampling strategies employing unbiased but not necessarily linear estimators based on RR, certain optimal ones are identified under two alternative models analogously to well-known counterparts based on DR, if available. Unlike Warner’s (1965) treatment of categorical RR we consider quantitative RR here.     

Estimation from two-stage unequal probability sampling with missing units

A formula is presented for an unbiased estimator for the variance of an unbiased estimator of a survey population total as well as for an unbiased estimator of its variance based on sampling in two-stages following Rao et al. J Roy Stat Soc B 24: 482–491 (1962) scheme in both stages when the originally selected units in both stages cannot be fully covered in the survey but are to be randomly sub-sampled. The development is helpful to tackle non-responses if assumed to have occurred at random in either or both the stages     

Estimation in Surveys Using Conditional Inclusion Probabilities: Simple Random Sampling

In survey sampling, auxiliary information on the population is often available. The aim of this paper is to develop a method which allows one to take into account such auxiliary information at the estimation stage by means of conditional bias adjustment. The basic idea is to attempt to construct a conditionally unbiased estimator. Four estimators that have a small conditional bias with respect to a statistic are proposed. It is shown that many of the estimators used in the literature in the case of simple random sampling can be obtained by using this estimation principle. The problem of simple random sampling with replacement, poststratification, and adjustment of a 2 x 2 dimensional contingency table to marginal totals are discussed in the conditional framework. Finally it is shown that the regression estimator can be viewed as an approximation of an application of the conditional principle.     

Mixed random systematic sampling designs

In this paper, an alternative sampling procedure that is a mixture of simple random sampling and systematic sampling is proposed. It results in uniform inclusion probabilities for all individual units and positive inclusion probabilities for all pairs of units. As a result, the proposed sampling procedure enables us to estimate the population mean unbiasedly using the ordinary sample mean, and to provide an unbiased estimator of its sampling variance. It is also found that the suggested sampling procedure performs well especially when the size of simple random sample is small. Received August 2001     

On the admissibility of estimators for the finite population variance

Summary With each unti of a finite population is associated an unknown variate value. We are interested in the variance of these values and consider (1) simple random sampling without replacement. (2) quadratic loss and (3) a one parameter class of estimators. We determine all admissible elements of the class. The usual unbiased estimator for the variance which is an element of the class considered turns out to be inadmissible.     

Admissible unbiased variance estimation in finite population sampling under randomized response

LetP be the proportion of units in a finite population possessing a sensitive attribute. We prove the admissibility of (i) an unbiased estimator of the variance of a general homogeneous linear unbiased estimator ofP and (ii) an unbiased estimator of the population varianceP(1−P), based on an arbitrary but fixed sampling design, under the randomized response plans due to Warner (1965) and Eriksson (1973). Admissibility of an unbiased strategy for estimating the population variance is also established.     

On the efficiency of systematic sampling in ratio and product estimation

Summary In this paper the possibility of gain in efficiency in systematic sampling as compared to simple random sampling has been considered when a ratio or product estimator is used to improve upon the conventional unbiased estimator. The expression for the variance of the estimators are derived for multistage design where systematic selection is used at the ultimate-stage with any probability scheme at the previous stages. In particular the results for the uni-stage systematic sampling and for two-stage sampling with systematic selection at the second-stage have been obtained in section 3.     

On estimating nonnegative definite quadratic forms

It is often required to estimate a quadratic form in survey sampling, especially when one has to estimate the mean squared error of a linear estimator of the population total. In this note we consider the problem of obtaining uniformly nonnegative quadratic unbiased estimators for nonnegative definite quadratic forms. The estimators considered here are necessarily quadratic. Received January 1997     

On the existence of locally mvu estimators

It is proved that there exists an unbiased estimator for some real parameter of a class of distributions, which has minimal variance for some fixed distribution among all corresponding unbiased estimators, if and. only if the corresponding minimal variances for all related unbiased estimation problems concerning finite subsets of the underlying family of distributions are bounded. As an application it is shown that there does not exist some unbiased estimator for θ^k+c(ε≥0) with minimal variance for θ =0 among all corresponding unbiased estimators on the base of k i.i.d. random variables with a Cauchy-distribution, where θ denotes some location parameter.     

A note on estimation of variance components in a multi-stage sampling design based on interpenetrating sub-samples

Summary In this note it is shown that unbiased estimators of the components of the sampling variance of an estimator in the case of a stratified multi-stage sampling design could easily be obtained by selecting the samples at the different stages in the form of two or more independent interpenetrating sub-samples.     

Estimators for particulate sampling derived from a multinomial distribution

Counting the number of units is not always practical during the sampling of particulate materials: it is often much easier to sample a fixed volume or fixed mass of particles. Hence, a class of sampling designs is proposed which leads to samples that have approximately a constant mass or a constant volume. For these sampling designs, estimators were derived which are a ratio of arbitrary sample totals. A Taylor expansion was used to obtain a first-order approximation for the expected value and variance in the limit of a large batch-to-sample size ratio. Furthermore, a π -estimator for a ratio of batch totals was found by deriving expressions for the first- and second-order inclusion probabilities. Practical application of the π -estimator is limited because it requires inaccessible batch information. However, when the denominator of the estimated batch ratio is the batch size, the π -estimator becomes equal to a sample total divided by the sample size in the limit of a large sample-to-particle size ratio. As a consequence, the obtained sample ratio becomes an unbiased estimator for the corresponding batch ratio. Retaining unbiasedness, the Horvitz–Thompson estimator for the variance, which also contains inaccessible batch information, is replaced by an estimator containing sample information only. Practical application of this estimator is illustrated for the sampling of slag, produced during the production of steel.     

On the variance of the ratio estimator for midzuno-sen sampling scheme

Summary For the sampling scheme ofMidzuno [3] andSen [4], which provides unbiased ratio estimators an expression for the variance of the estimator does not seem to be available in literature. An expression for the same is derived in this note.     

On classes of estimators of the variance function of a linear estimator

Summary The variance function of a linear estimator can be expressed into a quadratic form. The present paper presents classes of estimators of this quadratic form along the lines implicitly suggested byHorvitz andThompson [1952] while formulating the classes of linear estimators. Accordingly it is noted that there exist nine principal classes of estimators out of which one principal class is examined in detail. Furthermore to illustrate the theory an example is considered where the expression for a unique estimator variance of the best estimator in theT ₁ class is derived.     

On efficiency of the ratio estimator

Summary The exact mean square error for the ratio estimator of a finite population total based on simple random sampling without replacement is shown to have an expected value less than that of the variance of the ratio estimator based on Midzuno’s scheme, under a usual super-population model.     

Estimation of the precision matrix of multivariate Pearson type II model

In this paper, the problem of estimating the precision matrix of a multivariate Pearson type II-model is considered. A new class of estimators is proposed. Moreover, the risk functions of the usual and the proposed estimators are explicitly derived. It is shown that the proposed estimator dominates the MLE and the unbiased estimator, under the quadratic loss function. A simulation study is carried out and confirms these results. Improved estimator of tr (Σ ⁻¹) is also obtained.     

Christofides’ randomized response technique in complex sample surveys

Christofides (2003) has given an improved modification of Warners (1965) pioneering randomized response (RR) technique in estimating an unknown proportion of people bearing a sensitive characteristic in a given community. As both these RR devices are shown to yield unbiased estimators based only on simple random sampling (SRS) with replacement (WR) but in practice samples are mostly taken with unequal selection probabilities without replacement (WOR), here we present methods of estimation when Christofides RR data are available from unequal probability samples. Warners (1965) RR device was earlier shown by Chaudhuri (2001) to be applicable in complex surveys. For completeness we present estimators for the variance of our estimator and also describe what to do if some people opt to divulge truths.This research is partially supported by CSIR grant No. 21(0539)/02/EMR-II     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

Estimation of variance in multi-stage sampling

In multi-stage sampling when selection is without replacement at the first stage, estimation of the variance of the estimate of the population total is often done assuming sampling with replacement. This estimate is biased and the degree of bias is not negligible. In this paper, a procedure which gives unbiased estimates of the variance making use of only estimated primary sampling unit totals is suggested for the case when sampling at the second and subsequent stages is simple random without replacement. This procedure is based on sub-samples drawn from the selected second and subsequent stage units.     

Variance estimation for unequal probability sampling

In this paper, we discuss the optimality of the variance estimator of the Horvitz-Thompson estimator proposed by Kott (1988) in the class of model-unbiased quadratic estimators. We also propose some improved estimators over Kott's estimator in the class of general quadratic estimators. Received: February 1999     

Estimating regression coefficients from survey data by asymptotic design-cum-model based approach

Postulating a linear regression of a variable of interest on an auxiliary variable with values of the latter known for all units of a survey population, we consider appropriate ways of choosing a sample and estimating the regression parameters. Recalling Thomsen’s (1978) results on non-existence of ‘design-cum-model’ based minimum variance unbiased estimators of regression coefficients we apply Brewer’s (1979) ‘asymptotic’ analysis to derive ‘asymptotic-design-cummodel’ based optimal estimators assuming large population and sample sizes. A variance estimation procedure is also proposed.