Pseudo empirical likelihood method in the presence of missing data

In this paper, we propose an estimator for the population mean when some observations on the study and auxiliary variables are missing from the sample. The proposed estimator is valid for any unequal probability sampling design, and is based upon the pseudo empirical likelihood method. The proposed estimator is compared with other estimators in a simulation study.     

Design‐based Estimators Calibrated on Estimated Totals from Multiple Surveys

The use of auxiliary variables to improve the efficiency of estimators is a well‐known strategy in survey sampling. Typically, the auxiliary variables used are the totals of appropriate measurement that are exactly known from registers or administrative sources. Increasingly, however, these totals are estimated from surveys and are then used to calibrate estimators and improve their efficiency. We consider different types of survey structures and develop design‐based estimators that are calibrated on known as well as estimated totals of auxiliary variables. The optimality properties of these estimators are studied. These estimators can be viewed as extensions of the Montanari generalised regression estimator adapted to the more complex situations. The paper studies interesting special cases to develop insights and guidelines to properly manage the survey‐estimated auxiliary totals.     

Yet another breakdown point notion: EFSBP

The breakdown point in its different variants is one of the central notions to quantify the global robustness of a procedure. We propose a simple supplementary variant which is useful in situations where we have no obvious or only partial equivariance: Extending the Donoho and Huber (The notion of breakdown point, Wadsworth, Belmont, 1983) Finite Sample Breakdown Point?, we propose the Expected Finite Sample Breakdown Point to produce less configuration-dependent values while still preserving the finite sample aspect of the former definition. We apply this notion for joint estimation of scale and shape (with only scale-equivariance available), exemplified for generalized Pareto, generalized extreme value, Weibull, and Gamma distributions. In these settings, we are interested in highly-robust, easy-to-compute initial estimators; to this end we study Pickands-type and Location-Dispersion-type estimators and compute their respective breakdown points.     

On ratio and product methods of estimation in sampling

Abstract  In sample surveys the ratio (product) method of estimation is quite effective when there is a positively (negatively) high correlation between the study variate and an auxiliary variate on which supplementary information is available. This paper considers four estimators suited for cases where these correlations are only moderate and gives a rule of thumb for choosing among these and the traditional estimators. Such a choice needs a good guess of the interval containing a certain parameter k , which may not be hard in survey practice. A numerical example has been included for the case of positive correlation for illustration. An extension for using multiauxiliary information is also considered.     

Variance estimation for unequal probability sampling

In this paper, we discuss the optimality of the variance estimator of the Horvitz-Thompson estimator proposed by Kott (1988) in the class of model-unbiased quadratic estimators. We also propose some improved estimators over Kott's estimator in the class of general quadratic estimators. Received: February 1999     

Estimation of functions of population means and regression coefficients including structural coefficients: A minimum expected loss (MELO) approach

Parameter estimates that minimize the posterior expectation of generalized quadratic loss functions are derived for a wide range of estimation problems encountered in econometrics and statistics including estimation of structural coefficients of linear structural econometric models and reciprocals and ratios of population means and regression or reduced form coefficients. These MELO estimates are simple in form and possess finite sampling moments and risk in contrast to other estimators, including maximum likelihood estimators, that possess no finite moments and have infinite risk relative to quadratic loss functions. Additional finite and large sample properties of MELO estimates are derived and discussed.     

Connections between Survey Calibration Estimators and Semiparametric Models for Incomplete Data

Survey calibration (or generalized raking) estimators are a standard approach to the use of auxiliary information in survey sampling, improving on the simple Horvitz–Thompson estimator. In this paper we relate the survey calibration estimators to the semiparametric incomplete‐data estimators of Robins and coworkers, and to adjustment for baseline variables in a randomized trial. The development based on calibration estimators explains the “estimated weights” paradox and provides useful heuristics for constructing practical estimators. We present some examples of using calibration to gain precision without making additional modelling assumptions in a variety of regression models.     

Using Complex Surveys to Estimate the L1‐Median of a Functional Variable: Application to Electricity Load Curves

Mean profiles are widely used as indicators of the electricity consumption habits of customers. Currently, in Électricité De France (EDF), class load profiles are estimated using point‐wise mean profiles. Unfortunately, it is well known that the mean is highly sensitive to the presence of outliers, such as one or more consumers with unusually high‐levels of consumption. In this paper, we propose an alternative to the mean profile: the L ₁ ‐ median profile which is more robust. When dealing with large data sets of functional data (load curves for example), survey sampling approaches are useful for estimating the median profile avoiding storing the whole data. We propose here several sampling strategies and estimators to estimate the median trajectory. A comparison between them is illustrated by means of a test population. We develop a stratification based on the linearized variable which substantially improves the accuracy of the estimator compared to simple random sampling without replacement. We suggest also an improved estimator that takes into account auxiliary information. Some potential areas for future research are also highlighted.     

Estimating panel data models in the presence of endogeneity and selection

We consider estimation of panel data models with sample selection when the equation of interest contains endogenous explanatory variables as well as unobserved heterogeneity. Assuming that appropriate instruments are available, we propose several tests for selection bias and two estimation procedures that correct for selection in the presence of endogenous regressors. The tests are based on the fixed effects two-stage least squares estimator, thereby permitting arbitrary correlation between unobserved heterogeneity and explanatory variables. The first correction procedure is parametric and is valid under the assumption that the errors in the selection equation are normally distributed. The second procedure estimates the model parameters semiparametrically using series estimators. In the proposed testing and correction procedures, the error terms may be heterogeneously distributed and serially dependent in both selection and primary equations. Because these methods allow for a rather flexible structure of the error variance and do not impose any nonstandard assumptions on the conditional distributions of explanatory variables, they provide a useful alternative to the existing approaches presented in the literature.     

Robust Small Area Estimation under Spatial Non‐stationarity

The effective use of spatial information in a regression‐based approach to small area estimation is an important practical issue. One approach to account for geographic information is by extending the linear mixed model to allow for spatially correlated random area effects. An alternative is to include the spatial information by a non‐parametric mixed models. Another option is geographic weighted regression where the model coefficients vary spatially across the geography of interest. Although these approaches are useful for estimating small area means efficiently under strict parametric assumptions, they can be sensitive to outliers. In this paper, we propose robust extensions of the geographically weighted empirical best linear unbiased predictor. In particular, we introduce robust projective and predictive estimators under spatial non‐stationarity. Mean squared error estimation is performed by two analytic approaches that account for the spatial structure in the data. Model‐based simulations show that the methodology proposed often leads to more efficient estimators. Furthermore, the analytic mean squared error estimators introduced have appealing properties in terms of stability and bias. Finally, we demonstrate in the application that the new methodology is a good choice for producing estimates for average rent prices of apartments in urban planning areas in Berlin.     

Localised Estimates of Dynamics of Multi‐dimensional Disadvantage: An Application of the Small Area Estimation Technique Using Australian Survey and Census Data

Deep and persistent disadvantage is an important, but statistically rare, phenomenon in the population, and sample sizes are usually not large enough to provide reliable estimates for disaggregated analysis. Survey samples are typically designed to produce estimates of population characteristics of planned areas. The sample sizes are calculated so that the survey estimator for each of the planned areas is of a desired level of precision. However, in many instances, estimators are required for areas of the population for which the survey providing the data was unplanned. Then, for areas with small sample sizes, direct estimation of population characteristics based only on the data available from the particular area tends to be unreliable. This has led to the development of a class of indirect estimators that make use of information from related areas through modelling. A model is used to link similar areas to enhance the estimation of unplanned areas; in other words, they borrow strength from the other areas. Doing so improves the precision of estimated characteristics in the small area, especially in areas with smaller sample sizes. Social science researchers have increasingly employed small area estimation to provide localised estimates of population characteristics from surveys. We explore how to extend this approach within the context of deep and persistent disadvantage in Australia. We find that because of the unique circumstances of the Australian population distribution, direct estimates of disadvantage have substantial variation, but by applying small area estimation, there are significant improvements in precision of estimates.     

Some model-restricted shrinkage estimators for contingency tables with missing data

For contingency tables with extensive missing data, the unrestricted MLE under the saturated model, computed by the EM algorithm, is generally unsatisfactory. In this case, it may be better to fit a simpler model by imposing some restrictions on the parameter space. Perlman and Wu (1999) propose lattice conditional independence (LCI) models for contingency tables with arbitrary missing data patterns. When this LCI model fits well, the restricted MLE under the LCI model is more accurate than the unrestricted MLE under the saturated model, but not in general. Here we propose certain empirical Bayes (EB) estimators that adaptively combine the best features of the restricted and unrestricted MLEs. These EB estimators appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain. We also study a restricted EM algorithm (called the ER algorithm) with similar desirable features. Received: July 1999     

Calibration Estimation in Survey Sampling

Calibration estimation, where the sampling weights are adjusted to make certain estimators match known population totals, is commonly used in survey sampling. The generalized regression estimator is an example of a calibration estimator. Given the functional form of the calibration adjustment term, we establish the asymptotic equivalence between the functional-form calibration estimator and an instrumental variable calibration estimator where the instrumental variable is directly determined from the functional form in the calibration equation. Variance estimation based on linearization is discussed and applied to some recently proposed calibration estimators. The results are extended to the estimator that is a solution to the calibrated estimating equation. Results from a limited simulation study are presented.     

Estimation Techniques for Ordinal Data in Multiple Frame Surveys with Complex Sampling Designs

Surveys usually include questions where individuals must select one in a series of possible options that can be sorted. On the other hand, multiple frame surveys are becoming a widely used method to decrease bias due to undercoverage of the target population. In this work, we propose statistical techniques for handling ordinal data coming from a multiple frame survey using complex sampling designs and auxiliary information. Our aim is to estimate proportions when the variable of interest has ordinal outcomes. Two estimators are constructed following model‐assisted generalised regression and model calibration techniques. Theoretical properties are investigated for these estimators. Simulation studies with different sampling procedures are considered to evaluate the performance of the proposed estimators in finite size samples. An application to a real survey on opinions towards immigration is also included.     

Using Remote Sensing for Agricultural Statistics

Remote sensing can be a valuable tool for agricultural statistics when area frames or multiple frames are used. At the design level, remote sensing typically helps in the definition of sampling units and the stratification, but can also be exploited to optimise the sample allocation and size of sampling units. At the estimator level, classified satellite images are generally used as auxiliary variables in a regression estimator or for estimators based on confusion matrixes. The most often used satellite images are LANDSAT-TM and SPOT-XS. In general, classified or photo-interpreted images should not be directly used to estimate crop areas because the proportion of pixels classified into the specific crop is often strongly biased. Vegetation indexes computed from satellite images can give in some cases a good indication of the potential crop yield.     

A new class of asymptotically efficient estimators for moment condition models

In this paper, we propose a new class of asymptotically efficient estimators for moment condition models. These estimators share the same higher order bias properties as the generalized empirical likelihood estimators and once bias corrected, have the same higher order efficiency properties as the bias corrected generalized empirical likelihood estimators. Unlike the generalized empirical likelihood estimators, our new estimators are much easier to compute. A simulation study finds that our estimators have better finite sample performance than the two-step GMM, and compare well to several potential alternatives in terms of both computational stability and overall performance.     

Multivariate Hill Estimators

We propose two classes of semi‐parametric estimators for the tail index of a regular varying elliptical random vector. The first one is based on the distance between a tail probability contour and the observations outside this contour. We denote it as the class of separating estimators. The second one is based on the norm of an arbitrary order. We denote it as the class of angular estimators. We show the asymptotic properties and the finite sample performances of both classes. We also illustrate the separating estimators with an empirical application to 21 worldwide financial market indexes.     

Measuring correlations of integrated but not cointegrated variables: A semiparametric approach

Many macroeconomic and financial variables are integrated of order one (or I(1)) processes and are correlated with each other but not necessarily cointegrated. In this paper, we propose to use a semiparametric varying coefficient approach to model/capture such correlations. We propose two consistent estimators to study the dependence relationship among some integrated but not cointegrated time series variables. Simulations are used to examine the finite sample performances of the proposed estimators.     

Smooth estimators for estimating order restricted scale parameters of two gamma distributions

We consider the problem of component-wise estimation of ordered scale parameters of two gamma populations, when it is known apriori which population corresponds to each ordered parameter. Under the scale equivariant squared error loss function, smooth estimators that improve upon the best scale equivariant estimators are derived. These smooth estimators are shown to be generalized Bayes with respect to a non-informative prior. Finally, using Monte Carlo simulations, these improved smooth estimators are compared with the best scale equivariant estimators, their non-smooth improvements obtained in Vijayasree, Misra & Singh (1995), and the restricted maximum likelihood estimators. Acknowledgments. Authors are thankful to a referee for suggestions leading to improved presentation.     

Residual‐based IV estimation of dynamic panel data models with fixed effects

In dynamic panel regression, when the variance ratio of individual effects to disturbance is large, the system‐GMM estimator will have large asymptotic variance and poor finite sample performance. To deal with this variance ratio problem, we propose a residual‐based instrumental variables (RIV) estimator, which uses the residual from regressing Δy_i,t?1 on as the instrument for the level equation. The RIV estimator proposed is consistent and asymptotically normal under general assumptions. More importantly, its asymptotic variance is almost unaffected by the variance ratio of individual effects to disturbance. Monte Carlo simulations show that the RIV estimator has better finite sample performance compared to alternative estimators. The RIV estimator generates less finite sample bias than difference‐GMM, system‐GMM, collapsing‐GMM and Level‐IV estimators in most cases. Under RIV estimation, the variance ratio problem is well controlled, and the empirical distribution of its t‐statistic is similar to the standard normal distribution for moderate sample sizes.