Pre-testing for linear restrictions in a regression model with spherically symmetric disturbances

In this paper we derive the exact risk (under quadratic loss) of pre-test estimators of the prediction vector and of the error variance of a linear regression model with spherically symmetric disturbances. The pre-test in question is one of the validity of a set of exact linear restrictions on the model's coefficient vector. We demonstrate how the known results for the model with normal disturbances can be extended to this broader case. We also show that the critical value of unity results in a minimum of the risk of the pre-test estimator of the error variance. To illustrate the results we assume multivariate Student-t regression disturbances and numerically evaluate the derived expressions.     

A note on a heteroscedastic model

In this article the author considers a regression model where the variance of the error term is a linear combination of certain independent variables and compares four different estimators of the coefficients of this linear combination, They are (1) the estimator proposed by Goldfeld and Quant and called the Modified Glejser Method, (2) the estimator proposed by Hildreth and Houck, (3) the generalized least squares method, and (4) the maximum likelihood estimator. It is shown that the first two are asymptotically not fully efficient whereas the last two are.     

Non-Existence of the First Moment of the Adjusted Least Squares Estimator in Multivariate Errors-in-Variables Model

The linear normal multivariate errors-in-variables model is considered. The model involves an equation error. It is proved in both structural and functional cases that the first moment of the adjusted least squares estimator does not exist.     

A simple estimator for nonlinear error in variable models

We propose a simple estimator for nonlinear method of moment models with measurement error of the classical type when no additional data, such as validation data or double measurements, are available. We assume that the marginal distributions of the measurement errors are Laplace (double exponential) with zero means and unknown variances and the measurement errors are independent of the latent variables and are independent of each other. Under these assumptions, we derive simple revised moment conditions in terms of the observed variables. They are used to make inference about the model parameters and the variance of the measurement error. The results of this paper show that the distributional assumption on the measurement errors can be used to point identify the parameters of interest. Our estimator is a parametric method of moments estimator that uses the revised moment conditions and hence is simple to compute. Our estimation method is particularly useful in situations where no additional data are available, which is the case in many economic data sets. Simulation study demonstrates good finite sample properties of our proposed estimator. We also examine the performance of the estimator in the case where the error distribution is misspecified.     

Efficiency of iterative estimators in the regression model with AR(1) disturbances

The mean square error approximation method of Nagar is applied to the iterated Prais-Winsten and (iterated) maximum likelihood estimators of regression coefficients in the model with AR(1) disturbances. Their mean square errors are found to equal that of the two-stage Prais-Winsten estimator at the second-order level of approximation.     

Finite sample properties of maximum likelihood estimator in spatial models

We investigate the finite sample properties of the maximum likelihood estimator for the spatial autoregressive model. A stochastic expansion of the score function is used to develop the second-order bias and mean squared error of the maximum likelihood estimator. We show that the results can be expressed in terms of the expectations of cross products of quadratic forms, or ratios of quadratic forms in a normal vector which can be evaluated using the top order invariant polynomial. Our numerical calculations demonstrate that the second-order behaviors of the maximum likelihood estimator depend on the degree of sparseness of the weights matrix.     

Second-order properties of estimators of serial correlation from regression residuals

Second-order properties of estimators and tests offer a way of choosinf among aymptotically equivalent procedures. This paper studies the second-order terms of two estimators of serial correlation in the linear model. Using these second-order approximations, the maximum likelihood estimator is judge to be superior in terms of bias and variance. A small Monte Carlo experiment is done to assess the accuracy of the results.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Asymptotics of SIMEX-based variance estimation

In this paper, we study the asymptotic properties of simulation extrapolation (SIMEX) based variance estimation that was proposed by Wang et al. (J R Stat Soc Series B 71:425–445, 2009). We first investigate the asymptotic normality of the parameter estimator in general parametric variance function and the local linear estimator for nonparametric variance function when permutation SIMEX (PSIMEX) is used. The asymptotic optimal bandwidth selection with respect to approximate mean integrated squared error (AMISE) for nonparametric estimator is also studied. We finally discuss constructing confidence intervals/bands of the parameter/function of interest. Other than applying the asymptotic results so that normal approximation can be used, we recommend a nonparametric Monte Carlo algorithm to avoid estimating the asymptotic variance of estimator. Simulation studies are carried out for illustration.     

Mean square error estimation in multi-stage sampling

Summary: Suppose for a homogeneous linear unbiased function of the sampled first stage unit (fsu)-values taken as an estimator of a survey population total, the sampling variance is expressed as a homogeneous quadratic function of the fsu-values. When the fsu-values are not ascertainable but unbiased estimators for them are separately available through sampling in later stages and substituted into the estimator, Raj (1968) gave a simple variance estimator formula for this multi-stage estimator of the population total. He requires that the variances of the estimated fsu-values in sampling at later stages and their unbiased estimators are available in certain `simple forms'. For the same set-up Rao (1975) derived an alternative variance estimator when the later stage sampling variances have more ‘complex forms’. Here we pursue with Raj's (1968) simple forms to derive a few alternative variance and mean square error estimators when the condition of homogeneity or unbiasedness in the original estimator of the total is relaxed and the variance of the original estimator is not expressed as a quadratic form.  We illustrate a particular three-stage sampling strategy and present a simulation-based numerical exercise showing the relative efficacies of two alternative variance estimators. Received: 19 February 1999     

Model assisted survey sampling strategy in two phases

Postulating a super-population regression model connecting a size variable, a cheaply measurable variable and an expensively observable variable of interest, an asymptotically optimal double sampling strategy to estimate the survey population total of the third variable is specified. To render it practicable, unknown model-parameters in the optimal estimator are replaced by appropriate statistics. The resulting generalized regression estimator is then shown to have a model-cum-asymptotic design based expected square error equal to that of the asymptotically optimum estimator itself. An estimator for design variance of the estimator is also proposed.     

Asymptotic distributions of impulse response functions in short panel vector autoregressions

This paper establishes the asymptotic distributions of the impulse response functions in panel vector autoregressions with a fixed time dimension. It also proves the asymptotic validity of a bootstrap approximation to their sampling distributions. The autoregressive parameters are estimated using the GMM estimators based on the first differenced equations and the error variance is estimated using an extended analysis-of-variance type estimator. Contrary to the time series setting, we find that the GMM estimator of the autoregressive coefficients is not asymptotically independent of the error variance estimator. The asymptotic dependence calls for variance correction for the orthogonalized impulse response functions. Simulation results show that the variance correction improves the coverage accuracy of both the asymptotic confidence band and the studentized bootstrap confidence band for the orthogonalized impulse response functions.     

A finite sample correction for the variance of linear efficient two-step GMM estimators

Monte Carlo studies have shown that estimated asymptotic standard errors of the efficient two-step generalized method of moments (GMM) estimator can be severely downward biased in small samples. The weight matrix used in the calculation of the efficient two-step GMM estimator is based on initial consistent parameter estimates. In this paper it is shown that the extra variation due to the presence of these estimated parameters in the weight matrix accounts for much of the difference between the finite sample and the usual asymptotic variance of the two-step GMM estimator, when the moment conditions used are linear in the parameters. This difference can be estimated, resulting in a finite sample corrected estimate of the variance. In a Monte Carlo study of a panel data model it is shown that the corrected variance estimate approximates the finite sample variance well, leading to more accurate inference.     

Simultaneous optimal estimation in linear mixed models

Simultaneous optimal estimation in linear mixed models is considered. A necessary and sufficient condition is presented for the least squares estimator of the fixed effects and the analysis of variance estimator of the variance components to be of uniformly minimum variance simultaneously in a general variance components model. That is, the matrix obtained by orthogonally projecting the covariance matrix onto the orthogonal complement space of the column space of the design matrix is symmetric, each eigenvalue of the matrix is a linear combinations of the variance components and the number of all distinct eigenvalues of the matrix is equal to the the number of the variance components. Under this condition, uniformly optimal unbiased tests and uniformly most accurate unbiased confidence intervals are constructed for the parameters of interest. A necessary and sufficient condition is also given for the equivalence of several common estimators of variance components. Two examples of their application are given.     

Semiparametric Estimator for Binary‐outcome Sample Selection: Prejudice Matters in Election

a semiparametric estimator for binary‐outcome sample‐selection models is proposed that imposes only single index assumptions on the selection and outcome equations without specifying the error term distribution. I adopt the idea in Lewbel (2000) using a ‘special regressor’ to transform the binary response Y so that the transformed Y becomes linear in the latent index, which then makes it possible to remove the selection correction term by differencing the transformed Y equation. There are various versions of the estimator, which perform differently trading off bias and variance. A simulation study is conducted, and then I apply the estimators to US presidential election data in 2008 and 2012 to assess the impact of racial prejudice on the elections, as a black candidate was involved for the first time ever in the US history.     

Two-stage non Gaussian QML estimation of GARCH models and testing the efficiency of the Gaussian QMLE

In generalized autoregressive conditional heteroskedastic (GARCH) models, the standard identifiability assumption that the variance of the iid process is equal to 1 can be replaced by an alternative moment assumption. We show that, for estimating the original specification based on the standard identifiability assumption, efficiency gains can be expected from using a quasi-maximum likelihood (QML) estimator based on a non Gaussian density and a reparameterization based on an alternative identifiability assumption. A test allowing to determine whether a reparameterization is needed, that is, whether the more efficient QMLE is obtained with a non Gaussian density, is proposed.     

Estimators for particulate sampling derived from a multinomial distribution

Counting the number of units is not always practical during the sampling of particulate materials: it is often much easier to sample a fixed volume or fixed mass of particles. Hence, a class of sampling designs is proposed which leads to samples that have approximately a constant mass or a constant volume. For these sampling designs, estimators were derived which are a ratio of arbitrary sample totals. A Taylor expansion was used to obtain a first-order approximation for the expected value and variance in the limit of a large batch-to-sample size ratio. Furthermore, a π -estimator for a ratio of batch totals was found by deriving expressions for the first- and second-order inclusion probabilities. Practical application of the π -estimator is limited because it requires inaccessible batch information. However, when the denominator of the estimated batch ratio is the batch size, the π -estimator becomes equal to a sample total divided by the sample size in the limit of a large sample-to-particle size ratio. As a consequence, the obtained sample ratio becomes an unbiased estimator for the corresponding batch ratio. Retaining unbiasedness, the Horvitz–Thompson estimator for the variance, which also contains inaccessible batch information, is replaced by an estimator containing sample information only. Practical application of this estimator is illustrated for the sampling of slag, produced during the production of steel.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

Self-weighted and local quasi-maximum likelihood estimators for ARMA-GARCH/IGARCH models

The limit distribution of the quasi-maximum likelihood estimator (QMLE) for parameters in the ARMA-GARCH model remains an open problem when the process has infinite 4th moment. We propose a self-weighted QMLE and show that it is consistent and asymptotically normal under only a fractional moment condition. Based on this estimator, the asymptotic normality of the local QMLE is established for the ARMA model with GARCH (finite variance) and IGARCH errors. Using the self-weighted and the local QMLEs, we construct Wald statistics for testing linear restrictions on the parameters, and their limiting distributions are given. In addition, we show that the tail index of the IGARCH process is always 2, which is independently of interest.     

Gamma-minimax estimation of a multivariate normal mean

Summary The mean vector of a multivariate normal distribution is to be estimated. A class Γ of priors is considered which consists of all priors whose vector of first moments and matrix of second moments satisfy some given restrictions. The Γ-minimax estimator under arbitrary squared error loss is characterized. The characterization follows from an application of a result of Browder and Karamardian published in Ichiishi (1983) which is a special version of a minimax inequality due to Ky Fan (1972). In particular, it is shown that within the set of all estimators a linear estimator is Γ-minimax. The authors would like to thank the Deutsche Forschungsgemeinschaft for financial support.