Optimal designs for models with block-block resp. treatment-treatment correlations

Summary In this paper we study optimal designs assuming two special covariance structures of the observations, namely that the covariance between the observations depends only on the blocks resp. the treatments. We show that the weighted least squares estimator equals the ordinary least squares estimator. Then we prove that block-block correlations resp. treatment-treatment correlations do not have any influence on the A- and MV-optimality resp. A-optimality. For the study of the MV-optimality in the case of treatment-treatment correlations we use the idea of invariance to find optimal C-matrices.     

Efficiency of the OLSE for regressions on two-dimensional grids with sinusoidal regressors and spatially correlated errors

For spatial regressions with sinusoidal surfaces, the ordinary least squares estimator (OLSE) is shown to be asymptotically as efficient as the generalized least squares estimator (GLSE) in that the covariance matrices of the two estimators have the same nontrivial limit under the same normalization.     

Bootstrap HAC Tests for Ordinary Least Squares Regression*

There is a need for tests that are derived from the ordinary least squares (OLS) estimators of regression coefficients and are useful in the presence of unspecified forms of heteroskedasticity and autocorrelation. A method that uses the moving block bootstrap and quasi‐estimators in order to derive a consistent estimator of the asymptotic covariance matrix for the OLS estimators and robust significance tests is proposed. The method is shown to be asymptotically valid and Monte Carlo evidence indicates that it is capable of providing good control of significance levels in finite samples and good power compared with two other bootstrap tests.     

A heteroscedasticity-consistent covariance matrix estimator for time series regressions

This paper provides a covariance matrix estimator for the ordinary least squares coefficients of a linear time series model which is consistent even when the disturbances are heteroscedastic. This estimator does not require a formal model of the heteroscedasticity. One can also obtain a direct test of heteroscedasticity, although Monte Carlo experiments show that it may have low power.     

Small sample corrections for LTS and MCD

The least trimmed squares estimator and the minimum covariance determinant estimator [6] are frequently used robust estimators of regression and of location and scatter. Consistency factors can be computed for both methods to make the estimators consistent at the normal model. However, for small data sets these factors do not make the estimator unbiased. Based on simulation studies we therefore construct formulas which allow us to compute small sample correction factors for all sample sizes and dimensions without having to carry out any new simulations. We give some examples to illustrate the effect of the correction factor.     

Optimality of least squares in the seemingly unrelated regression equation model

In this article the authors have investigated the situations in which the single-equation least squares estimator is identical with the generalized least squares estimator in the seemingly unrelated regression model. The condition obtained turned out to be advantageous from an empirical point of view as it permits one to decide whether to go for a single-equation least squares method or Zellner's method with estimated disturbance variance covariance matrix for estimating the coefficients in the model.     

Optimal versus orthogonal and equivalent-estimation design of blocked and split-plot experiments

This article provides an overview of the recent literature on the design of blocked and split-plot experiments with quantitative experimental variables. A detailed literature study introduces the ongoing debate between an optimal design approach to constructing blocked and split-plot designs and approaches where the equivalence of ordinary least squares and generalized least squares estimates are envisaged. Examples where the competing design strategies lead to totally different designs are given, as well as examples in which the optimal experimental designs are orthogonally blocked or equivalent-estimation split-plot designs.     

The asymptotic behaviour of the estimated generalized least squares method in the linear regression model

Abstract  In the linear regression model the generalized least squares (GLS) method is only applicable if the covariance matrix of the errors is known but for a scalar factor. Otherwise an estimator for this matrix has to be used. Then we speak of the estimated generalized least squares (EGLS) method. In this paper the asymptotic behaviour of both methods is compared. Results are applied to some standard models commonly used in econometrics     

Determination of Discrete Spectrum in a Random Field

We consider a two dimensional frequency model in a random field, which can be used to model textures and also has wide applications in Statistical Signal Processing. First we consider the usual least squares estimators and obtain the consistency and the asymptotic distribution of the least squares estimators. Next we consider an estimator, which can be obtained by maximizing the periodogram function. It is observed that the least squares estimators and the estimators obtained by maximizing the periodogram function are asymptotically equivalent. Some numerical experiments are performed to see how the results work for finite samples. We apply our results on simulated textures to observe how the different estimators perform in estimating the true textures from a noisy data.     

Heteroskedasticity-consistent covariance matrix estimators for spatial autoregressive models

In the presence of heteroskedasticity, conventional test statistics based on the ordinary least squares (OLS) estimator lead to incorrect inference results for the linear regression model. Given that heteroskedasticity is common in cross-sectional data, the test statistics based on various forms of heteroskedasticity-consistent covariance matrices (HCCMs) have been developed in the literature. In contrast to the standard linear regression model, heteroskedasticity is a more serious problem for spatial econometric models, generally causing inconsistent extremum estimators of model coefficients. This paper investigates the finite sample properties of the heteroskedasticity-robust generalized method of moments estimator (RGMME) for a spatial econometric model with an unknown form of heteroskedasticity. In particular, it develops various HCCM-type corrections to improve the finite sample properties of the RGMME and the conventional Wald test. The Monte Carlo results indicate that the HCCM-type corrections can produce more accurate results for inference on model parameters and the impact effects estimates in small samples.     

Fixed Effects and Random Effects Estimation of Higher-order Spatial Autoregressive Models with Spatial Autoregressive and Heteroscedastic Disturbances

Abstract

This paper develops a unified framework for fixed effects (FE) and random effects (RE) estimation of higher-order spatial autoregressive panel data models with spatial autoregressive disturbances and heteroscedasticity of unknown form in the idiosyncratic error component. We derive the moment conditions and optimal weighting matrix without distributional assumptions for a generalized moments (GM) estimation procedure of the spatial autoregressive parameters of the disturbance process and define both an RE and an FE spatial generalized two-stage least squares estimator for the regression parameters of the model. We prove consistency of the proposed estimators and derive their joint asymptotic distribution, which is robust to heteroscedasticity of unknown form in the idiosyncratic error component. Finally, we derive a robust Hausman test of the spatial random against the spatial FE model.     

A distribution-free least squares estimator for censored linear regression models

This paper describes a method for estimating simultaneously the parameter vector of the systematic component and the distribution function of the random component of a censored linear regression model. The estimator is obtained by minimizing the sum of the squares of the differences between the observed values of the dependent variable and the corresponding expected values of this variable according to the estimated parameter vector and distribution function. The resulting least squares parameter estimator incorporates information on the distribution of the random component of the regression model that is available from the estimation sample. Hence, it may often be more efficient than are parameter estimators that do not use such information. The results of numerical experiments with the least squares estimator tend to support this hypothesis.     

Robust estimation for structural spurious regressions and a Hausman-type cointegration test

This paper analyzes an approach to correcting spurious regressions involving unit-root nonstationary variables by generalized least squares (GLS) using asymptotic theory. This analysis leads to a new robust estimator and a new test for dynamic regressions. The robust estimator is consistent for structural parameters not just when the regression error is stationary but also when it is unit-root nonstationary under certain conditions. We also develop a Hausman-type test for the null hypothesis of cointegration for dynamic ordinary least squares (OLS) estimation. We demonstrate our estimation and testing methods in three applications: (i) long-run money demand in the U.S., (ii) output convergence among industrial and developing countries, and (iii) purchasing power parity (PPP) for traded and non-traded goods.     

Estimation and optimal designs for linear Haar-wavelet models

This paper gives an analytical expression for the best linear unbiased estimator (BLUE) of the unknown parameters in the linear Haar-wavelet model. From the analytical expression, we solve for the eigenvalues of the covariance matrix of the BLUE in analytical form. Further, we use these eigenvalues to construct some conventional discrete optimal designs for the model. The equivalences among these optimal designs are demonstrated and some examples are also given.      

Semiparametric robust estimation of truncated and censored regression models

Many estimation methods of truncated and censored regression models such as the maximum likelihood and symmetrically censored least squares (SCLS) are sensitive to outliers and data contamination as we document. Therefore, we propose a semiparametric general trimmed estimator (GTE) of truncated and censored regression, which is highly robust but relatively imprecise. To improve its performance, we also propose data-adaptive and one-step trimmed estimators. We derive the robust and asymptotic properties of all proposed estimators and show that the one-step estimators (e.g., one-step SCLS) are as robust as GTE and are asymptotically equivalent to the original estimator (e.g., SCLS). The finite-sample properties of existing and proposed estimators are studied by means of Monte Carlo simulations.     

On the relative efficiency of estimators which include the initial observations in the estimation of seemingly unrelated regressions with first-order autoregressive disturbances

The generalized least squares estimator for a seemingly unrelated regressions model with first-order vector autoregressive disturbances is outlined, and its efficiency is compared with that of an approximate generalized least squares estimator which ignores the first observation. A scalar index for the loss of efficiency is developed and applied to a special case where the matrix of autoregressive parameters is diagonal and the regressors are smooth. Also, for a more general model, a Monte Carlo study is used to investigate the relative efficiencies of various estimators. The results suggest that Maeshiro (1980) has overstated the case for the exact generalized least squares estimator, because, in many circumstances, it is only marginally better than the approximate generalized least squares estimator.     

Mean estimation bias in least squares estimation of autoregressive processes

Estimation of the parameters of an autoregressive process with a mean that is a function of time is considered. Approximate expressions for the bias of the least squares estimator of the autoregressive parameters that is due to estimating the unknown mean function are derived. For the case of a mean function that is a polynomial in time, a reparameterization that isolates the bias is given. Using the approximate expressions, a method of modifying the least squares estimator is proposed. A Monte Carlo study of the second-order autoregressive process is presented. The Monte Carlo results agree well with the approximate theory and, generally speaking, the modified least squares estimators performed better than the least squares estimator. For the second-order process we also considered the empirical properties of the estimated generalized least squares estimator of the mean function and the error made in predicting the process one, two and three periods in the future.     

Fully modified semiparametric GLS estimation for regressions with nonstationary seasonal regressors

Regression models with seasonally integrated and possibly endogenous regressors and serially correlated regression errors are studied. Spectral decompositions of generalized sums of cross products of regressors and regression errors are used to develop a feasible generalized least squares estimator (FGLSE) which does not require parametric specifications for error processes. Using the FGLSE and following the spirit of “Fully Modified estimation” of Phillips and Hansen (Rev. Econ. Stud. 57 (1990) 99), a fully modified GLSE (FM-GLSE) and inference procedures are constructed. The distribution of the FM-GLSE is shown to be asymptotically a mixed normal distribution which validates standard inference based on the FM-GLSE with normal theory. A Monte-Carlo simulation shows that the FM-GLSE is more efficient than the ordinary least squares estimator (OLSE) in the cases of endogeneity or serial correlation and more efficient than the FM-estimator based on the OLSE in the case of serial correlation.     

Robust explicit estimators of Weibull parameters

The Weibull distribution plays a central role in modeling duration data. Its maximum likelihood estimator is very sensitive to outliers. We propose three robust and explicit Weibull parameter estimators: the quantile least squares, the repeated median and the median/Q _n estimator. We derive their breakdown point, influence function, asymptotic variance and study their finite sample properties in a Monte Carlo study. The methods are illustrated on real lifetime data affected by a recording error.     

A consistent estimator in general functional errors-in-variables models

The problem of estimation in nonlinear functional errors-in-variables model is considered. A modified least squares estimator is studied, its consistency and asymptotic normality is established. Simulation results are also presented showing the performance of the estimator in comparison with the naive ordinary least squares estimator. Received: June 1999