Weaker MSE criteria and tests for linear restrictions in regression models with non-spherical disturbances

This paper extend, in an asymptotic sense, the strong and the weaker mean square error criteria and corresponding tests to linear models with non-spherical disturbances where the error covariance matrix is unknown but a consistent estimator for it is available. The mean square error tests of Toro-Vizcorrondo and Wallace (1968) and Wallace (1972) test for the superiority of restricted over unrestricted linear estimators in a least squares context. This generalization of these tests makes them available for use with GLS, Zellner's SUR, 2SLS, 3SLS, tests of over identification, and so forth.     

IV估计的最优工具变量选取方法

IV估计的有限样本性质对工具变量的选取十分敏感,尤其是存在弱工具变量的情形。本文在Donald和Newey(2001)的基础上研究了常用的IV估计———2SLS的最优工具变量选取方法。首先通过对2SLS估计量进行Nagar分解,从理论上推导出估计量的近似MSE表达式;根据这一表达式,提出IV估计的最优工具变量选取准则,并证明选取准则的渐近有效性。模拟结果表明,本文提出的工具变量选取准则能够极大地改善2SLS估计量的有限样本表现。本研究为实证中面临的工具变量选择问题提供了理论依据。     

The generalized ridge estimator and improved adjustments for regression parameters

Summary The generalized ridge estimator, which considers generalizations of mean square error, is presented, and a mathematical rule of determining the optimalk-value is discussed. The generalized ridge estimator is examined in comparison with the least squares, the pseudoinverse, theJames-Stein-type shrinkage, and the principal component estimators, especially focusing their attention on improved adjustments for regression coefficients. An alternative estimation approach that better integrates a priori information is noted. Finally, combining the generalized ridge and robust regression methods is suggested.     

The second-order bias and mean squared error of estimators in time-series models

We develop analytical results on the second-order bias and mean squared error of estimators in time-series models. These results provide a unified approach to developing the properties of a large class of estimators in linear and nonlinear time-series models and they are valid for both normal and nonnormal samples of observations, and where the regressors are stochastic. The estimators included are the generalized method of moments, maximum likelihood, least squares, and other extremum estimators. Our general results are applied to four time-series models. We investigate the effects of nonnormality on the second-order bias results for two of these models, while for all four models, the second-order bias and mean squared error results are given under normality. Numerical results for some of these models are also presented.     

Mean estimation bias in least squares estimation of autoregressive processes

Estimation of the parameters of an autoregressive process with a mean that is a function of time is considered. Approximate expressions for the bias of the least squares estimator of the autoregressive parameters that is due to estimating the unknown mean function are derived. For the case of a mean function that is a polynomial in time, a reparameterization that isolates the bias is given. Using the approximate expressions, a method of modifying the least squares estimator is proposed. A Monte Carlo study of the second-order autoregressive process is presented. The Monte Carlo results agree well with the approximate theory and, generally speaking, the modified least squares estimators performed better than the least squares estimator. For the second-order process we also considered the empirical properties of the estimated generalized least squares estimator of the mean function and the error made in predicting the process one, two and three periods in the future.     

Partially generalized least squares and two-stage least squares estimators

A class of partially generalized least squares estimators and a class of partially generalized two-stage least squares estimators in regression models with heteroscedastic errors are proposed. By using these estimators a researcher can attain higher efficiency than that attained by the least squares or the two-stage least squares estimators without explicitly estimating each component of the heteroscedastic variances. However, the efficiency is not as high as that of the generalized least squares or the generalized two-stage least squares estimator calculated using the knowledge of the true variances. Hence the use of the term partial.     

A note on amemiya's partially generalized least squares

This note explores the relationship between the generalized least squares estimator and Amemiya's partially generalized least squares estimator and establishes the conditions under which the two estimators are equal.     

An unexpected property of minimax estimation in the relative squared error approach to linear regression analysis

An unexpected property of the relative squared error approach to linear regression analysis is derived: It is shown that an estimator being minimax among all linear affine estimators is also minimax in the set of all estimators. Two illustrative special cases are mentioned, where a generalized least squares estimator and a general ridge or Kuks-Olman estimator turn out to be minimax.     

An application of approximate finite sample results to parameter estimation in a linear errors-in-variables model

In the simple errors-in-variables model the least squares estimator of the slope coefficient is known to be biased towards zero for finite sample size as well as asymptotically. In this paper we suggest a new corrected least squares estimator, where the bias correction is based on approximating the finite sample bias by a lower bound. This estimator is computationally very simple. It is compared with previously proposed corrected least squares estimators, where the correction aims at removing the asymptotic bias or the exact finite sample bias. For each type of corrected least squares estimators we consider the theoretical form, which depends on an unknown parameter, as well as various feasible forms. An analytical comparison of the theoretical estimators is complemented by a Monte Carlo study evaluating the performance of the feasible estimators. The new estimator proposed in this paper proves to be superior with respect to the mean squared error.     

Efficiency of the OLSE for regressions on two-dimensional grids with sinusoidal regressors and spatially correlated errors

For spatial regressions with sinusoidal surfaces, the ordinary least squares estimator (OLSE) is shown to be asymptotically as efficient as the generalized least squares estimator (GLSE) in that the covariance matrices of the two estimators have the same nontrivial limit under the same normalization.     

Panel data models with spatially correlated error components

In this paper we consider a panel data model with error components that are both spatially and time-wise correlated. The model blends specifications typically considered in the spatial literature with those considered in the error components literature. We introduce generalizations of the generalized moments estimators suggested in Kelejian and Prucha (1999. A generalized moments estimator for the autoregressive parameter in a spatial model. International Economic Review 40, 509–533) for estimating the spatial autoregressive parameter and the variance components of the disturbance process. We then use those estimators to define a feasible generalized least squares procedure for the regression parameters. We give formal large sample results for the proposed estimators. We emphasize that our estimators remain computationally feasible even in large samples.     

Finite sample properties of estimators for autoregressive moving average models

We analyze by simulation the properties of three estimators frequently used in the analysis of autoregressive moving average time series models for both nonseasonal and seasonal data. The estimators considered are exact maximum likelihood, exact least squares and conditional least squares. For samples of the size commonly found in economic applications, the estimators are compared in terms of bias, mean squared error, and predictive ability. The reliability of the usually calculated confidence intervals is assessed for the maximum likelihood estimator.     

Preliminary test Liu estimators based on the conflicting W,LR and LM tests in a regression model with multivariate Student-<Emphasis Type="Italic">t</Emphasis> error

In this paper, the problem of estimation of the regression coefficients in a multiple regression model with multivariate Student-t error is considered under the multicollinearity situation when it is suspected that the regression coefficients may be restricted to a linear manifold. The preliminary test Liu estimators (PTLE) based on the Wald, Likelihood ratio (LR) and Lagrangian multiplier (LM) tests are given. The bias and mean square error (MSE) of the proposed estimators are derived and conditions of superiority of these estimators are provided. In particular, we show that in the neighborhood of the null hypothesis, the PTLE based on the LM test has the best performance followed by the estimators based on LR and W tests, while the situation is reversed when the parameter moves away from the manifold of the restriction. Furthermore, the optimum choice of the level of significance is also discussed.     

On the relative efficiency of estimators which include the initial observations in the estimation of seemingly unrelated regressions with first-order autoregressive disturbances

The generalized least squares estimator for a seemingly unrelated regressions model with first-order vector autoregressive disturbances is outlined, and its efficiency is compared with that of an approximate generalized least squares estimator which ignores the first observation. A scalar index for the loss of efficiency is developed and applied to a special case where the matrix of autoregressive parameters is diagonal and the regressors are smooth. Also, for a more general model, a Monte Carlo study is used to investigate the relative efficiencies of various estimators. The results suggest that Maeshiro (1980) has overstated the case for the exact generalized least squares estimator, because, in many circumstances, it is only marginally better than the approximate generalized least squares estimator.     

Weighted least squares estimators in possibly misspecified nonlinear regression

The behavior of estimators for misspecified parametric models has been well studied. We consider estimators for misspecified nonlinear regression models, with error and covariates possibly dependent. These models are described by specifying a parametric model for the conditional expectation of the response given the covariates. This is a parametric family of conditional constraints, which makes the model itself close to nonparametric. We study the behavior of weighted least squares estimators both when the regression function is correctly specified, and when it is misspecified and also involves possible additional covariates.     

The effects of dynamic feedbacks on LS and MM estimator accuracy in panel data models

The finite sample behavior is analyzed of particular least squares (LS) and a range of (generalized) method of moments (MM) estimators in panel data models with individual effects and both a lagged dependent variable regressor and another explanatory variable. The latter may be affected by lagged feedbacks from the dependent variable too. Asymptotic expansions indicate how the order of magnitude of bias of MM estimators tends to increase with the number of moment conditions exploited. They also provide analytic evidence on how the bias of the various estimators depends on the feedbacks and on other model characteristics such as prominence of individual effects and correlation between observed and unobserved heterogeneity. Simulation results corroborate the theoretical findings and reveal that in small samples of models with dynamic feedbacks none of the techniques examined dominates regarding bias and mean squared error over all parametrizations examined.     

Small sample properties of the mixed regression estimator

In this paper, the small sample properties of the mixed regression estimator are examined when prior information may be biased and when the ration of the variance of the prior restriction errors to the variance of the sample errors is unknown. The mean square error of the mixed regression estimator is derived, and it is shown that the mixed regression estimator gets dominated by the ordinary least squares estimator in terms of the mean square error as the bias of prior information gets larger.     

Control variate method for stationary processes

The sample mean is one of the most natural estimators of the population mean based on independent identically distributed sample. However, if some control variate is available, it is known that the control variate method reduces the variance of the sample mean. The control variate method often assumes that the variable of interest and the control variable are i.i.d. Here we assume that these variables are stationary processes with spectral density matrices, i.e. dependent. Then we propose an estimator of the mean of the stationary process of interest by using control variate method based on nonparametric spectral estimator. It is shown that this estimator improves the sample mean in the sense of mean square error. Also this analysis is extended to the case when the mean dynamics is of the form of regression. Then we propose a control variate estimator for the regression coefficients which improves the least squares estimator (LSE). Numerical studies will be given to see how our estimator improves the LSE.     

A note on least squares estimation and the blue in a generalized linear regression model

In a generalized linear regression model, least squares and Gauss-Markov estimators differ, in general, if the variance-covariance matrix of the disturbances is singular. In the present note it is shown that, nevertheless, the conventional least squares procedure leads to a Gauss-Markov estimator if it is applied to a modified model which results from adding dummy constraints to the original model. These constraints reflect the effects of the singularity of the variance- convariance matrix. As a consequence, a Gauss-Markov estimate may always be obtained by standard least squares minimization, which offers considerable computational advantages.     

Single-equation estimators and aggregation restrictions when equations have the same sets of regressors

It is well known that linear equations subject to cross-equation aggregation restrictions can be ‘stacked’ and estimated simultaneously. However, if every equation contains the same set of regressors, a number of single-equation estimation procedures can be employed. The applicability of ordinary least squares is widely recognized but the article demonstrates that the class of applicable estimators is much broaders than OLS. Under specified conditions, the class includes instrumental variables, generalized least squares, ridge regression, two-stage least squares, k-class estimators, and indirect least squares. Transformations of the original equations and other related matters are discussed also.