Estimation for spatial dynamic panel data with fixed effects: The case of spatial cointegration

Yu et al. (2008) establish asymptotic properties of quasi-maximum likelihood estimators for a stable spatial dynamic panel model with fixed effects when both the number of individuals n and the number of time periods T are large. This paper investigates unstable cases where there are unit roots generated by temporal and spatial correlations. We focus on the spatial cointegration model where some eigenvalues of the data generating process are equal to 1 and the outcomes of spatial units are cointegrated as in a vector autoregressive system. The asymptotics of the QML estimators are developed by reparameterization, and bias correction for the estimators is proposed. We also consider the 2SLS and GMM estimations when T could be small.     

On the asymptotic optimality of the LIML estimator with possibly many instruments

We consider the estimation of the coefficients of a linear structural equation in a simultaneous equation system when there are many instrumental variables. We derive some asymptotic properties of the limited information maximum likelihood (LIML) estimator when the number of instruments is large; some of these results are new as well as old, and we relate them to results in some recent studies. We have found that the variance of the limiting distribution of the LIML estimator and its modifications often attain the asymptotic lower bound when the number of instruments is large and the disturbance terms are not necessarily normally distributed, that is, for the micro-econometric models of some cases recently called many instruments and many weak instruments.     

On finite sample properties of alternative estimators of coefficients in a structural equation with many instruments

We compare four different estimation methods for the coefficients of a linear structural equation with instrumental variables. As the classical methods we consider the limited information maximum likelihood (LIML) estimator and the two-stage least squares (TSLS) estimator, and as the semi-parametric estimation methods we consider the maximum empirical likelihood (MEL) estimator and the generalized method of moments (GMM) (or the estimating equation) estimator. Tables and figures of the distribution functions of four estimators are given for enough values of the parameters to cover most linear models of interest and we include some heteroscedastic cases and nonlinear cases. We have found that the LIML estimator has good performance in terms of the bounded loss functions and probabilities when the number of instruments is large, that is, the micro-econometric models with “many instruments” in the terminology of recent econometric literature.     

Efficient estimation and inference in linear pseudo-panel data models

We consider pseudo-panel data models constructed from repeated cross sections in which the number of individuals per group is large relative to the number of groups and time periods. First, we show that, when time-invariant group fixed effects are neglected, the OLS estimator does not converge in probability to a constant but rather to a random variable. Second, we show that, while the fixed-effects (FE) estimator is consistent, the usual t statistic is not asymptotically normally distributed, and we propose a new robust t statistic whose asymptotic distribution is standard normal. Third, we propose efficient GMM estimators using the orthogonality conditions implied by grouping and we provide t tests that are valid even in the presence of time-invariant group effects. Our Monte Carlo results show that the proposed GMM estimator is more precise than the FE estimator and that our new t test has good size and is powerful.     

Examining bias in estimators of linear rational expectations models under misspecification

Most rational expectations models involve equations in which the dependent variable is a function of its lags and its expected future value. We investigate the asymptotic bias of generalized method of moment (GMM) and maximum likelihood (ML) estimators in such models under misspecification. We consider several misspecifications, and focus more specifically on the case of omitted dynamics in the dependent variable. In a stylized DGP, we derive analytically the asymptotic biases of these estimators. We establish that in many cases of interest the two estimators of the degree of forward-lookingness are asymptotically biased in opposite direction with respect to the true value of the parameter. We also propose a quasi-Hausman test of misspecification based on the difference between the GMM and ML estimators. Using Monte-Carlo simulations, we show that the ordering and direction of the estimators still hold in a more realistic New Keynesian macroeconomic model. In this set-up, misspecification is in general found to be more harmful to GMM than to ML estimators.     

Performance of conditional Wald tests in IV regression with weak instruments

We compare the powers of five tests of the coefficient on a single endogenous regressor in instrumental variables regression. Following Moreira [2003, A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048], all tests are implemented using critical values that depend on a statistic which is sufficient under the null hypothesis for the (unknown) concentration parameter, so these conditional tests are asymptotically valid under weak instrument asymptotics. Four of the tests are based on k-class Wald statistics (two-stage least squares, LIML, Fuller's [Some properties of a modification of the limited information estimator. Econometrica 45, 939–953], and bias-adjusted TSLS); the fifth is Moreira's (2003) conditional likelihood ratio (CLR) test. The heretofore unstudied conditional Wald (CW) tests are found to perform poorly, compared to the CLR test: in many cases, the CW tests have almost no power against a wide range of alternatives. Our analysis is facilitated by a new algorithm, presented here, for the computation of the asymptotic conditional p-value of the CLR test.     

Bias Reduction in Dynamic Panel Data Models by Common Recursive Mean Adjustment*

The within‐group estimator (same as the least squares dummy variable estimator) of the dominant root in dynamic panel regression is known to be biased downwards. This article studies recursive mean adjustment (RMA) as a strategy to reduce this bias for AR(p) processes that may exhibit cross‐sectional dependence. Asymptotic properties for N,T→∞ jointly are developed. When ( log ²T)(N/T)→ζ, where ζ is a non‐zero constant, the estimator exhibits nearly negligible inconsistency. Simulation experiments demonstrate that the RMA estimator performs well in terms of reducing bias, variance and mean square error both when error terms are cross‐sectionally independent and when they are not. RMA dominates comparable estimators when T is small and/or when the underlying process is persistent.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

Generalized empirical likelihood tests in time series models with potential identification failure

We introduce test statistics based on generalized empirical likelihood methods that can be used to test simple hypotheses involving the unknown parameter vector in moment condition time series models. The test statistics generalize those in Guggenberger and Smith [2005. Generalized empirical likelihood estimators and tests under partial, weak and strong identification. Econometric Theory 21 (4), 667–709] from the i.i.d. to the time series context and are alternatives to those in Kleibergen [2005a. Testing parameters in GMM without assuming that they are identified. Econometrica 73 (4), 1103–1123] and Otsu [2006. Generalized empirical likelihood inference for nonlinear and time series models under weak identification. Econometric Theory 22 (3), 513–527]. The main feature of these tests is that their empirical null rejection probabilities are not affected much by the strength or weakness of identification. More precisely, we show that the statistics are asymptotically distributed as chi-square under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright [2000. GMM with weak identification. Econometrica 68 (5), 1055–1096]. We also introduce a modification to Otsu's (2006) statistic that is computationally more attractive. A Monte Carlo study reveals that the finite-sample performance of the suggested tests is very competitive.     

Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables

Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578] and Ai and Chen [2003. Efficient estimation of conditional moment restrictions models containing unknown functions. Econometrica 71, 1795–1843] propose sieve minimum distance (SMD) estimation of both finite dimensional parameter (θ)$(\theta )$ and infinite dimensional parameter (h) that are identified through a conditional moment restriction model, in which h could depend on endogenous variables. This paper modifies their SMD procedure to allow for different conditioning variables to be used in different equations, and derives the asymptotic properties when the model may be misspecified  . Under low-level sufficient conditions, we show that: (i) the modified SMD estimators of both θ$\theta$ and h   converge to some pseudo-true values in probability; (ii) the SMD estimators of smooth functionals, including the θ$\theta$ estimator and the average derivative estimator, are asymptotically normally distributed; and (iii) the estimators for the asymptotic covariances of the SMD estimators of smooth functionals are consistent and easy to compute. These results allow for asymptotically valid tests of various hypotheses on the smooth functionals regardless of whether the semiparametric model is correctly specified or not.     

Estimation of spatial autoregressive panel data models with fixed effects

This paper establishes asymptotic properties of quasi-maximum likelihood estimators for SAR panel data models with fixed effects and SAR disturbances. A direct approach is to estimate all the parameters including the fixed effects. Because of the incidental parameter problem, some parameter estimators may be inconsistent or their distributions are not properly centered. We propose an alternative estimation method based on transformation which yields consistent estimators with properly centered distributions. For the model with individual effects only, the direct approach does not yield a consistent estimator of the variance parameter unless T is large, but the estimators for other common parameters are the same as those of the transformation approach. We also consider the estimation of the model with both individual and time effects.     

Bias in dynamic panel estimation with fixed effects,incidental trends and cross section dependence

Explicit asymptotic bias formulae are given for dynamic panel regression estimators as the cross section sample size N→∞$N\to \infty$. The results extend earlier work by Nickell [1981. Biases in dynamic models with fixed effects. Econometrica 49, 1417–1426] and later authors in several directions that are relevant for practical work, including models with unit roots, deterministic trends, predetermined and exogenous regressors, and errors that may be cross sectionally dependent. The asymptotic bias is found to be so large when incidental linear trends are fitted and the time series sample size is small that it changes the sign of the autoregressive coefficient. Another finding of interest is that, when there is cross section error dependence, the probability limit of the dynamic panel regression estimator is a random variable rather than a constant, which helps to explain the substantial variability observed in dynamic panel estimates when there is cross section dependence even in situations where N is very large. Some proposals for bias correction are suggested and finite sample performance is analyzed in simulations.     

Simultaneous selection and weighting of moments in GMM using a trapezoidal kernel

This paper proposes a novel procedure to estimate linear models when the number of instruments is large. At the heart of such models is the need to balance the trade off between attaining asymptotic efficiency, which requires more instruments, and minimizing bias, which is adversely affected by the addition of instruments. Two questions are of central concern: (1) What is the optimal number of instruments to use? (2) Should the instruments receive different weights? This paper contains the following contributions toward resolving these issues. First, I propose a kernel weighted generalized method of moments (GMM) estimator that uses a trapezoidal kernel. This kernel turns out to be attractive to select and weight the number of moments. Second, I derive the higher order mean squared error of the kernel weighted GMM estimator and show that the trapezoidal kernel generates a lower asymptotic variance than regular kernels. Finally, Monte Carlo simulations show that in finite samples the kernel weighted GMM estimator performs on par with other estimators that choose optimal instruments and improves upon a GMM estimator that uses all instruments.     

Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction

We provide analytical formulae for the asymptotic bias (ABIAS) and mean-squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. Our analytical formulae can be viewed as generalizing the bias and MSE results of [Richardson and Wu 1971. A note on the comparison of ordinary and two-stage least squares estimators. Econometrica 39, 973–982] to the case with nonnormal errors and stochastic instruments. Our approximations are shown to compare favorably with approximations due to [Morimune 1983. Approximate distributions of k$k$-class estimators when the degree of overidentifiability is large compared with the sample size. Econometrica 51, 821–841] and [Donald and Newey 2001. Choosing the number of instruments. Econometrica 69, 1161–1191], particularly when the instruments are weak. We also construct consistent estimators for the ABIAS and AMSE, and we use these to further construct a number of bias corrected OLS and IV estimators, the properties of which are examined both analytically and via a series of Monte Carlo experiments.     

GMM and 2SLS estimation of mixed regressive,spatial autoregressive models

The GMM method and the classical 2SLS method are considered for the estimation of mixed regressive, spatial autoregressive models. These methods have computational advantage over the conventional maximum likelihood method. The proposed GMM estimators are shown to be consistent and asymptotically normal. Within certain classes of GMM estimators, best ones are derived. The proposed GMM estimators improve upon the 2SLS estimators and are applicable even if all regressors are irrelevant. A best GMM estimator may have the same limiting distribution as the ML estimator (with normal disturbances).     

Asymptotic distribution of the cointegrating vector estimator in error correction models with conditional heteroskedasticity

This paper explores the asymptotic distribution of the cointegrating vector estimator in error correction models with conditionally heteroskedastic errors. Asymptotic properties of the maximum likelihood estimator (MLE) of the cointegrating vector, which estimates the cointegrating vector and the multivariate GARCH process jointly, are provided. The MLE of the cointegrating vector follows mixture normal, and its asymptotic distribution depends on the conditional heteroskedasticity and the kurtosis of standardized innovations. The reduced rank regression (RRR) estimator and the regression-based cointegrating vector estimators do not consider conditional heteroskedasticity, and thus the efficiency gain of the MLE emerges as the magnitude of conditional heteroskedasticity increases. The simulation results indicate that the relative power of the t-statistics based on the MLE improves significantly as the GARCH effect increases.     

Asymptotics of the principal components estimator of large factor models with weakly influential factors

This paper introduces a drifting-parameter asymptotic framework to derive accurate approximations to the finite sample distribution of the principal components (PC) estimator in situations when the factors’ explanatory power does not strongly dominate the explanatory power of the cross-sectionally and temporally correlated idiosyncratic terms. Under our asymptotics, the PC estimator is inconsistent. We find explicit formulae for the amount of the inconsistency, and propose an estimator of the number of factors for which the PC estimator works reasonably well. For the special case when the idiosyncratic terms are cross-sectionally but not temporally correlated (or vice versa), we show that the coefficients in the OLS regressions of the PC estimates of factors (loadings) on the true factors (true loadings) are asymptotically normal, and find explicit formulae for the corresponding asymptotic covariance matrix. We explain how to estimate the parameters of the derived asymptotic distributions. Our Monte Carlo analysis suggests that our asymptotic formulae and estimators work well even for relatively small n$n$ and T$T$. We apply our theoretical results to test a hypothesis about the factor content of the US stock return data.     

Empirical likelihood block bootstrapping

Monte Carlo evidence has made it clear that asymptotic tests based on generalized method of moments (GMM) estimation have disappointing size. The problem is exacerbated when the moment conditions are serially correlated. Several block bootstrap techniques have been proposed to correct the problem, including Hall and Horowitz (1996) and Inoue and Shintani (2006). We propose an empirical likelihood block bootstrap procedure to improve inference where models are characterized by nonlinear moment conditions that are serially correlated of possibly infinite order. Combining the ideas of Kitamura (1997) and Brown and Newey (2002), the parameters of a model are initially estimated by GMM which are then used to compute the empirical likelihood probability weights of the blocks of moment conditions. The probability weights serve as the multinomial distribution used in resampling. The first-order asymptotic validity of the proposed procedure is proven, and a series of Monte Carlo experiments show it may improve test sizes over conventional block bootstrapping.