Simultaneous selection and weighting of moments in GMM using a trapezoidal kernel

This paper proposes a novel procedure to estimate linear models when the number of instruments is large. At the heart of such models is the need to balance the trade off between attaining asymptotic efficiency, which requires more instruments, and minimizing bias, which is adversely affected by the addition of instruments. Two questions are of central concern: (1) What is the optimal number of instruments to use? (2) Should the instruments receive different weights? This paper contains the following contributions toward resolving these issues. First, I propose a kernel weighted generalized method of moments (GMM) estimator that uses a trapezoidal kernel. This kernel turns out to be attractive to select and weight the number of moments. Second, I derive the higher order mean squared error of the kernel weighted GMM estimator and show that the trapezoidal kernel generates a lower asymptotic variance than regular kernels. Finally, Monte Carlo simulations show that in finite samples the kernel weighted GMM estimator performs on par with other estimators that choose optimal instruments and improves upon a GMM estimator that uses all instruments.     

GMM and 2SLS estimation of mixed regressive,spatial autoregressive models

The GMM method and the classical 2SLS method are considered for the estimation of mixed regressive, spatial autoregressive models. These methods have computational advantage over the conventional maximum likelihood method. The proposed GMM estimators are shown to be consistent and asymptotically normal. Within certain classes of GMM estimators, best ones are derived. The proposed GMM estimators improve upon the 2SLS estimators and are applicable even if all regressors are irrelevant. A best GMM estimator may have the same limiting distribution as the ML estimator (with normal disturbances).     

A Note on the Theme of Too Many Instruments*

The difference and system generalized method of moments (GMM) estimators are growing in popularity. As implemented in popular software, the estimators easily generate instruments that are numerous and, in system GMM, potentially suspect. A large instrument collection overfits endogenous variables even as it weakens the Hansen test of the instruments’ joint validity. This paper reviews the evidence on the effects of instrument proliferation, and describes and simulates simple ways to control it. It illustrates the dangers by replicating Forbes [American Economic Review (2000) Vol. 90, pp. 869–887] on income inequality and Levine et al. [Journal of Monetary Economics] (2000) Vol. 46, pp. 31–77] on financial sector development. Results in both papers appear driven by previously undetected endogeneity.     

An efficient GMM estimator of spatial autoregressive models

In this paper, we consider GMM estimation of the regression and MRSAR models with SAR disturbances. We derive the best GMM estimator within the class of GMM estimators based on linear and quadratic moment conditions. The best GMM estimator has the merit of computational simplicity and asymptotic efficiency. It is asymptotically as efficient as the ML estimator under normality and asymptotically more efficient than the Gaussian QML estimator otherwise. Monte Carlo studies show that, with moderate-sized samples, the best GMM estimator has its biggest advantage when the disturbances are asymmetrically distributed. When the diagonal elements of the spatial weights matrix have enough variation, incorporating kurtosis of the disturbances in the moment functions will also be helpful.     

Estimating and Forecasting with a Dynamic Spatial Panel Data Model*

This study focuses on the estimation and predictive performance of several estimators for the dynamic and autoregressive spatial lag panel data model with spatially correlated disturbances. In the spirit of Arellano and Bond (1991) and Mutl (2006) , a dynamic spatial generalized method of moments (GMM) estimator is proposed based on Kapoor, Kelejian and Prucha (2007) for the spatial autoregressive (SAR) error model. The main idea is to mix non‐spatial and spatial instruments to obtain consistent estimates of the parameters. Then, a linear predictor of this spatial dynamic model is derived. Using Monte Carlo simulations, we compare the performance of the GMM spatial estimator to that of spatial and non‐spatial estimators and illustrate our approach with an application to new economic geography.     

Instrumental variable estimation in the presence of many moment conditions

This paper develops shrinkage methods for addressing the “many instruments” problem in the context of instrumental variable estimation. It has been observed that instrumental variable estimators may behave poorly if the number of instruments is large. This problem can be addressed by shrinking the influence of a subset of instrumental variables. The procedure can be understood as a two-step process of shrinking some of the OLS coefficient estimates from the regression of the endogenous variables on the instruments, then using the predicted values of the endogenous variables (based on the shrunk coefficient estimates) as the instruments. The shrinkage parameter is chosen to minimize the asymptotic mean square error. The optimal shrinkage parameter has a closed form, which makes it easy to implement. A Monte Carlo study shows that the shrinkage method works well and performs better in many situations than do existing instrument selection procedures.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

Instrumental variable estimation based on grouped data

The paper considers the estimation of the coefficients of a single equation in the presence of dummy intruments. We derive pseudo ML and GMM estimators based on moment restrictions induced either by the structural form or by the reduced form of the model. The performance of the estimators is evaluated for the non-Gaussian case. We allow for heteroscedasticity. The asymptotic distributions are based on parameter sequences where the number of instruments increases at the same rate as the sample size. Relaxing the usual Gaussian assumption is shown to affect the normal asymptotic distributions. As a result also recently suggested new specification tests for the validity of instruments depend on Gaussianity. Monte Carlo simulations confirm the accuracy of the asymptotic approach.     

Nearly-singular design in GMM and generalized empirical likelihood estimators

Nearly-Singular design relaxes the nonsingularity assumption of the limit weight matrix in GMM, and the nonsingularity of the limit variance matrix for the first order conditions in GEL. The sample versions of these matrices are nonsingular, but in large samples we assume these sample matrices converge to a singular matrix. This can result in size distortions for the overidentifying restrictions test and large bias for the estimators. This nearly-singular design may occur because of the similar instruments in these matrices. We derive the large sample theory for GMM and GEL estimators under nearly-singular design. The rate of convergence of the estimators is slower than root n$n$.     

ENDOGENEITY IN COUNT DATA MODELS: AN APPLICATION TO DEMAND FOR HEALTH CARE

The generalized method of moments (GMM) estimation technique is discussed for count data models with endogenous regressors. Count data models can be specified with additive or multiplicative errors. It is shown that, in general, a set of instruments is not orthogonal to both error types. Simultaneous equations with a dependent count variable often do not have a reduced form which is a simple function of the instruments. However, a simultaneous model with a count and a binary variable can only be logically consistent when the system is triangular. The GMM estimator is used in the estimation of a model explaining the number of visits to doctors, with as a possible endogenous regressor a self-reported binary health index. Further, a model is estimated, in stages, that includes latent health instead of the binary health index. © 1997 John Wiley & Sons, Ltd.     

Endogenous selection or treatment model estimation

In a sample selection or treatment effects model, common unobservables may affect both the outcome and the probability of selection in unknown ways. This paper shows that the distribution function of potential outcomes, conditional on covariates, can be identified given an observed variable V$V$ that affects the treatment or selection probability in certain ways and is conditionally independent of the error terms in a model of potential outcomes. Selection model estimators based on this identification are provided, which take the form of simple weighted averages, GMM, or two stage least squares. These estimators permit endogenous and mismeasured regressors. Empirical applications are provided to estimation of a firm investment model and a schooling effects on wages model.     

Proofs for large sample properties of generalized method of moments estimators

I present proofs for the consistency of generalized method of moments (GMM) estimators presented in Hansen (1982). Some basic approximation results provide the groundwork for the analysis of a class of such estimators. Using these results, I establish the large sample convergence of GMM estimators under alternative restrictions on the estimation problem.     

Estimation with overidentifying inequality moment conditions

This paper derives limit distributions of empirical likelihood estimators for models in which inequality moment conditions provide overidentifying information. We show that the use of this information leads to a reduction of the asymptotic mean-squared estimation error and propose asymptotically uniformly valid tests and confidence sets for the parameters of interest. While inequality moment conditions arise in many important economic models, we use a dynamic macroeconomic model as a data generating process and illustrate our methods with instrumental variable estimators of monetary policy rules. The results obtained in this paper extend to conventional GMM estimators.     

Estimation for spatial dynamic panel data with fixed effects: The case of spatial cointegration

Yu et al. (2008) establish asymptotic properties of quasi-maximum likelihood estimators for a stable spatial dynamic panel model with fixed effects when both the number of individuals n and the number of time periods T are large. This paper investigates unstable cases where there are unit roots generated by temporal and spatial correlations. We focus on the spatial cointegration model where some eigenvalues of the data generating process are equal to 1 and the outcomes of spatial units are cointegrated as in a vector autoregressive system. The asymptotics of the QML estimators are developed by reparameterization, and bias correction for the estimators is proposed. We also consider the 2SLS and GMM estimations when T could be small.     

Censored regression quantiles with endogenous regressors

This paper develops a semiparametric method for estimation of the censored regression model when some of the regressors are endogenous (and continuously distributed) and instrumental variables are available for them. A “distributional exclusion” restriction is imposed on the unobservable errors, whose conditional distribution is assumed to depend on the regressors and instruments only through a lower-dimensional “control variable,” here assumed to be the difference between the endogenous regressors and their conditional expectations given the instruments. This assumption, which implies a similar exclusion restriction for the conditional quantiles of the censored dependent variable, is used to motivate a two-stage estimator of the censored regression coefficients. In the first stage, the conditional quantile of the dependent variable given the instruments and the regressors is nonparametrically estimated, as are the first-stage reduced-form residuals to be used as control variables. The second-stage estimator is a weighted least squares regression of pairwise differences in the estimated quantiles on the corresponding differences in regressors, using only pairs of observations for which both estimated quantiles are positive (i.e., in the uncensored region) and the corresponding difference in estimated control variables is small. The paper gives the form of the asymptotic distribution for the proposed estimator, and discusses how it compares to similar estimators for alternative models.     

Jackknife instrumental variables estimation

Two-stage-least-squares (2SLS) estimates are biased towards the probability limit of OLS estimates. This bias grows with the degree of over-identification and can generate highly misleading results. In this paper we propose two simple alternatives to 2SLS and limited-information-maximum-likelihood (LIML) estimators for models with more instruments than endogenous regressors. These estimators can be interpreted as instrumental variables procedures using an instrument that is independent of disturbances even in finite samples. Independence is achieved by using a ‘leave-one-out’ jackknife-type fitted value in place of the usual first stage equation. The new estimators are first-order equivalent to 2SLS but with finite-sample properties superior, in terms of bias and coverage rate of confidence intervals, compared to those of 2SLS and similar to those of LIML, when there are many instruments. Copyright © 1999 John Wiley & Sons, Ltd.     

Efficient estimation and inference in linear pseudo-panel data models

We consider pseudo-panel data models constructed from repeated cross sections in which the number of individuals per group is large relative to the number of groups and time periods. First, we show that, when time-invariant group fixed effects are neglected, the OLS estimator does not converge in probability to a constant but rather to a random variable. Second, we show that, while the fixed-effects (FE) estimator is consistent, the usual t statistic is not asymptotically normally distributed, and we propose a new robust t statistic whose asymptotic distribution is standard normal. Third, we propose efficient GMM estimators using the orthogonality conditions implied by grouping and we provide t tests that are valid even in the presence of time-invariant group effects. Our Monte Carlo results show that the proposed GMM estimator is more precise than the FE estimator and that our new t test has good size and is powerful.     

A regularization approach to the many instruments problem

This paper focuses on the estimation of a finite dimensional parameter in a linear model where the number of instruments is very large or infinite. In order to improve the small sample properties of standard instrumental variable (IV) estimators, we propose three modified IV estimators based on three different ways of inverting the covariance matrix of the instruments. These inverses involve a regularization or smoothing parameter. It should be stressed that no restriction on the number of instruments is needed and that all the instruments are used in the estimation. We show that the three estimators are asymptotically normal and attain the semiparametric efficiency bound. Higher-order analysis of the MSE reveals that the bias of the modified estimators does not depend on the number of instruments. Finally, we suggest a data-driven method for selecting the regularization parameter. Interestingly, our regularization techniques lead to a consistent nonparametric estimation of the optimal instrument.     

On finite sample properties of alternative estimators of coefficients in a structural equation with many instruments

We compare four different estimation methods for the coefficients of a linear structural equation with instrumental variables. As the classical methods we consider the limited information maximum likelihood (LIML) estimator and the two-stage least squares (TSLS) estimator, and as the semi-parametric estimation methods we consider the maximum empirical likelihood (MEL) estimator and the generalized method of moments (GMM) (or the estimating equation) estimator. Tables and figures of the distribution functions of four estimators are given for enough values of the parameters to cover most linear models of interest and we include some heteroscedastic cases and nonlinear cases. We have found that the LIML estimator has good performance in terms of the bounded loss functions and probabilities when the number of instruments is large, that is, the micro-econometric models with “many instruments” in the terminology of recent econometric literature.