Jackknife instrumental variables estimation

Two-stage-least-squares (2SLS) estimates are biased towards the probability limit of OLS estimates. This bias grows with the degree of over-identification and can generate highly misleading results. In this paper we propose two simple alternatives to 2SLS and limited-information-maximum-likelihood (LIML) estimators for models with more instruments than endogenous regressors. These estimators can be interpreted as instrumental variables procedures using an instrument that is independent of disturbances even in finite samples. Independence is achieved by using a ‘leave-one-out’ jackknife-type fitted value in place of the usual first stage equation. The new estimators are first-order equivalent to 2SLS but with finite-sample properties superior, in terms of bias and coverage rate of confidence intervals, compared to those of 2SLS and similar to those of LIML, when there are many instruments. Copyright © 1999 John Wiley & Sons, Ltd.     

FIML estimation of the dynamic simultaneous equations model with ARMA disturbances

A method is presented for the estimation of the parameters in the dynamic simultaneous equations model with vector autoregressive moving average disturbances. The estimation procedure is derived from the full information maximum likelihood approach and is based on Newton-Raphson techniques applied to the likelihood equations. The resulting two-step Newton-Raphson procedure involves only generalized instrumental variables estimation in the second step. This procedure also serves as the basis for an iterative scheme to solve the normal equations and obtain the maximum likelihood estimates of the conditional likelihood function. A nine-equation variant of the quarterly forecasting model of the US economy developed by Fair is then used as a realistic example to illustrate the estimation procedure described in the paper.     

Specification and estimation of spatial autoregressive models with autoregressive and heteroskedastic disturbances

This study develops a methodology of inference for a widely used Cliff–Ord type spatial model containing spatial lags in the dependent variable, exogenous variables, and the disturbance terms, while allowing for unknown heteroskedasticity in the innovations. We first generalize the GMM estimator suggested in  and  for the spatial autoregressive parameter in the disturbance process. We also define IV estimators for the regression parameters of the model and give results concerning the joint asymptotic distribution of those estimators and the GMM estimator. Much of the theory is kept general to cover a wide range of settings.     

Indirect estimation of large conditionally heteroskedastic factor models,with an application to the Dow 30 stocks

We derive indirect estimators of conditionally heteroskedastic factor models in which the volatilities of common and idiosyncratic factors depend on their past unobserved values by calibrating the score of a Kalman-filter approximation with inequality constraints on the auxiliary model parameters. We also propose alternative indirect estimators for large-scale models, and explain how to apply our procedures to many other dynamic latent variable models. We analyse the small sample behaviour of our indirect estimators and several likelihood-based procedures through an extensive Monte Carlo experiment with empirically realistic designs. Finally, we apply our procedures to weekly returns on the Dow 30 stocks.     

A ridge-like method for simultaneous estimation of simultaneous equations

In the context of full information estimation in a linear simultaneous equations model, this paper considers a ridge-like modification of the 3SLS estimator. The proposed method is particularly desirable where the square matrix of the 3SLS normal equationsis singular (or near-singular) leading to non-existence (or poor performance) of the estimator. Furthermore, the type of solution suggested here does seem to result in the existence of the finite sample moments of the estimator even when the degrees of over identification are as low as zero (just identified models). This paper considers only a simple scalar form of the ‘ridge-matrix” with a relatively simple choice of the modifying scalar that preserves the asymptotic properties of the 3SLS estimator. A value of this scalar is derived which minimizes an appropriatequadratic risk criterion. The approximate quadratic risk function is based upon the asymptotic approximation of the relevant moments in the manner of Nagar (1959). A range of risk reducing values of the ‘ridge-scalar” is also given.     

Information and computation in simultaneous equations estimation

The complexity and size of simultaneous equations systems necessitates great care with computations for parameter estimation. In three-stage least-squares (3SLS) large matrix inversions are required, and because of the sensitivity of many economic systems to key parameters, accuracy in estimation is important. There are many numerical techniques available which yield accurate solutions to systems of equations. We make use of Householder transformations and recursive triangulation solutions in presenting numerical algorithms for the computation of 3SLS and k-class estimates. Another numerical technique, the singular value decomposition is valuable in providing additional information in k-class estimation. The values of k for which this estimator does not exist are accurately derived, their use being demonstrated by an example.     

Semi-parametric estimation of simultaneous equations with limited dependent variables: A case study of female labour supply

We propose a general strategy to estimate semi-parametrically simultaneous equations with limited dependent variables. First, each reduced form (RF) is estimated with various semi-parametric methods. Second, the specification of each RF is tested to select an appropriate method. Third, the structural form (SF) equations are estimated using minimum distance methods and the restrictions among the SF and RF parameters. A case study of female labour supply is presented.     

Local polynomial estimation of nonparametric simultaneous equations models

We define a new procedure for consistent estimation of nonparametric simultaneous equations models under the conditional mean independence restriction of Newey et al. [1999. Nonparametric estimation of triangular simultaneous equation models. Econometrica 67, 565–603]. It is based upon local polynomial regression and marginal integration techniques. We establish the asymptotic distribution of our estimator under weak data dependence conditions. Simulation evidence suggests that our estimator may significantly outperform the estimators of Pinkse [2000. Nonparametric two-step regression estimation when regressors and errors are dependent. Canadian Journal of Statistics 28, 289–300] and Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578].     

Fixed effects instrumental variables estimation in correlated random coefficient panel data models

We provide a set of conditions sufficient for consistency of a general class of fixed effects instrumental variables (FE-IV) estimators in the context of a correlated random coefficient panel data model, where one ignores the presence of individual-specific slopes. We discuss cases where the assumptions are met and violated. Monte Carlo simulations verify that the FE-IV estimator of the population averaged effect performs notably better than other standard estimators, provided a full set of period dummies is included. We also propose a simple test of selection bias in unbalanced panels when we suspect the slopes may vary by individual.     

Long difference instrumental variables estimation for dynamic panel models with fixed effects

This paper proposes a new instrumental variables estimator for a dynamic panel model with fixed effects with good bias and mean squared error properties even when identification of the model becomes weak near the unit circle. We adopt a weak instrument asymptotic approximation to study the behavior of various estimators near the unit circle. We show that an estimator based on long differencing the model is much less biased than conventional implementations of the GMM estimator for the dynamic panel model. We also show that under the weak instrument approximation conventional GMM estimators are dominated in terms of mean squared error by an estimator with far less moment conditions. The long difference (LD) estimator mimics the infeasible optimal procedure through its reliance on a small set of moment conditions.     

Linear instrumental variable estimation of limited dependent variable models with endogenous explanatory variables

The purpose of this paper is to present and analyze an instrumental variables estimator for limited dependent variable models that does not require functional form assumptions for the distribution of disturbances. This estimator is a weighted instrumental variables estimator, where the weight is the ratio of a multivariate normal density to the actual density of the instrumental variables. A semi-non-parametric estimator of the weights is presented and some conjectures concerning the asymptotic distribution of the estimator are discussed.     

On efficient estimation with panel data: An empirical comparison of instrumental variables estimators

This paper attempts a replication of the Cornwell and Rupert (1988) study—hereafter CR. The CR study investigated the efficiency gains in a returns to schooling example by applying alternative sets of instrumental variables estimators for panel data regressions proposed by Hausman and Taylor (1981), Amemiya and MaCurdy (1986), and Breusch, Mizon, and Schmidt (1989). Corrections on the CR data set lead to changes in the legitimate set of instruments, when the time dummies are excluded from the regression, and to much lower empirical gains in efficiency than those reported in CR. If the time dummies are retained in the wage equation, the experience coefficient is not estimable by the within regression, and the empirical gains in efficiency from using the IV procedures are not limited to the time-invariant education coefficient.     

Several efficient two-step estimators for the dynamic simultaneous equations model with autoregressive disturbances

Several asymptotically efficient methods are suggested on both the full and the limited information approach to estimate the simultaneous equations model in which the lagged endogenous variables and the autoregressive disturbances coexist. They are two-step procedures and do not involve iterations. A method is suggested also for the case where any portion of the autoregressive parameter matrix is specified to be zero. Since the consistency and efficiency depend upon the asymptotic, local identifiability, the necessary and sufficient condition is derived for it. It does not depend on the exclusion of the lagged endogenous variables.     

Three-stage least-squares estimation for a system of simultaneous,nonlinear, implicit equations

The article describes a nonlinear three-stage least-squares estimator for the parameters of a system of simultaneous, nonlinear, implicit equations; the method allows the estimation of these parameters subject to nonlinear parametric restrictions across equations. The estimator is shown to be strongly consistent, asymptotically normally distributed, and more efficient than the nonlinear two-stage least-squares estimator. Some practical implications of the regularity conditions used to obtain these results are discussed from the point of view of one whose interest is in applications, Also, computing methods using readily available nonlinear regression programs are described.     

Jackknife instrumental variables estimation: replication and extension of angrist,imbens and krueger (1999)

I replicate most of the results in Angrist, Imbens, and Krueger (Journal of Applied Econometrics 1999; 14: 57–67), point to a possible error in and re‐estimate Model 3, and analyze some simple extensions. The programming code, data, and results are available at http://sites.google.com/site/antonnakov/software . Copyright © 2010 John Wiley & Sons, Ltd.     

Distribution free estimation of heteroskedastic binary response models using Probit/Logit criterion functions

In this paper estimators for distribution free heteroskedastic binary response models are proposed. The estimation procedures are based on relationships between distribution free models with a conditional median restriction and parametric models (such as Probit/Logit) exhibiting (multiplicative) heteroskedasticity. The first proposed estimator is based on the observational equivalence between the two models, and is a semiparametric sieve estimator (see, e.g. Gallant and Nychka (1987), Ai and Chen (2003) and Chen et al. (2005)) for the regression coefficients, based on maximizing standard Logit/Probit criterion functions, such as NLLS and MLE. This procedure has the advantage that choice probabilities and regression coefficients are estimated simultaneously. The second proposed procedure is based on the equivalence between existing semiparametric estimators for the conditional median model (,  and ) and the standard parametric (Probit/Logit) NLLS estimator. This estimator has the advantage of being implementable with standard software packages such as Stata. Distribution theory is developed for both estimators and a Monte Carlo study indicates they both perform well in finite samples.     

The structure of simultaneous equations estimators

The formula for the Full Information Maximum Likelihood Estimator for a linear simultaneous system (with finite variance, serially independent errors) is demonstrated to be an estimator generating equation for econometrics in that all presently known estimators are readily derivable from that formula if they are considered as numerical approximations to its solution. Further, the approach immediately classifies the resulting estimators into asymptotically equivalent groups. The method is then generalised to encompass the large class of estimators for dynamic systems with (vector) autoregressive errors. The very close relationship between estimation rules and non-linear optimisation algorithms is highlighted.     

On two methods for solving and estimating linear simultaneous equations under rational expectations

A method of Chow (1983) and a method of Dagli and Taylor (1982) for solving and estimating linear simultaneous equations under rational expectations are compared. The latter solution is shown to be a special case of the former in the sense of imposing a set of restrictions on the parameters of the former solution. Statistical methods to test the restrictions implicit in the latter solution are suggested. An illustrated model is provided to demonstrate the two methods, with the Dagli-Taylor method found to give inconsistent estimates when the restrictions are not met.     

Recursive estimation of simultaneous equation models

A recursive instrumental variable estimator is derived. For simultaneous equation estimation, the choice of the instruments is discussed. A computationally simple and asymptotically efficient recursive estimator is proposed in this context.