Robust estimation of the structural errors-in-variables model

Robust alternatives to the method of moments estimator for estimating the simple structural errors-in-variables model are proposed. Consistency and asymptotic normality of the estimators are established. Using the influence curve the asymptotic variance is given. Results from a simulation experiment indicate a superior performance of robust alternatives to the method of moments estimator in a small sample framework when measurement errors are contaminated normal. Research reported in this paper was supported by a grant from Sundsvallsbanken.     

Improved instrumental variables estimation of simultaneous equations under conditionally heteroskedastic disturbances

In this paper we develop estimation techniques and a specification test for the validity of instrumental variables allowing for conditionally heteroskedastic disturbances. We propose modified two‐stage least squares (2SLS) and modified 3SLS procedures where the conditional heteroskedasticity is taken into account, which are natural extensions of the traditional 2SLS and 3SLS estimators and which achieve a lower variance. We recommend the use of these modified 2SLS and 3SLS procedures in practice instead of alternative estimators like limited‐information maximum likelihood/full‐information maximum likelihood, where the non‐existence of moments leads to extreme values, and also for ease of computation. It is shown theoretically and with simulation that in some cases 2SLS, 3SLS and our modified 2SLS and 3SLS procedures can have very severe biases (including the weak instruments case), and we present bias correction procedures to apply in practice along the lines of Flores‐Lagunes ( 2007 ). Our new estimation procedures can also be used to extend the test for weak instruments of Stock and Yogo ( 2005 ) and to allow for conditional heteroskedasticity. Finally, we show the usefulness of our estimation procedures with an application to the demand and supply of fish. Copyright © 2010 John Wiley & Sons, Ltd.     

Consistent moment estimators of regression coefficients in the presence of errors in variables

This paper examines the possibilities of moment estimators of regression coefficients in the errors-in-variables problem suggested by Geary (1942) and others [Scott (1950) and Drion (1951)]. This approach yields consistent estimators of regression coefficients based on uni- and bi-variate moments (or cumulants) of third or higher order. These are computationally simple and need milder assumptions than the standard techniques, viz., ML and IV estimation. After a review of past investigations, this paper proposes new moment estimators and compares the asymptotic efficiencies of six estimators proposed earlier or here and of the OLS estimator. The case where the true regressor is lognormally distributed receives considerable attention in this communication.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Weaker MSE criteria and tests for linear restrictions in regression models with non-spherical disturbances

This paper extend, in an asymptotic sense, the strong and the weaker mean square error criteria and corresponding tests to linear models with non-spherical disturbances where the error covariance matrix is unknown but a consistent estimator for it is available. The mean square error tests of Toro-Vizcorrondo and Wallace (1968) and Wallace (1972) test for the superiority of restricted over unrestricted linear estimators in a least squares context. This generalization of these tests makes them available for use with GLS, Zellner's SUR, 2SLS, 3SLS, tests of over identification, and so forth.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

On B-robust instrumental variable estimation of the linear model with panel data

The aim of this paper is to demonstrate how to acquire robust consistent estimates of the linear model when the fundamental orthogonality condition is not fulfilled. With this end in view, we develop two estimation procedures: Two stage generalized M (2SGM) and robust generalized method of moments (RGMM). Both estimators are B-robust, i.e. their associated influence function is bounded, consistent and asymptotic normally distributed. Our simulation results indicate that the relatively efficient RGMM estimator (in regressions with heteroskedastic and/or autocorrelated errors) provides accurate parameter estimates of a panel data model with all variables subject to measurement errors, even if a substantial portion of the data is contaminated with aberrant observations. The traditional estimation techniques such as 2SLS and GMM break down when outliers corrupt the data.     

Estimation and testing for a Poisson autoregressive model

This article considers statistical inference for a Poisson autoregressive model. A condition for ergodicity and a necessary and sufficient condition for the existence of moments are given. Asymptotics for maximum likelihood estimator and weighted least squares estimators with estimated weights or known weights of the parameters are established. Testing conditional heteroscedasticity and testing the parameters under a simple ordered restriction are noted. A simulation study is also given.     

Information and computation in simultaneous equations estimation

The complexity and size of simultaneous equations systems necessitates great care with computations for parameter estimation. In three-stage least-squares (3SLS) large matrix inversions are required, and because of the sensitivity of many economic systems to key parameters, accuracy in estimation is important. There are many numerical techniques available which yield accurate solutions to systems of equations. We make use of Householder transformations and recursive triangulation solutions in presenting numerical algorithms for the computation of 3SLS and k-class estimates. Another numerical technique, the singular value decomposition is valuable in providing additional information in k-class estimation. The values of k for which this estimator does not exist are accurately derived, their use being demonstrated by an example.     

Estimation of models with grouped and ungrouped data by means of “2SLS”

This paper deals with a special case of estimation with grouped data, where the dependent variable is only available for groups, whereas the endogenous regressor(s) is available at the individual level. By estimating the first stage using the available individual data, and then estimating the second stage at the aggregate level, it might be possible to gain efficiency relative to the OLS and 2SLS estimators that use only grouped data. We term this the mixed-2SLS estimator (M2SLS). The M2SLS estimator is consistent and asymptotically normal. We also provide a test of efficiency of M2SLS relative to OLS and “2SLS” estimators.     

Local GMM estimation of time series models with conditional moment restrictions

This paper investigates statistical properties of the local generalized method of moments (LGMM) estimator for some time series models defined by conditional moment restrictions. First, we consider Markov processes with possible conditional heteroskedasticity of unknown forms and establish the consistency, asymptotic normality, and semi-parametric efficiency of the LGMM estimator. Second, we undertake a higher-order asymptotic expansion and demonstrate that the LGMM estimator possesses some appealing bias reduction properties for positively autocorrelated processes. Our analysis of the asymptotic expansion of the LGMM estimator reveals an interesting contrast with the OLS estimator that helps to shed light on the nature of the bias correction performed by the LGMM estimator. The practical importance of these findings is evaluated in terms of a bond and option pricing exercise based on a diffusion model for spot interest rate.     

Averaging estimators for autoregressions with a near unit root

This paper uses local-to-unity theory to evaluate the asymptotic mean-squared error (AMSE) and forecast expected squared error from least-squares estimation of an autoregressive model with a root close to unity. We investigate unconstrained estimation, estimation imposing the unit root constraint, pre-test estimation, model selection estimation, and model average estimation. We find that the asymptotic risk depends only on the local-to-unity parameter, facilitating simple graphical comparisons. Our results strongly caution against pre-testing. Strong evidence supports averaging based on Mallows weights. In particular, our Mallows averaging method has uniformly and substantially smaller risk than the conventional unconstrained estimator, and this holds for autoregressive roots far from unity. Our averaging estimator is a new approach to forecast combination.     

Indirect inference in structural econometric models

This paper considers parametric inference in a wide range of structural econometric models. It illustrates how the indirect inference principle can be used in the inference of these models. Specifically, we show that an ordinary least squares (OLS) estimation can be used as an auxiliary model, which leads to a method that is similar in spirit to a two-stage least squares (2SLS) estimator. Monte Carlo studies and an empirical analysis of timber sale auctions held in Oregon illustrate the usefulness and feasibility of our approach.     

Spatial heteroskedasticity and autocorrelation consistent estimation of covariance matrix

This paper considers spatial heteroskedasticity and autocorrelation consistent (spatial HAC) estimation of covariance matrices of parameter estimators. We generalize the spatial HAC estimator introduced by Kelejian and Prucha (2007) to apply to linear and nonlinear spatial models with moment conditions. We establish its consistency, rate of convergence and asymptotic truncated mean squared error (MSE). Based on the asymptotic truncated MSE criterion, we derive the optimal bandwidth parameter and suggest its data dependent estimation procedure using a parametric plug-in method. The finite sample performances of the spatial HAC estimator are evaluated via Monte Carlo simulation.     

Asymptotic linearity of minimax estimators

The celebrated local asymptotic minimax (LAM) theorem due to HÁjek (1972) also includes the statement that a LAM estimator Is necessarily asymptotically linear. A similar result. is true for semi-parametric models, but Hájek's result doesn't apply to this case as the efficient influence function is often not contained in the (proper) tangent space. This note gives a simple, elementary proof of both the LAM theorem and the necessity of asymptotic linearity of a LAM estimator sequence.     

The asymptotic behaviour of the estimated generalized least squares method in the linear regression model

Abstract  In the linear regression model the generalized least squares (GLS) method is only applicable if the covariance matrix of the errors is known but for a scalar factor. Otherwise an estimator for this matrix has to be used. Then we speak of the estimated generalized least squares (EGLS) method. In this paper the asymptotic behaviour of both methods is compared. Results are applied to some standard models commonly used in econometrics     

Simultaneous selection and weighting of moments in GMM using a trapezoidal kernel

This paper proposes a novel procedure to estimate linear models when the number of instruments is large. At the heart of such models is the need to balance the trade off between attaining asymptotic efficiency, which requires more instruments, and minimizing bias, which is adversely affected by the addition of instruments. Two questions are of central concern: (1) What is the optimal number of instruments to use? (2) Should the instruments receive different weights? This paper contains the following contributions toward resolving these issues. First, I propose a kernel weighted generalized method of moments (GMM) estimator that uses a trapezoidal kernel. This kernel turns out to be attractive to select and weight the number of moments. Second, I derive the higher order mean squared error of the kernel weighted GMM estimator and show that the trapezoidal kernel generates a lower asymptotic variance than regular kernels. Finally, Monte Carlo simulations show that in finite samples the kernel weighted GMM estimator performs on par with other estimators that choose optimal instruments and improves upon a GMM estimator that uses all instruments.     

Optimal convergence rates,Bahadur representation,and asymptotic normality of partitioning estimators

This paper studies the asymptotic properties of partitioning estimators of the conditional expectation function and its derivatives. Mean-square and uniform convergence rates are established and shown to be optimal under simple and intuitive conditions. The uniform rate explicitly accounts for the effect of moment assumptions, which is useful in semiparametric inference. A general asymptotic integrated mean-square error approximation is obtained and used to derive an optimal plug-in tuning parameter selector. A uniform Bahadur representation is developed for linear functionals of the estimator. Using this representation, asymptotic normality is established, along with consistency of a standard-error estimator. The finite-sample performance of the partitioning estimator is examined and compared to other nonparametric techniques in an extensive simulation study.     

Endogeneity in quantile regression models: A control function approach

This paper considers a linear triangular simultaneous equations model with conditional quantile restrictions. The paper adjusts for endogeneity by adopting a control function approach and presents a simple two-step estimator that exploits the partially linear structure of the model. The first step consists of estimation of the residuals of the reduced-form equation for the endogenous explanatory variable. The second step is series estimation of the primary equation with the reduced-form residual included nonparametrically as an additional explanatory variable. This paper imposes no functional form restrictions on the stochastic relationship between the reduced-form residual and the disturbance term in the primary equation conditional on observable explanatory variables. The paper presents regularity conditions for consistency and asymptotic normality of the two-step estimator. In addition, the paper provides some discussions on related estimation methods in the literature.