Robust estimation of the structural errors-in-variables model

Robust alternatives to the method of moments estimator for estimating the simple structural errors-in-variables model are proposed. Consistency and asymptotic normality of the estimators are established. Using the influence curve the asymptotic variance is given. Results from a simulation experiment indicate a superior performance of robust alternatives to the method of moments estimator in a small sample framework when measurement errors are contaminated normal. Research reported in this paper was supported by a grant from Sundsvallsbanken.     

Some properties of the LIML estimator in a dynamic panel structural equation

We investigate the finite sample and asymptotic properties of the within-groups (WG), the random-effects quasi-maximum likelihood (RQML), the generalized method of moment (GMM) and the limited information maximum likelihood (LIML) estimators for a panel autoregressive structural equation model with random effects when both T (time-dimension) and N (cross-section dimension) are large. When we use the forward-filtering due to Alvarez and Arellano (2003), the WG, the RQML and GMM estimators are significantly biased when both T and N are large while T/N is different from zero. The LIML estimator gives desirable asymptotic properties when T/N converges to a constant.     

Spatial correlation robust inference with errors in location or distance

This paper presents results from a Monte Carlo study concerning inference with spatially dependent data. We investigate the impact of location/distance measurement errors upon the accuracy of parametric and nonparametric estimators of asymptotic variances. Nonparametric estimators are quite robust to such errors, method of moments estimators perform surprisingly well, and MLE estimators are very poor. We also present and evaluate a specification test based on a parametric bootstrap that has good power properties for the types of measurement error we consider.     

Estimation for spatial dynamic panel data with fixed effects: The case of spatial cointegration

Yu et al. (2008) establish asymptotic properties of quasi-maximum likelihood estimators for a stable spatial dynamic panel model with fixed effects when both the number of individuals n and the number of time periods T are large. This paper investigates unstable cases where there are unit roots generated by temporal and spatial correlations. We focus on the spatial cointegration model where some eigenvalues of the data generating process are equal to 1 and the outcomes of spatial units are cointegrated as in a vector autoregressive system. The asymptotics of the QML estimators are developed by reparameterization, and bias correction for the estimators is proposed. We also consider the 2SLS and GMM estimations when T could be small.     

On the existence of moments of partially restricted reduced form coefficients

In this paper ridgelike Bayesian estimators of structural coefficients have been used to form the partially restricted reduced form estimators. These partially restricted reduced form estimators are simple in form and possess finite sampling moments and risk in contrast to other restricted reduced form estimators that possess no finite moments and have infinite risk relative to quadratic loss functions. The usual k-class implied partially restricted reduced form estimators with 0≦k≦1 do not posses finite moments unless the degree of overidentification (or the excess of sample size over the number of coefficients) of the structural equation being estimated is suitably restricted.     

Heteroskedasticity, autocorrelation, and spatial correlation robust inference in linear panel models with fixed-effects

This paper develops an asymptotic theory for test statistics in linear panel models that are robust to heteroskedasticity, autocorrelation and/or spatial correlation. Two classes of standard errors are analyzed. Both are based on nonparametric heteroskedasticity autocorrelation (HAC) covariance matrix estimators. The first class is based on averages of HAC estimators across individuals in the cross-section, i.e. “averages of HACs”. This class includes the well known cluster standard errors analyzed by Arellano (1987) as a special case. The second class is based on the HAC of cross-section averages and was proposed by Driscoll and Kraay (1998). The ”HAC of averages” standard errors are robust to heteroskedasticity, serial correlation and spatial correlation but weak dependence in the time dimension is required. The “averages of HACs” standard errors are robust to heteroskedasticity and serial correlation including the nonstationary case but they are not valid in the presence of spatial correlation. The main contribution of the paper is to develop a fixed-b asymptotic theory for statistics based on both classes of standard errors in models with individual and possibly time fixed-effects dummy variables. The asymptotics is carried out for large time sample sizes for both fixed and large cross-section sample sizes. Extensive simulations show that the fixed-b approximation is usually much better than the traditional normal or chi-square approximation especially for the Driscoll-Kraay standard errors. The use of fixed-b critical values will lead to more reliable inference in practice especially for tests of joint hypotheses.     

Regression with errors in variables: estimators based on third order moments

In this paper consistent and, in a well–defined sense, optimal moment–estimators of the regression coefficient in a simple regression model with errors in variables are derived. The asymptotic variance and other asymptotic properties of these estimators are given. As is known for a long time, serious estimation problems exist in this model. There are two ways out of this problem: using either additional assumptions or additional information in the data. A lot of attention has been paid to the use of additional assumptions. However, quite often this leads to rather unrealistic models. In this paper we use additional information in the data. That means here that, besides first and second order moments, third order moments are formulated as functions of the model parameters. Besides theoretical derivations a small study with generated data is discussed. This study shows that for samples larger than 50 the estimates we consider behave nicely.     

Identification and estimation of polynomial errors-in-variables models

Methods of estimation of regression coefficients are proposed when the regression function includes a polynomial in a ‘true’ regressor which is measured with error. Two sources of additional information concerning the unobservable regressor are considered: either an additional indicator of the regressor (itself measured with error) or instrumental variables which characterize the systematic variation in the true regressor. In both cases, estimators are constructed by relating moments involving the unobserved variables to moments of observables; these relations lead to recursion formulae for computation of the regression coefficients and nuisance parameters (e.g., moments of the measurement error). Consistency and asymptotic normality of the estimated coefficients is demonstrated, and consistent estimators of the asymptotic covariant matrices are provided.     

Bias in dynamic panel estimation with fixed effects,incidental trends and cross section dependence

Explicit asymptotic bias formulae are given for dynamic panel regression estimators as the cross section sample size N→∞$N\to \infty$. The results extend earlier work by Nickell [1981. Biases in dynamic models with fixed effects. Econometrica 49, 1417–1426] and later authors in several directions that are relevant for practical work, including models with unit roots, deterministic trends, predetermined and exogenous regressors, and errors that may be cross sectionally dependent. The asymptotic bias is found to be so large when incidental linear trends are fitted and the time series sample size is small that it changes the sign of the autoregressive coefficient. Another finding of interest is that, when there is cross section error dependence, the probability limit of the dynamic panel regression estimator is a random variable rather than a constant, which helps to explain the substantial variability observed in dynamic panel estimates when there is cross section dependence even in situations where N is very large. Some proposals for bias correction are suggested and finite sample performance is analyzed in simulations.     

Generalised residuals and heterogeneous duration models: With applications to the Weilbull model

This paper deals with models for the duration of an event that are misspecified by the neglect of random multiplicative heterogeneity in the hazard function. This type of misspecification has been widely discussed in the literature [e.g., Heckman and Singer (1982), Lancaster and Nickell (1980)], but no study of its effect on maximum likelihood estimators has been given. This paper aims to provide such a study with particular reference to the Weibull regression model which is by far the most frequently used parametric model [e.g., Heckman and Borjas (1980), Lancaster (1979)]. In this paper we define generalised errors and residuals in the sense of Cox and Snell (1968, 1971) and show how their use materially simplifies the analysis of both true and misspecified duration models. We show that multiplicative heterogeneity in the hazard of the Weibull model has two errors in variables interpretations. We give the exact asymptotic inconsistency of M.L. estimation in the Weibull model and give a general expression for the inconsistency of M.L. estimators due to neglected heterogeneity for any duration model to O(σ²), where σ² is the variance of the error term. We also discuss the information matrix test for neglected heterogeneity in duration models and consider its behaviour when σ²>0.     

Shrinkage estimation of the proportion in randomized response

This article considers the asymptotic estimation theory for the proportion in randomized response survey usinguncertain prior information (UPI) about the true proportion parameter which is assumed to be available on the basis of some sort of realistic conjecture. Three estimators, namely, the unrestricted estimator, the shrinkage restricted estimator and an estimator based on a preliminary test, are proposed. Their asymptotic mean squared errors are derived and compared. The relative dominance picture of the estimators is presented.     

Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

On B-robust instrumental variable estimation of the linear model with panel data

The aim of this paper is to demonstrate how to acquire robust consistent estimates of the linear model when the fundamental orthogonality condition is not fulfilled. With this end in view, we develop two estimation procedures: Two stage generalized M (2SGM) and robust generalized method of moments (RGMM). Both estimators are B-robust, i.e. their associated influence function is bounded, consistent and asymptotic normally distributed. Our simulation results indicate that the relatively efficient RGMM estimator (in regressions with heteroskedastic and/or autocorrelated errors) provides accurate parameter estimates of a panel data model with all variables subject to measurement errors, even if a substantial portion of the data is contaminated with aberrant observations. The traditional estimation techniques such as 2SLS and GMM break down when outliers corrupt the data.     

Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction

We provide analytical formulae for the asymptotic bias (ABIAS) and mean-squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. Our analytical formulae can be viewed as generalizing the bias and MSE results of [Richardson and Wu 1971. A note on the comparison of ordinary and two-stage least squares estimators. Econometrica 39, 973–982] to the case with nonnormal errors and stochastic instruments. Our approximations are shown to compare favorably with approximations due to [Morimune 1983. Approximate distributions of k$k$-class estimators when the degree of overidentifiability is large compared with the sample size. Econometrica 51, 821–841] and [Donald and Newey 2001. Choosing the number of instruments. Econometrica 69, 1161–1191], particularly when the instruments are weak. We also construct consistent estimators for the ABIAS and AMSE, and we use these to further construct a number of bias corrected OLS and IV estimators, the properties of which are examined both analytically and via a series of Monte Carlo experiments.     

Trending time-varying coefficient time series models with serially correlated errors

This paper studies a time-varying coefficient time series model with a time trend function and serially correlated errors to characterize the nonlinearity, nonstationarity, and trending phenomenon. A local linear approach is developed to estimate the time trend and coefficient functions. The asymptotic properties of the proposed estimators, coupled with their comparisons with other methods, are established under the α$\alpha$-mixing conditions and without specifying the error distribution. Further, the asymptotic behaviors of the estimators at the boundaries are examined. The practical problem of implementation is also addressed. In particular, a simple nonparametric version of a bootstrap test is adapted for testing misspecification and stationarity, together with a data-driven method for selecting the bandwidth and a consistent estimate of the standard errors. Finally, results of two Monte Carlo experiments are presented to examine the finite sample performances of the proposed procedures and an empirical example is discussed.     

Asymptotic distributions of some scale estimators in nonlinear models

Often in the robust analysis of regression and time series models there is a need for having a robust scale estimator of a scale parameter of the errors. One often used scale estimator is the median of the absolute residuals s ₁. It is of interest to know its limiting distribution and the consistency rate. Its limiting distribution generally depends on the estimator of the regression and/or autoregressive parameter vector unless the errors are symmetrically distributed around zero. To overcome this difficulty it is then natural to use the median of the absolute differences of pairwise residuals, s ₂, as a scale estimator. This paper derives the asymptotic distributions of these two estimators for a large class of nonlinear regression and autoregressive models when the errors are independent and identically distributed. It is found that the asymptotic distribution of a suitably standardizes s ₂ is free of the initial estimator of the regression/autoregressive parameters. A similar conclusion also holds for s ₁ in linear regression models through the origin and with centered designs, and in linear autoregressive models with zero mean errors.  This paper also investigates the limiting distributions of these estimators in nonlinear regression models with long memory moving average errors. An interesting finding is that if the errors are symmetric around zero, then not only is the limiting distribution of a suitably standardized s ₁ free of the regression estimator, but it is degenerate at zero. On the other hand a similarly standardized s ₂ converges in distribution to a normal distribution, regardless of the errors being symmetric or not. One clear conclusion is that under the symmetry of the long memory moving average errors, the rate of consistency for s ₁ is faster than that of s ₂.     

Optimal Design Approach to GMM Estimation of Parameters Based on Empirical Transforms

Parameter estimation based on the generalized method of moments (GMM) is proposed. The proposed method employs a distance between an empirical and the corresponding theoretical transform. Estimation by the empirical characteristic function (CF) is a typical example, but alternative empirical transforms are also employed, such as the empirical Laplace transform when dealing with non‐negative random variables. D‐optimal designs are discussed, whereby the arguments of the empirical transform are chosen by maximizing the determinant of the asymptotic Fisher information matrix for the resulting estimators. The methods are applied to some parametric models for which classical inference is complicated.     

Estimating the autocorrelated error model with trended data

A Monte Carlo study of the small sample properties of various estimators of the linear regression model with first-order autocorrelated errors. When independent variables are trended, estimators using Ttransformed observations (Prais-Winsten) are much more efficient than those using T–1 (Cochrane–Orcutt). The best of the feasible estimators isiterated Prais-Winsten using a sum-of-squared-error minimizing estimate of the autocorrelation coefficient ?. None of the feasible estimators performs well in hypothesis testing; all seriously underestimate standard errors, making estimated coefficients appear to be much more significant than they actually are.     

The existence of moments of some simple Bayes estimators of coefficients in a simultaneous equation model

In this paper a simple modification of the usual k-class estimators has been suggested so that for 0 ≦ k ≦ 1 the problem of the non-existence of moments disappears. These modified estimators can be interpreted either as Bayes estimators or as constrained estimators subject to the restriction that the squared length of the coefficient vector is less than or equal to a given number.     

Consistent estimation of a regression with errors in the variables

Summary As is well known, least squares estimates of regression coefficients are inconsistent if the variables are measured with random errors. In the classical case of known variances and covariances for these error variables, consistent estimates can be derived. It is shown that these estimators generally have a joint asymptotic normal distribution, the covariance matrix of which is derived. No use is made of normality assumptions, but knowledge of the third and fourth moments of error variables is utilized.