Asymptotic theory for nonparametric regression with spatial data

Nonparametric regression with spatial, or spatio-temporal, data is considered. The conditional mean of a dependent variable, given explanatory ones, is a nonparametric function, while the conditional covariance reflects spatial correlation. Conditional heteroscedasticity is also allowed, as well as non-identically distributed observations. Instead of mixing conditions, a (possibly non-stationary) linear process is assumed for disturbances, allowing for long range, as well as short-range, dependence, while decay in dependence in explanatory variables is described using a measure based on the departure of the joint density from the product of marginal densities. A basic triangular array setting is employed, with the aim of covering various patterns of spatial observation. Sufficient conditions are established for consistency and asymptotic normality of kernel regression estimates. When the cross-sectional dependence is sufficiently mild, the asymptotic variance in the central limit theorem is the same as when observations are independent; otherwise, the rate of convergence is slower. We discuss the application of our conditions to spatial autoregressive models, and models defined on a regular lattice.     

Pseudo maximum likelihood estimation of spatial autoregressive models with increasing dimension

Pseudo maximum likelihood estimates are developed for higher-order spatial autoregressive models with increasingly many parameters, including models with spatial lags in the dependent variables both with and without a linear or nonlinear regression component, and regression models with spatial autoregressive disturbances. Consistency and asymptotic normality of the estimates are established. Monte Carlo experiments examine finite-sample behaviour.     

Large panels with common factors and spatial correlation

This paper considers methods for estimating the slope coefficients in large panel data models that are robust to the presence of various forms of error cross-section dependence. It introduces a general framework where error cross-section dependence may arise because of unobserved common effects and/or error spill-over effects due to spatial or other forms of local dependencies. Initially, this paper focuses on a panel regression model where the idiosyncratic errors are spatially dependent and possibly serially correlated, and derives the asymptotic distributions of the mean group and pooled estimators under heterogeneous and homogeneous slope coefficients, and for these estimators proposes non-parametric variance matrix estimators. The paper then considers the more general case of a panel data model with a multifactor error structure and spatial error correlations. Under this framework, the Common Correlated Effects (CCE) estimator, recently advanced by Pesaran (2006), continues to yield estimates of the slope coefficients that are consistent and asymptotically normal. Small sample properties of the estimators under various patterns of cross-section dependence, including spatial forms, are investigated by Monte Carlo experiments. Results show that the CCE approach works well in the presence of weak and/or strong cross-sectionally correlated errors.     

Heteroskedasticity and non-normality robust LM tests for spatial dependence

The standard LM tests for spatial dependence in linear and panel regressions are derived under the normality and homoskedasticity assumptions of the regression disturbances. Hence, they may not be robust against non-normality or heteroskedasticity of the disturbances. Following Born and Breitung (2011), we introduce general methods to modify the standard LM tests so that they become robust against heteroskedasticity and non-normality. The idea behind the robustification is to decompose the concentrated score function into a sum of uncorrelated terms so that the outer product of gradient (OPG) can be used to estimate its variance. We also provide methods for improving the finite sample performance of the proposed tests. These methods are then applied to several popular spatial models. Monte Carlo results show that they work well in finite sample.     

Testing for serial correlation,spatial autocorrelation and random effects using panel data

This paper considers a spatial panel data regression model with serial correlation on each spatial unit over time as well as spatial dependence between the spatial units at each point in time. In addition, the model allows for heterogeneity across the spatial units using random effects. The paper then derives several Lagrange multiplier tests for this panel data regression model including a joint test for serial correlation, spatial autocorrelation and random effects. These tests draw upon two strands of earlier work. The first is the LM tests for the spatial error correlation model discussed in Anselin and Bera [1998. Spatial dependence in linear regression models with an introduction to spatial econometrics. In: Ullah, A., Giles, D.E.A. (Eds.), Handbook of Applied Economic Statistics. Marcel Dekker, New York] and in the panel data context by Baltagi et al. [2003. Testing panel data regression models with spatial error correlation. Journal of Econometrics 117, 123–150]. The second is the LM tests for the error component panel data model with serial correlation derived by Baltagi and Li [1995. Testing AR(1) against MA(1) disturbances in an error component model. Journal of Econometrics 68, 133–151]. Hence, the joint LM test derived in this paper encompasses those derived in both strands of earlier works. In fact, in the context of our general model, the earlier LM tests become marginal LM tests that ignore either serial correlation over time or spatial error correlation. The paper then derives conditional LM and LR tests that do not ignore these correlations and contrast them with their marginal LM and LR counterparts. The small sample performance of these tests is investigated using Monte Carlo experiments. As expected, ignoring any correlation when it is significant can lead to misleading inference.     

Matching and semi-parametric IV estimation, a distance-based measure of migration, and the wages of young men

Our paper estimates the effect of US internal migration on wage growth for young men between their first and second job. Our analysis of migration extends previous research by: (i) exploiting the distance-based measures of migration in the National Longitudinal Surveys of Youth 1979 (NLSY79); (ii) allowing the effect of migration to differ by schooling level and (iii) using propensity score matching to estimate the average treatment effect on the treated (ATET) for movers and (iv) using local average treatment effect (LATE) estimators with covariates to estimate the average treatment effect (ATE) and ATET for compliers.We believe the Conditional Independence Assumption (CIA) is reasonable for our matching estimators since the NLSY79 provides a relatively rich array of variables on which to match. Our matching methods are based on local linear, local cubic, and local linear ridge regressions. Local linear and local ridge regression matching produce relatively similar point estimates and standard errors, while local cubic regression matching badly over-fits the data and provides very noisy estimates.We use the bootstrap to calculate standard errors. Since the validity of the bootstrap has not been investigated for the matching estimators we use, and has been shown to be invalid for nearest neighbor matching estimators, we conduct a Monte Carlo study on the appropriateness of using the bootstrap to calculate standard errors for local linear regression matching. The data generating processes in our Monte Carlo study are relatively rich and calibrated to match our empirical models or to test the sensitivity of our results to the choice of parameter values. The estimated standard errors from the bootstrap are very close to those from the Monte Carlo experiments, which lends support to our using the bootstrap to calculate standard errors in our setting.From the matching estimators we find a significant positive effect of migration on the wage growth of college graduates, and a marginally significant negative effect for high school dropouts. We do not find any significant effects for other educational groups or for the overall sample. Our results are generally robust to changes in the model specification and changes in our distance-based measure of migration. We find that better data matters; if we use a measure of migration based on moving across county lines, we overstate the number of moves, while if we use a measure based on moving across state lines, we understate the number of moves. Further, using either the county or state measures leads to much less precise estimates.We also consider semi-parametric LATE estimators with covariates (Frölich 2007), using two sets of instrumental variables. We precisely estimate the proportion of compliers in our data, but because we have a small number of compliers, we cannot obtain precise LATE estimates.     

Estimating and Forecasting with a Dynamic Spatial Panel Data Model*

This study focuses on the estimation and predictive performance of several estimators for the dynamic and autoregressive spatial lag panel data model with spatially correlated disturbances. In the spirit of Arellano and Bond (1991) and Mutl (2006) , a dynamic spatial generalized method of moments (GMM) estimator is proposed based on Kapoor, Kelejian and Prucha (2007) for the spatial autoregressive (SAR) error model. The main idea is to mix non‐spatial and spatial instruments to obtain consistent estimates of the parameters. Then, a linear predictor of this spatial dynamic model is derived. Using Monte Carlo simulations, we compare the performance of the GMM spatial estimator to that of spatial and non‐spatial estimators and illustrate our approach with an application to new economic geography.     

An efficient GMM estimator of spatial autoregressive models

In this paper, we consider GMM estimation of the regression and MRSAR models with SAR disturbances. We derive the best GMM estimator within the class of GMM estimators based on linear and quadratic moment conditions. The best GMM estimator has the merit of computational simplicity and asymptotic efficiency. It is asymptotically as efficient as the ML estimator under normality and asymptotically more efficient than the Gaussian QML estimator otherwise. Monte Carlo studies show that, with moderate-sized samples, the best GMM estimator has its biggest advantage when the disturbances are asymmetrically distributed. When the diagonal elements of the spatial weights matrix have enough variation, incorporating kurtosis of the disturbances in the moment functions will also be helpful.     

Robust Small Area Estimation under Spatial Non‐stationarity

The effective use of spatial information in a regression‐based approach to small area estimation is an important practical issue. One approach to account for geographic information is by extending the linear mixed model to allow for spatially correlated random area effects. An alternative is to include the spatial information by a non‐parametric mixed models. Another option is geographic weighted regression where the model coefficients vary spatially across the geography of interest. Although these approaches are useful for estimating small area means efficiently under strict parametric assumptions, they can be sensitive to outliers. In this paper, we propose robust extensions of the geographically weighted empirical best linear unbiased predictor. In particular, we introduce robust projective and predictive estimators under spatial non‐stationarity. Mean squared error estimation is performed by two analytic approaches that account for the spatial structure in the data. Model‐based simulations show that the methodology proposed often leads to more efficient estimators. Furthermore, the analytic mean squared error estimators introduced have appealing properties in terms of stability and bias. Finally, we demonstrate in the application that the new methodology is a good choice for producing estimates for average rent prices of apartments in urban planning areas in Berlin.     

Variable selection and functional form uncertainty in cross-country growth regressions

Regression analyses of cross-country economic growth data are complicated by two main forms of model uncertainty: the uncertainty in selecting explanatory variables and the uncertainty in specifying the functional form of the regression function. Most discussions in the literature address these problems independently, yet a joint treatment is essential. We present a new framework that makes such a joint treatment possible, using flexible nonlinear models specified by Gaussian process priors and addressing the variable selection problem by means of Bayesian model averaging. Using this framework, we extend the linear model to allow for parameter heterogeneity of the type suggested by new growth theory, while taking into account the uncertainty in selecting explanatory variables. Controlling for variable selection uncertainty, we confirm the evidence in favor of parameter heterogeneity presented in several earlier studies. However, controlling for functional form uncertainty, we find that the effects of many of the explanatory variables identified in the literature are not robust across countries and variable selections.     

Estimation of a non-invertible moving average process: The case of overdifferencing

The effect of differencing all of the variables in a properly specified regression equation is examined. Excessive use of the difference transformation induces a non-invertible moving average (MA) process in the disturbances of the transformed regression. Monte Carlo techniques are used to examine the effects of overdifferencing on the efficiency of regression parameter estimates, inferences based on these estimates, and tests for overdifferenccing based on the estimator of the MA parameter for the disturbances of the differences regression. Overall, the problem of overdifferencing is not serious if careful attention is paid to the properties of the disturbances of regression equations.     

Time aggregation and the distributional shape of unemployment duration

This paper reports empirical evidence on the sensitivity of unemployment duration regression estimates to distributional assumptions and to time aggregation. The results indicate that parameter estimates are robust to distributional assumptions, while estimates of duration dependence are not. Time aggregation does not seem to have drastic effects on the estimates in a simple parametric model like the Weibull, but can produce dramatic changes in the more complicated extended generalized gamma model. Semiparametric models for grouped data produce stable estimates, and perform much better than continuous-time models in terms of significance at high levels of time aggregation.     

An empirical likelihood method for spatial regression

Properties of a “blockwise”empirical likelihood for spatial regression with non-stochastic regressors are investigated for spatial data on a lattice. The method enables nonparametric confidence regions for spatial trend parameters to be calibrated, even though non-random regressors introduce non-stationary forms of spatial dependence into the “blockwise” construction. Additionally, the regression results are valid in a general framework allowing for a variety of behavior in regressor variables as well as the underlying spatial error process. The same regression method also applies when the regressors are stochastic.     

Robust subsampling

We characterize the robustness of subsampling procedures by deriving a formula for the breakdown point of subsampling quantiles. This breakdown point can be very low for moderate subsampling block sizes, which implies the fragility of subsampling procedures, even when they are applied to robust statistics. This instability arises also for data driven block size selection procedures minimizing the minimum confidence interval volatility index, but can be mitigated if a more robust calibration method can be applied instead. To overcome these robustness problems, we introduce a consistent robust subsampling procedure for M-estimators and derive explicit subsampling quantile breakdown point characterizations for MM-estimators in the linear regression model. Monte Carlo simulations in two settings where the bootstrap fails show the accuracy and robustness of the robust subsampling relative to the subsampling.     

Efficient estimation of the semiparametric spatial autoregressive model

Efficient semiparametric and parametric estimates are developed for a spatial autoregressive model, containing non-stochastic explanatory variables and innovations suspected to be non-normal. The main stress is on the case of distribution of unknown, nonparametric, form, where series nonparametric estimates of the score function are employed in adaptive estimates of parameters of interest. These estimates are as efficient as the ones based on a correct form, in particular they are more efficient than pseudo-Gaussian maximum likelihood estimates at non-Gaussian distributions. Two different adaptive estimates are considered, relying on somewhat different regularity conditions. A Monte Carlo study of finite sample performance is included.     

Estimation and testing for a partially linear single-index spatial regression model

ABSTRACT

Observations recorded on ‘locations’ usually exhibit spatial dependence. In an effort to take into account both the spatial dependence and the possible underlying non-linear relationship, a partially linear single-index spatial regression model is proposed. This paper establishes the estimators of the unknowns. Moreover, it builds a generalized F-test to determine whether or not the data provide evidence on using linear settings in empirical studies. Their asymptotic properties are derived. Monte Carlo simulations indicate that the estimators and test statistic perform well. The analysis of Chinese house price data shows the existence of both spatial dependence and a non-linear relationship.     

GMM estimation of spatial autoregressive models with unknown heteroskedasticity

In the presence of heteroskedastic disturbances, the MLE for the SAR models without taking into account the heteroskedasticity is generally inconsistent. The 2SLS estimates can have large variances and biases for cases where regressors do not have strong effects. In contrast, GMM estimators obtained from certain moment conditions can be robust. Asymptotically valid inferences can be drawn with consistently estimated covariance matrices. Efficiency can be improved by constructing the optimal weighted estimation.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

A matrix exponential spatial specification

We introduce the matrix exponential as a way of modelling spatially dependent data. The matrix exponential spatial specification (MESS) simplifies the log-likelihood allowing a closed form solution to the problem of maximum-likelihood estimation, and greatly simplifies the Bayesian estimation of the model. The MESS can produce estimates and inferences similar to those from conventional spatial autoregressive models, but has analytical, computational, and interpretive advantages. We present maximum likelihood and Bayesian approaches to the estimation of this spatial model specification along with methods of model comparisons over different explanatory variables and spatial specifications.