Variable selection for additive partially linear models with measurement error

Variable selection for additive partially linear models with measurement error is considered. By the backfitting technique, we first propose a variable selection procedure for the parametric components based on the smoothly clipped absolute deviation (SCAD) penalization, and one-step spare estimates for parametric components are also presented. The resulting estimates perform asymptotic normality as well as an oracle property. Then, two-stage backfitting estimators are also presented for the nonparametric components by using the local linear method, and the structures of asymptotic biases and covariances of the proposed estimators are the same as those in partially linear model with measurement error. The finite sample performance of the proposed procedures is illustrated by simulation studies.     

Indirect inference for dynamic panel models

Maximum likelihood (ML) estimation of the autoregressive parameter of a dynamic panel data model with fixed effects is inconsistent under fixed time series sample size and large cross section sample size asymptotics. This paper proposes a general, computationally inexpensive method of bias reduction that is based on indirect inference, shows unbiasedness and analyzes efficiency. Monte Carlo studies show that our procedure achieves substantial bias reductions with only mild increases in variance, thereby substantially reducing root mean square errors. The method is compared with certain consistent estimators and is shown to have superior finite sample properties to the generalized method of moment (GMM) and the bias-corrected ML estimator.     

The structure of simultaneous equations estimators

The formula for the Full Information Maximum Likelihood Estimator for a linear simultaneous system (with finite variance, serially independent errors) is demonstrated to be an estimator generating equation for econometrics in that all presently known estimators are readily derivable from that formula if they are considered as numerical approximations to its solution. Further, the approach immediately classifies the resulting estimators into asymptotically equivalent groups. The method is then generalised to encompass the large class of estimators for dynamic systems with (vector) autoregressive errors. The very close relationship between estimation rules and non-linear optimisation algorithms is highlighted.     

Model identification for infinite variance autoregressive processes

We consider model identification for infinite variance autoregressive time series processes. It is shown that a consistent estimate of autoregressive model order can be obtained by minimizing Akaike’s information criterion, and we use all-pass models to identify noncausal autoregressive processes and estimate the order of noncausality (the number of roots of the autoregressive polynomial inside the unit circle in the complex plane). We examine the performance of the order selection procedures for finite samples via simulation, and use the techniques to fit a noncausal autoregressive model to stock market trading volume data.     

Variable selection for varying coefficient models with measurement errors

This paper focuses on variable selections for varying coefficient models when some covariates are measured with errors. We present a bias-corrected variable selection procedure by combining basis function approximations with shrinkage estimations. With appropriate selection of the tuning parameters, we establish the consistency of the variable selection procedure, and derive the optimal convergence rate of the regularized estimators. A simulation study and a real data application are undertaken to assess the finite sample performance of the proposed variable selection procedure.     

Detecting nonlinearity in time series by model selection criteria

This article analyzes the use of model selection criteria for detecting nonlinearity in the residuals of a linear model. Model selection criteria are applied for finding the order of the best autoregressive model fitted to the squared residuals of the linear model. If the order selected is not zero, this is considered as an indication of nonlinear behavior. The BIC and AIC criteria are compared to some popular nonlinearity tests in three Monte Carlo experiments. We conclude that the BIC model selection criterion seems to offer a promising tool for detecting nonlinearity in time series. An example is shown to illustrate the performance of the tests considered and the relationship between nonlinearity and structural changes in time series.     

Trending time-varying coefficient time series models with serially correlated errors

This paper studies a time-varying coefficient time series model with a time trend function and serially correlated errors to characterize the nonlinearity, nonstationarity, and trending phenomenon. A local linear approach is developed to estimate the time trend and coefficient functions. The asymptotic properties of the proposed estimators, coupled with their comparisons with other methods, are established under the α$\alpha$-mixing conditions and without specifying the error distribution. Further, the asymptotic behaviors of the estimators at the boundaries are examined. The practical problem of implementation is also addressed. In particular, a simple nonparametric version of a bootstrap test is adapted for testing misspecification and stationarity, together with a data-driven method for selecting the bandwidth and a consistent estimate of the standard errors. Finally, results of two Monte Carlo experiments are presented to examine the finite sample performances of the proposed procedures and an empirical example is discussed.     

Adaptive estimation of autoregressive models with time-varying variances

Stable autoregressive models are considered with martingale differences errors scaled by an unknown nonparametric time-varying function generating heterogeneity. An important special case involves structural change in the error variance, but in most practical cases the pattern of variance change over time is unknown and may involve shifts at unknown discrete points in time, continuous evolution or combinations of the two. This paper develops kernel-based estimators of the residual variances and associated adaptive least squares (ALS) estimators of the autoregressive coefficients. Simulations show that efficiency gains are achieved by the adaptive procedure.     

The behaviour of inconsistent instrumental variables estimators in dynamic systems with autocorrelated errors

To appropriately interpret time-series evidence when empirical relationships are incorrectly formulated, a general mis-specification framework is required. A linear, stationary, dynamic, simultaneous system with autoregressive errors is postulated to investigate instrumental variables ables estimators when the instruments are unknowingly correlated with the equation errors. The approach uses control variates (Hendry and Harrison, Journal of Econometrics, July 1974) to develop asymptotic distributions and exact moments for approximations to the econometric estimators. The accuracy of the asymptotic results for finite sample moments is corroborated by simulation. The analysis highlights the need for care in interpreting estimated equations and tests for predictive failure.     

Testing for cointegration using partially linear models

A partially linear model of cointegration is developed where stationary covariates enter nonparametrically. We propose tests for cointegration using singular values of the estimated autoregressive matrix. The tests are based on eigenvalues of standardized matrices and are relatively simple to compute. Asymptotic theory of the proposed test is developed. It is shown that the limiting distribution of the proposed test is similar to that of several tests in the recent literature. A Gamma approximation of the distribution is discussed to facilitate inference. Finite sample properties of the proposed procedure are illustrated in some limited Monte Carlo experiments. An empirical application to US macroeconomic time series is conducted to highlight the approach.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

Estimation and model adequacy checking for multivariate seasonal autoregressive time series models with periodically varying parameters

We introduce a class of multivariate seasonal time series models with periodically varying parameters, abbreviated by the acronym SPVAR. The model is suitable for multivariate data, and combines a periodic autoregressive structure and a multiplicative seasonal time series model. The stationarity conditions (in the periodic sense) and the theoretical autocovariance functions of SPVAR stochastic processes are derived. Estimation and checking stages are considered. The asymptotic normal distribution of the least squares estimators of the model parameters is established, and the asymptotic distributions of the residual autocovariance and autocorrelation matrices in the class of SPVAR time series models are obtained. In order to check model adequacy, portmanteau test statistics are considered and their asymptotic distributions are studied. A simulation study is briefly discussed to investigate the finite-sample properties of the proposed test statistics. The methodology is illustrated with a bivariate quarterly data set on travelers entering in to Canada.     

Bayesian median autoregression for robust time series forecasting

We develop a Bayesian median autoregressive (BayesMAR) model for time series forecasting. The proposed method utilizes time-varying quantile regression at the median, favorably inheriting the robustness of median regression in contrast to the widely used mean-based methods. Motivated by a working Laplace likelihood approach in Bayesian quantile regression, BayesMAR adopts a parametric model bearing the same structure as autoregressive models by altering the Gaussian error to Laplace, leading to a simple, robust, and interpretable modeling strategy for time series forecasting. We estimate model parameters by Markov chain Monte Carlo. Bayesian model averaging is used to account for model uncertainty, including the uncertainty in the autoregressive order, in addition to a Bayesian model selection approach. The proposed methods are illustrated using simulations and real data applications. An application to U.S. macroeconomic data forecasting shows that BayesMAR leads to favorable and often superior predictive performance compared to the selected mean-based alternatives under various loss functions that encompass both point and probabilistic forecasts. The proposed methods are generic and can be used to complement a rich class of methods that build on autoregressive models.     

Asymptotic distributions of some scale estimators in nonlinear models

Often in the robust analysis of regression and time series models there is a need for having a robust scale estimator of a scale parameter of the errors. One often used scale estimator is the median of the absolute residuals s ₁. It is of interest to know its limiting distribution and the consistency rate. Its limiting distribution generally depends on the estimator of the regression and/or autoregressive parameter vector unless the errors are symmetrically distributed around zero. To overcome this difficulty it is then natural to use the median of the absolute differences of pairwise residuals, s ₂, as a scale estimator. This paper derives the asymptotic distributions of these two estimators for a large class of nonlinear regression and autoregressive models when the errors are independent and identically distributed. It is found that the asymptotic distribution of a suitably standardizes s ₂ is free of the initial estimator of the regression/autoregressive parameters. A similar conclusion also holds for s ₁ in linear regression models through the origin and with centered designs, and in linear autoregressive models with zero mean errors.  This paper also investigates the limiting distributions of these estimators in nonlinear regression models with long memory moving average errors. An interesting finding is that if the errors are symmetric around zero, then not only is the limiting distribution of a suitably standardized s ₁ free of the regression estimator, but it is degenerate at zero. On the other hand a similarly standardized s ₂ converges in distribution to a normal distribution, regardless of the errors being symmetric or not. One clear conclusion is that under the symmetry of the long memory moving average errors, the rate of consistency for s ₁ is faster than that of s ₂.     

Statistical inference on seemingly unrelated varying coefficient partially linear models

This paper is concerned with the statistical inference on seemingly unrelated varying coefficient partially linear models. By combining the local polynomial and profile least squares techniques, and estimating the contemporaneous correlation, we propose a class of weighted profile least squares estimators (WPLSEs) for the parametric components. It is shown that the WPLSEs achieve the semiparametric efficiency bound and are asymptotically normal. For the non‐parametric components, by applying the undersmoothing technique, and taking the contemporaneous correlation into account, we propose an efficient local polynomial estimation. The resulting estimators are shown to have mean‐squared errors smaller than those estimators that neglect the contemporaneous correlation. In addition, a class of variable selection procedures is developed for simultaneously selecting significant variables and estimating unknown parameters, based on the non‐concave penalized and weighted profile least squares techniques. With a proper choice of regularization parameters and penalty functions, the proposed variable selection procedures perform as efficiently as if one knew the true submodels. The proposed methods are evaluated using wide simulation studies and applied to a set of real data.     

Model selection, estimation and forecasting in VAR models with short-run and long-run restrictions

We study the joint determination of the lag length, the dimension of the cointegrating space and the rank of the matrix of short-run parameters of a vector autoregressive (VAR) model using model selection criteria. We suggest a new two-step model selection procedure which is a hybrid of traditional criteria and criteria with data-dependant penalties and we prove its consistency. A Monte Carlo study explores the finite sample performance of this procedure and evaluates the forecasting accuracy of models selected by this procedure. Two empirical applications confirm the usefulness of the model selection procedure proposed here for forecasting.     

Estimating panel data models in the presence of endogeneity and selection

We consider estimation of panel data models with sample selection when the equation of interest contains endogenous explanatory variables as well as unobserved heterogeneity. Assuming that appropriate instruments are available, we propose several tests for selection bias and two estimation procedures that correct for selection in the presence of endogenous regressors. The tests are based on the fixed effects two-stage least squares estimator, thereby permitting arbitrary correlation between unobserved heterogeneity and explanatory variables. The first correction procedure is parametric and is valid under the assumption that the errors in the selection equation are normally distributed. The second procedure estimates the model parameters semiparametrically using series estimators. In the proposed testing and correction procedures, the error terms may be heterogeneously distributed and serially dependent in both selection and primary equations. Because these methods allow for a rather flexible structure of the error variance and do not impose any nonstandard assumptions on the conditional distributions of explanatory variables, they provide a useful alternative to the existing approaches presented in the literature.     

Panel data models with spatially correlated error components

In this paper we consider a panel data model with error components that are both spatially and time-wise correlated. The model blends specifications typically considered in the spatial literature with those considered in the error components literature. We introduce generalizations of the generalized moments estimators suggested in Kelejian and Prucha (1999. A generalized moments estimator for the autoregressive parameter in a spatial model. International Economic Review 40, 509–533) for estimating the spatial autoregressive parameter and the variance components of the disturbance process. We then use those estimators to define a feasible generalized least squares procedure for the regression parameters. We give formal large sample results for the proposed estimators. We emphasize that our estimators remain computationally feasible even in large samples.     

Measuring correlations of integrated but not cointegrated variables: A semiparametric approach

Many macroeconomic and financial variables are integrated of order one (or I(1)) processes and are correlated with each other but not necessarily cointegrated. In this paper, we propose to use a semiparametric varying coefficient approach to model/capture such correlations. We propose two consistent estimators to study the dependence relationship among some integrated but not cointegrated time series variables. Simulations are used to examine the finite sample performances of the proposed estimators.