Size and Power of the Error Correction Model Cointegration Test. A Bootstrap Approach

The size and power of the ECM cointegration test are investigated by using the 'bootstrap critical values'. The purpose of this paper is to show the ability of the bootstrap technique to produce critical values which are much more accurate than the asymptotic ones. The properties of the test have been studied, using Monte Carlo methods, for three different data generating processes. As regards the size of the test, we find that the ECM cointegration test together with the bootstrap critical values perform better than the ECM cointegration test based on the asymptotic critical values. While as regards the power of the tests, the results prove to be similar for the different versions.     

Exact and asymptotic tests for possibly non-regular hypotheses on stochastic volatility models

We study the problem of testing hypotheses on the parameters of one- and two-factor stochastic volatility models (SV), allowing for the possible presence of non-regularities such as singular moment conditions and unidentified parameters, which can lead to non-standard asymptotic distributions. We focus on the development of simulation-based exact procedures–whose level can be controlled in finite samples–as well as on large-sample procedures which remain valid under non-regular conditions. We consider Wald-type, score-type and likelihood-ratio-type tests based on a simple moment estimator, which can be easily simulated. We also propose a C(α)-type test which is very easy to implement and exhibits relatively good size and power properties. Besides usual linear restrictions on the SV model coefficients, the problems studied include testing homoskedasticity against a SV alternative (which involves singular moment conditions under the null hypothesis) and testing the null hypothesis of one factor driving the dynamics of the volatility process against two factors (which raises identification difficulties). Three ways of implementing the tests based on alternative statistics are compared: asymptotic critical values (when available), a local Monte Carlo (or parametric bootstrap) test procedure, and a maximized Monte Carlo (MMC) procedure. The size and power properties of the proposed tests are examined in a simulation experiment. The results indicate that the C(α)-based tests (built upon the simple moment estimator available in closed form) have good size and power properties for regular hypotheses, while Monte Carlo tests are much more reliable than those based on asymptotic critical values. Further, in cases where the parametric bootstrap appears to fail (for example, in the presence of identification problems), the MMC procedure easily controls the level of the tests. Moreover, MMC-based tests exhibit relatively good power performance despite the conservative feature of the procedure. Finally, we present an application to a time series of returns on the Standard and Poor’s Composite Price Index.     

LM tests of spatial dependence based on bootstrap critical values

To test the existence of spatial dependence in an econometric model, a convenient test is the Lagrange Multiplier (LM) test. However, evidence shows that, in finite samples, the LM test referring to asymptotic critical values may suffer from the problems of size distortion and low power, which become worse with a denser spatial weight matrix. In this paper, residual-based bootstrap methods are introduced for asymptotically refined approximations to the finite sample critical values of the LM statistics. Conditions for their validity are clearly laid out and formal justifications are given in general, and in detail under several popular spatial LM tests using Edgeworth expansions. Monte Carlo results show that when the conditions are not fully met, bootstrap may lead to unstable critical values that change significantly with the alternative, whereas when all conditions are met, bootstrap critical values are very stable, approximate much better the finite sample critical values than those based on asymptotics, and lead to significantly improved size and power. The methods are further demonstrated using more general spatial LM tests, in connection with local misspecification and unknown heteroskedasticity.     

Bootstrap HAC Tests for Ordinary Least Squares Regression*

There is a need for tests that are derived from the ordinary least squares (OLS) estimators of regression coefficients and are useful in the presence of unspecified forms of heteroskedasticity and autocorrelation. A method that uses the moving block bootstrap and quasi‐estimators in order to derive a consistent estimator of the asymptotic covariance matrix for the OLS estimators and robust significance tests is proposed. The method is shown to be asymptotically valid and Monte Carlo evidence indicates that it is capable of providing good control of significance levels in finite samples and good power compared with two other bootstrap tests.     

Robust Non‐nested Testing for Ordinary Least Squares Regression when Some of the Regressors are Lagged Dependent Variables*

The problem of testing non‐nested regression models that include lagged values of the dependent variable as regressors is discussed. It is argued that it is essential to test for error autocorrelation if ordinary least squares and the associated J and F tests are to be used. A heteroskedasticity–robust joint test against a combination of the artificial alternatives used for autocorrelation and non‐nested hypothesis tests is proposed. Monte Carlo results indicate that implementing this joint test using a wild bootstrap method leads to a well‐behaved procedure and gives better control of finite sample significance levels than asymptotic critical values.     

Micro versus macro cointegration in heterogeneous panels

We consider the issue of cross-sectional aggregation in nonstationary and heterogeneous panels where each unit cointegrates. We derive asymptotic properties of the aggregate estimate, and necessary and sufficient conditions for cointegration to hold in the aggregate relationship. We then analyze the case when cointegration does not carry through the aggregation process, and we investigate whether the violation of the formal conditions for perfect aggregation can still lead to an aggregate equation that is observationally equivalent to a cointegrated relationship. We derive a measure of the degree of noncointegration of the aggregate relationship and we explore its asymptotic properties. We propose a valid bootstrap approximation of the test. A Monte Carlo exercise evaluates size and power properties of the bootstrap test.     

BOOTSTRAPPING A STABLE AD MODEL: WEAK VS STRONG EXOGENEITY*

Through Monte Carlo experiments the effects of a feedback mechanism on the accuracy in finite samples of ordinary and bootstrap inference procedures are examined in stable first- and second-order autoregressive distributed-lag models with non-stationary weakly exogenous regressors. The Monte Carlo is designed to mimic situations that are relevant when a weakly exogenous policy variable affects (and is affected by) the outcome of agents’ behaviour. In the parameterizations we consider, it is found that small-sample problems undermine ordinary first-order asymptotic inference procedures irrespective of the presence and importance of a feedback mechanism. We examine several residual-based bootstrap procedures, each of them designed to reduce one or several specific types of bootstrap approximation error. Surprisingly, the bootstrap procedure which only incorporates the conditional model overcomes the small sample problems reasonably well. Often (but not always) better results are obtained if the bootstrap also resamples the marginal model for the policymakers’ behaviour.     

A bootstrap algorithm for testing cointegration rank in VAR models in the presence of stationary variables

In this paper, a bootstrap algorithm for a reduced rank vector autoregressive (VAR) model which also includes stationary regressors, is analyzed. It is shown that the bootstrap distribution for estimating the rank converges to the distribution derived from the usual asymptotic framework. Because the asymptotic distribution will typically depend on unknown parameters, bootstrap distributions are of considerable interest in this context. The result of an application and some Monte Carlo experiments are also presented.     

An examination of the dynamic behaviour of local governments using GMM bootstrapping methods

Even though recent Monte Carlo evidence has shown that the use of bootstrap critical values, instead of asymptotic ones, improves the size of the tests substantially, empirical applications using GMM bootstrap techniques are largely missing. In this paper, the dynamic relationship between local government revenues and expenditures is re‐investigated using GMM bootstrapping techniques on a panel of 265 Swedish municipalities over the period 1979–1987. A lag of one year is found in the expenditures equation, while no dynamics is found in the own‐source revenues and grants equations. These results, while contrasting sharply with those obtained when asymptotic critical values are used, are well in line with the theoretical explanations given in the literature for dynamic behaviour in the local public sector. Copyright © 2000 John Wiley & Sons, Ltd.     

Bootstrap and Asymptotic Tests of Long-run Relationships in Cointegrated Systems

Hypothesis testing on cointegrating vectors based on the asymptotic distributions of the test statistics are known to suffer from severe small sample size distortion. In this paper an alternative bootstrap procedure is proposed and evaluated through a Monte Carlo experiment, finding that the Type I errors are close to the nominal signficance levels but power might be not entirely adequate. It is then shown that a combined test based on the outcomes of both the asymptotic and the bootstrap tests will have both correct size and low Type II error, therefore improving the currently available procedures.     

Bootstrap testing for the null of no cointegration in a threshold vector error correction model

We develop a test for the linear no cointegration null hypothesis in a threshold vector error correction model. We adopt a sup-Wald type test and derive its null asymptotic distribution. A residual-based bootstrap is proposed, and the first-order consistency of the bootstrap is established. A set of Monte Carlo simulations shows that the bootstrap corrects size distortion of asymptotic distribution in finite samples, and that its power against the threshold cointegration alternative is significantly greater than that of conventional cointegration tests. Our method is illustrated with used car price indexes.     

Testing parametric conditional distributions using the nonparametric smoothing method

This paper proposes a new goodness-of-fit test for parametric conditional probability distributions using the nonparametric smoothing methodology. An asymptotic normal distribution is established for the test statistic under the null hypothesis of correct specification of the parametric distribution. The test is shown to have power against local alternatives converging to the null at certain rates. The test can be applied to testing for possible misspecifications in a wide variety of parametric models. A bootstrap procedure is provided for obtaining more accurate critical values for the test. Monte Carlo simulations show that the test has good power against some common alternatives.     

Stationary bootstrapping for common mean change detection in cross-sectionally dependent panels

Stationary bootstrapping is applied to a CUSUM test for common mean break detection in cross-sectionally correlated panel data. Asymptotic null distribution of the bootstrapped test is derived, which is the same as that of the original CUSUM test depending on cross-sectional correlation parameter. A bootstrap test using the CUSUM test with bootstrap critical values is proposed and its asymptotic validity is proved. Finite sample Monte-Carlo simulation shows that the proposed test has reasonable size while other existing tests have severe size distortion under cross-section correlation. The simulation also shows good power performance of the proposed test against non-cancelling mean changes. The simulation also shows that the theoretically justified stationary bootstrapping CUSUM test has comparable size and power relative to other, theoretically unjustified, moving block or tapered block bootstrapping CUSUM tests.     

Asymptotic and bootstrap prediction regions for vector autoregression

Small sample properties of asymptotic and bootstrap prediction regions for VAR models are evaluated and compared. Monte Carlo simulations reveal that the bootstrap prediction region based on the percentile-t method outperforms its asymptotic and other bootstrap alternatives in small samples. It provides the most accurate assessment of future uncertainty under both normal and non-normal innovations. The use of an asymptotic prediction region may result in a serious under-estimation of future uncertainty when the sample size is small. When the model is near non-stationary, the use of the bootstrap region based on the percentile-t method is recommended, although extreme care should be taken when it is used for medium to long-term forecasting.     

Uniform confidence bands for functions estimated nonparametrically with instrumental variables

This paper is concerned with developing uniform confidence bands for functions estimated nonparametrically with instrumental variables. We show that a sieve nonparametric instrumental variables estimator is pointwise asymptotically normally distributed. The asymptotic normality result holds in both mildly and severely ill-posed cases. We present methods to obtain a uniform confidence band and show that the bootstrap can be used to obtain the required critical values. Monte Carlo experiments illustrate the finite-sample performance of the uniform confidence band.     

External bootstrap tests for parameter stability

This article considers tests for parameter stability over time in general econometric models, possibly nonlinear-in-variables. Existing test statistics are commonly not asymptotically pivotal under nonstandard conditions. In such cases, the external bootstrap tests proposed in this paper are appealing from a practical viewpoint. We propose to use bootstrap versions of the asymptotic critical values based on a first-order asymptotic expansion of the test statistics under the null hypothesis, which consists of a linear transformation of the unobserved “innovations” partial sum process. The nature of these transformations under nonstandard conditions is discussed for the main testing principles. Also, we investigate the small sample performance of the proposed bootstrap tests by means of a small Monte Carlo experiment.     

A Comparison of Sequential and Information‐based Methods for Determining the Co‐integration Rank in Heteroskedastic VAR Models

In this article, we investigate the behaviour of a number of methods for estimating the co‐integration rank in VAR systems characterized by heteroskedastic innovation processes. In particular, we compare the efficacy of the most widely used information criteria, such as Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) , with the commonly used sequential approach of Johansen [Likelihood‐based Inference in Cointegrated Vector Autoregressive Models (1996)] based around the use of either asymptotic or wild bootstrap‐based likelihood ratio type tests. Complementing recent work done for the latter in Cavaliere, Rahbek and Taylor [Econometric Reviews (2014) forthcoming], we establish the asymptotic properties of the procedures based on information criteria in the presence of heteroskedasticity (conditional or unconditional) of a quite general and unknown form. The relative finite‐sample properties of the different methods are investigated by means of a Monte Carlo simulation study. For the simulation DGPs considered in the analysis, we find that the BIC‐based procedure and the bootstrap sequential test procedure deliver the best overall performance in terms of their frequency of selecting the correct co‐integration rank across different values of the co‐integration rank, sample size, stationary dynamics and models of heteroskedasticity. Of these, the wild bootstrap procedure is perhaps the more reliable overall as it avoids a significant tendency seen in the BIC‐based method to over‐estimate the co‐integration rank in relatively small sample sizes.     

Testing for linear vector autoregressive dynamics under multivariate generalized autoregressive heteroskedasticity

In this paper, we propose a fixed design wild bootstrap procedure to test parameter restrictions in vector autoregressive models, which is robust in cases of conditionally heteroskedastic error terms. The wild bootstrap does not require any parametric specification of the volatility process and takes contemporaneous error correlation implicitly into account. Via a Monte Carlo investigation, empirical size and power properties of the method are illustrated for the case of white noise under the null hypothesis. We compare the bootstrap approach with standard ordinary least squares (OLS)-based, weighted least squares (WLS) and quasi-maximum likelihood (QML) approaches. In terms of empirical size, the proposed method outperforms competing approaches and achieves size-adjusted power close to WLS or QML inference. A White correction of standard OLS inference is satisfactory only in large samples. We investigate the case of Granger causality in a bivariate system of inflation expectations in France and the United Kingdom. Our evidence suggests that the former are Granger causal for the latter while for the reverse relation Granger non-causality cannot be rejected.     

Empirical likelihood block bootstrapping

Monte Carlo evidence has made it clear that asymptotic tests based on generalized method of moments (GMM) estimation have disappointing size. The problem is exacerbated when the moment conditions are serially correlated. Several block bootstrap techniques have been proposed to correct the problem, including Hall and Horowitz (1996) and Inoue and Shintani (2006). We propose an empirical likelihood block bootstrap procedure to improve inference where models are characterized by nonlinear moment conditions that are serially correlated of possibly infinite order. Combining the ideas of Kitamura (1997) and Brown and Newey (2002), the parameters of a model are initially estimated by GMM which are then used to compute the empirical likelihood probability weights of the blocks of moment conditions. The probability weights serve as the multinomial distribution used in resampling. The first-order asymptotic validity of the proposed procedure is proven, and a series of Monte Carlo experiments show it may improve test sizes over conventional block bootstrapping.     

Cross-sectional dependence robust block bootstrap panel unit root tests

In this paper we consider the issue of unit root testing in cross-sectionally dependent panels. We consider panels that may be characterized by various forms of cross-sectional dependence including (but not exclusive to) the popular common factor framework. We consider block bootstrap versions of the group-mean (Im et al., 2003) and the pooled (Levin et al., 2002) unit root coefficient DF tests for panel data, originally proposed for a setting of no cross-sectional dependence beyond a common time effect. The tests, suited for testing for unit roots in the observed data, can be easily implemented as no specification or estimation of the dependence structure is required. Asymptotic properties of the tests are derived for T going to infinity and N finite. Asymptotic validity of the bootstrap tests is established in very general settings, including the presence of common factors and cointegration across units. Properties under the alternative hypothesis are also considered. In a Monte Carlo simulation, the bootstrap tests are found to have rejection frequencies that are much closer to nominal size than the rejection frequencies for the corresponding asymptotic tests. The power properties of the bootstrap tests appear to be similar to those of the asymptotic tests.