Bootstrapping cointegrating regressions

In this paper, we consider bootstrapping cointegrating regressions. It is shown that the method of bootstrap, if properly implemented, generally yields consistent estimators and test statistics for cointegrating regressions. For the cointegrating regression models driven by general linear processes, we employ the sieve bootstrap based on the approximated finite-order vector autoregressions for the regression errors and the first differences of the regressors. In particular, we establish the bootstrap consistency for OLS method. The bootstrap method can thus be used to correct for the finite sample bias of the OLS estimator and to approximate the asymptotic critical values of the OLS-based test statistics in general cointegrating regressions. The bootstrap OLS procedure, however, is not efficient. For the efficient estimation and hypothesis testing, we consider the procedure proposed by Saikkonen [1991. Asymptotically efficient estimation of cointegration regressions. Econometric Theory 7, 1–21] and Stock and Watson [1993. A simple estimator of cointegrating vectors in higher order integrating systems. Econometrica 61, 783–820] relying on the regression augmented with the leads and lags of differenced regressors. The bootstrap versions of their procedures are shown to be consistent, and can be used to do asymptotically valid inferences. A Monte Carlo study is conducted to investigate the finite sample performances of the proposed bootstrap methods.     

The power of bootstrap and asymptotic tests

The bootstrap discrepancy measures the difference in rejection probabilities between a bootstrap test and one based on the true distribution. The order of magnitude of the bootstrap discrepancy is the same under the null hypothesis and under non-null processes described by Pitman drift. If the test statistic is not an exact pivot, critical values depend on which data-generating process (DGP) is used to determine the null distribution. We propose using the DGP which minimizes the bootstrap discrepancy. We also show that, under an asymptotic independence condition, the power of both bootstrap and asymptotic tests can be estimated cheaply by simulation.     

The wild bootstrap,tamed at last

The wild bootstrap is studied in the context of regression models with heteroskedastic disturbances. We show that, in one very specific case, perfect bootstrap inference is possible, and a substantial reduction in the error in the rejection probability of a bootstrap test is available much more generally. However, the version of the wild bootstrap with this desirable property is without the skewness correction afforded by the currently most popular version of the wild bootstrap. Simulation experiments show that this does not prevent the preferred version from having the smallest error in rejection probability in small and medium-sized samples.     

Bootstrapping realized multivariate volatility measures

We propose a bootstrap method for statistics that are a function of multivariate high frequency returns such as realized regression, covariance and correlation coefficients. We show that the finite sample performance of the bootstrap is superior to the existing first-order asymptotic theory. Nevertheless, and contrary to the existing results in the bootstrap literature for regression models subject to error heteroskedasticity, the Edgeworth expansion for the pairs bootstrap that we develop here shows that this method is not second-order accurate. We argue that this is due to the fact that the conditional mean parameters of realized regression models are heterogeneous under stochastic volatility.     

On the Applicability of the Sieve Bootstrap in Time Series Panels*

In this article, we investigate the validity of the univariate autoregressive sieve bootstrap applied to time series panels characterized by general forms of cross‐sectional dependence, including but not restricted to cointegration. Using the final equations approach we show that while it is possible to write such a panel as a collection of infinite order autoregressive equations, the innovations of these equations are not vector white noise. This causes the univariate autoregressive sieve bootstrap to be invalid in such panels. We illustrate this result with a small numerical example using a simple DGP for which the sieve bootstrap is invalid, and show that the extent of the invalidity depends on the value of specific parameters. We also show that Monte Carlo simulations in small samples can be misleading about the validity of the univariate autoregressive sieve bootstrap. The results in this article serve as a warning about the practical use of the autoregressive sieve bootstrap in panels where cross‐sectional dependence of general form may be present.     

Two-stage stationary bootstrapping for bivariate average realized volatility matrix under market microstructure noise and asynchronicity

Under the two important modern financial market features of noise and non-synchronicity for multiple assets, for consistent estimators of the integrated covariations, we adopt the two-time scale average realized volatility matrix (ARVM) which is a matrix extension of the two-time scale realized volatilities of Zhang et al. (2005). An asymptotic normal theory is provided for the two-time scale ARVM and resulting realized covariations. The asymptotic normality is not directly applicable in practice to construct statistical methods owning to nuisance parameters. To bypass the nuisance parameter problem, two-stage stationary bootstrapping is proposed. We establish consistencies of the bootstrap distributions, and construct confidence intervals and hypothesis tests for the integrated covariance, regression coefficient and correlation coefficient. The validity of the stationary bootstrap for the high frequency heterogeneous returns is proved by showing that there exist parameters of the stationary bootstrap blocks so that the bootstrap consistencies hold. The proposed bootstrap methods extend the i.i.d. bootstrapping methods for realized covariations by Dovonon et al. (2013), that are confined to synchronous noise-free sampling. For high frequency noisy asynchronous samples, a Monte-Carlo experiment shows better finite sample performances of the proposed stationary bootstrap methods based on the two-time scale ARVM estimator than the wild blocks of blocks bootstrap methods of Hounyo (2017), based on pre-averaged truncated estimator.     

Higher order properties of the wild bootstrap under misspecification

We examine the higher order properties of the wild bootstrap (Wu, 1986) in a linear regression model with stochastic regressors. We find that the ability of the wild bootstrap to provide a higher order refinement is contingent upon whether the errors are mean independent of the regressors or merely uncorrelated with them. In the latter case, the wild bootstrap may fail to match some of the terms in an Edgeworth expansion of the full sample test statistic. Nonetheless, we show that the wild bootstrap still has a lower maximal asymptotic risk as an estimator of the true distribution than a normal approximation, in shrinking neighborhoods of properly specified models. To assess the practical implications of this result we conduct a Monte Carlo study contrasting the performance of the wild bootstrap with a normal approximation and the traditional nonparametric bootstrap.     

Bootstrap testing for the null of no cointegration in a threshold vector error correction model

We develop a test for the linear no cointegration null hypothesis in a threshold vector error correction model. We adopt a sup-Wald type test and derive its null asymptotic distribution. A residual-based bootstrap is proposed, and the first-order consistency of the bootstrap is established. A set of Monte Carlo simulations shows that the bootstrap corrects size distortion of asymptotic distribution in finite samples, and that its power against the threshold cointegration alternative is significantly greater than that of conventional cointegration tests. Our method is illustrated with used car price indexes.     

Uniform confidence bands for functions estimated nonparametrically with instrumental variables

This paper is concerned with developing uniform confidence bands for functions estimated nonparametrically with instrumental variables. We show that a sieve nonparametric instrumental variables estimator is pointwise asymptotically normally distributed. The asymptotic normality result holds in both mildly and severely ill-posed cases. We present methods to obtain a uniform confidence band and show that the bootstrap can be used to obtain the required critical values. Monte Carlo experiments illustrate the finite-sample performance of the uniform confidence band.     

Asymptotic and bootstrap inference for inequality and poverty measures

A random sample drawn from a population would appear to offer an ideal opportunity to use the bootstrap in order to perform accurate inference, since the observations of the sample are IID. In this paper, Monte Carlo results suggest that bootstrapping a commonly used index of inequality leads to inference that is not accurate even in very large samples, although inference with poverty indices is satisfactory. We find that the major cause is the extreme sensitivity of many inequality indices to the exact nature of the upper tail of the income distribution. This leads us to study two non-standard bootstraps, the m out of n bootstrap, which is valid in some situations where the standard bootstrap fails, and a bootstrap in which the upper tail is modelled parametrically. Monte Carlo results suggest that accurate inference can be achieved with this last method in moderately large samples.     

Estimation and inference in two-stage,semi-parametric models of production processes

Many papers have regressed non-parametric estimates of productive efficiency on environmental variables in two-stage procedures to account for exogenous factors that might affect firms’ performance. None of these have described a coherent data-generating process (DGP). Moreover, conventional approaches to inference employed in these papers are invalid due to complicated, unknown serial correlation among the estimated efficiencies. We first describe a sensible DGP for such models. We propose single and double bootstrap procedures; both permit valid inference, and the double bootstrap procedure improves statistical efficiency in the second-stage regression. We examine the statistical performance of our estimators using Monte Carlo experiments.     

Practical Considerations for Choosing Between Tobit and SCLS or CLAD Estimators for Censored Regression Models with an Application to Charitable Giving*

Practical considerations for choosing between Tobit, symmetrically censored least squares (SCLS) and censored least absolute deviations (CLAD) estimators are offered. Practical considerations deal with when a Hausman test is better than a conditional moment test for judging the severity of a misspecification, the need to bootstrap the sampling distributions of the Hausman tests, what to look for in a graphical examination of the residuals and the limited value of SCLS. The practical considerations are applied to a model of the intergenerational transmission of charitable giving using new data from the Panel Study of Income Dynamics (PSID). The paper shows how to use relative distribution methods to calculate CLAD‐based marginal effects on the observable dependent variable.     

Income distribution and inequality measurement: The problem of extreme values

We examine the statistical performance of inequality indices in the presence of extreme values in the data and show that these indices are very sensitive to the properties of the income distribution. Estimation and inference can be dramatically affected, especially when the tail of the income distribution is heavy, even when standard bootstrap methods are employed. However, use of appropriate semiparametric methods for modelling the upper tail can greatly improve the performance of even those inequality indices that are normally considered particularly sensitive to extreme values.     

Cross-sectional dependence robust block bootstrap panel unit root tests

In this paper we consider the issue of unit root testing in cross-sectionally dependent panels. We consider panels that may be characterized by various forms of cross-sectional dependence including (but not exclusive to) the popular common factor framework. We consider block bootstrap versions of the group-mean (Im et al., 2003) and the pooled (Levin et al., 2002) unit root coefficient DF tests for panel data, originally proposed for a setting of no cross-sectional dependence beyond a common time effect. The tests, suited for testing for unit roots in the observed data, can be easily implemented as no specification or estimation of the dependence structure is required. Asymptotic properties of the tests are derived for T going to infinity and N finite. Asymptotic validity of the bootstrap tests is established in very general settings, including the presence of common factors and cointegration across units. Properties under the alternative hypothesis are also considered. In a Monte Carlo simulation, the bootstrap tests are found to have rejection frequencies that are much closer to nominal size than the rejection frequencies for the corresponding asymptotic tests. The power properties of the bootstrap tests appear to be similar to those of the asymptotic tests.     

A fast resample method for parametric and semiparametric models

We propose a fast resample method for two step nonlinear parametric and semiparametric models, which does not require recomputation of the second stage estimator during each resample iteration. The fast resample method directly exploits the score function representations computed on each bootstrap sample, thereby reducing computational time considerably. This method is used to approximate the limit distribution of parametric and semiparametric estimators, possibly simulation based, that admit an asymptotic linear representation. Monte Carlo experiments demonstrate the desirable performance and vast improvement in the numerical speed of the fast bootstrap method.     

Smooth minimum distance estimation and testing with conditional estimating equations: Uniform in bandwidth theory

To study the influence of a bandwidth parameter in inference with conditional moments, we propose a new class of estimators and establish an asymptotic representation of our estimator as a process indexed by a bandwidth, which can vary within a wide range including bandwidths independent of the sample size. We study its behavior under misspecification. We also propose an efficient version of our estimator. We develop a procedure based on a distance metric statistic for testing restrictions on parameters as well as a bootstrap technique to account for the bandwidth’s influence. Our new methods are simple to implement, apply to non-smooth problems, and perform well in our simulations.     

Bootstrapping I(1) data

A functional law is given for an I(1) sample data version of the continuous-path block bootstrap of Paparoditis and Politis (2001a). The results provide an alternative demonstration that continuous-path block bootstrap unit root tests are consistent under the null.     

Likelihood inference in some finite mixture models

Parametric mixture models are commonly used in applied work, especially empirical economics, where these models are often employed to learn for example about the proportions of various types in a given population. This paper examines the inference question on the proportions (mixing probability) in a simple mixture model in the presence of nuisance parameters when sample size is large. It is well known that likelihood inference in mixture models is complicated due to (1) lack of point identification, and (2) parameters (for example, mixing probabilities) whose true value may lie on the boundary of the parameter space. These issues cause the profiled likelihood ratio (PLR) statistic to admit asymptotic limits that differ discontinuously depending on how the true density of the data approaches the regions of singularities where there is lack of point identification. This lack of uniformity in the asymptotic distribution suggests that confidence intervals based on pointwise asymptotic approximations might lead to faulty inferences. This paper examines this problem in details in a finite mixture model and provides possible fixes based on the parametric bootstrap. We examine the performance of this parametric bootstrap in Monte Carlo experiments and apply it to data from Beauty Contest experiments. We also examine small sample inferences and projection methods.     

Bootstrap HAC Tests for Ordinary Least Squares Regression*

There is a need for tests that are derived from the ordinary least squares (OLS) estimators of regression coefficients and are useful in the presence of unspecified forms of heteroskedasticity and autocorrelation. A method that uses the moving block bootstrap and quasi‐estimators in order to derive a consistent estimator of the asymptotic covariance matrix for the OLS estimators and robust significance tests is proposed. The method is shown to be asymptotically valid and Monte Carlo evidence indicates that it is capable of providing good control of significance levels in finite samples and good power compared with two other bootstrap tests.