The power of bootstrap and asymptotic tests

The bootstrap discrepancy measures the difference in rejection probabilities between a bootstrap test and one based on the true distribution. The order of magnitude of the bootstrap discrepancy is the same under the null hypothesis and under non-null processes described by Pitman drift. If the test statistic is not an exact pivot, critical values depend on which data-generating process (DGP) is used to determine the null distribution. We propose using the DGP which minimizes the bootstrap discrepancy. We also show that, under an asymptotic independence condition, the power of both bootstrap and asymptotic tests can be estimated cheaply by simulation.     

Bootstrap and Asymptotic Tests of Long-run Relationships in Cointegrated Systems

Hypothesis testing on cointegrating vectors based on the asymptotic distributions of the test statistics are known to suffer from severe small sample size distortion. In this paper an alternative bootstrap procedure is proposed and evaluated through a Monte Carlo experiment, finding that the Type I errors are close to the nominal signficance levels but power might be not entirely adequate. It is then shown that a combined test based on the outcomes of both the asymptotic and the bootstrap tests will have both correct size and low Type II error, therefore improving the currently available procedures.     

Cross-sectional dependence robust block bootstrap panel unit root tests

In this paper we consider the issue of unit root testing in cross-sectionally dependent panels. We consider panels that may be characterized by various forms of cross-sectional dependence including (but not exclusive to) the popular common factor framework. We consider block bootstrap versions of the group-mean (Im et al., 2003) and the pooled (Levin et al., 2002) unit root coefficient DF tests for panel data, originally proposed for a setting of no cross-sectional dependence beyond a common time effect. The tests, suited for testing for unit roots in the observed data, can be easily implemented as no specification or estimation of the dependence structure is required. Asymptotic properties of the tests are derived for T going to infinity and N finite. Asymptotic validity of the bootstrap tests is established in very general settings, including the presence of common factors and cointegration across units. Properties under the alternative hypothesis are also considered. In a Monte Carlo simulation, the bootstrap tests are found to have rejection frequencies that are much closer to nominal size than the rejection frequencies for the corresponding asymptotic tests. The power properties of the bootstrap tests appear to be similar to those of the asymptotic tests.     

Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators

Subsampling and the m out of n bootstrap have been suggested in the literature as methods for carrying out inference based on post-model selection estimators and shrinkage estimators. In this paper we consider a subsampling confidence interval (CI) that is based on an estimator that can be viewed either as a post-model selection estimator that employs a consistent model selection procedure or as a super-efficient estimator. We show that the subsampling CI (of nominal level 1−α for any α(0,1)) has asymptotic confidence size (defined to be the limit of finite-sample size) equal to zero in a very simple regular model. The same result holds for the m out of n bootstrap provided m²/n→0 and the observations are i.i.d. Similar zero-asymptotic-confidence-size results hold in more complicated models that are covered by the general results given in the paper and for super-efficient and shrinkage estimators that are not post-model selection estimators. Based on these results, subsampling and the m out of n bootstrap are not recommended for obtaining inference based on post-consistent model selection or shrinkage estimators.     

Bootstrap unit root tests in panels with cross-sectional dependency

We apply bootstrap methodology to unit root tests for dependent panels with N cross-sectional units and T time series observations. More specifically, we let each panel be driven by a general linear process which may be different across cross-sectional units, and approximate it by a finite order autoregressive integrated process of order increasing with T. As we allow the dependency among the innovations generating the individual series, we construct our unit root tests from the estimation of the system of the entire N cross-sectional units. The limit distributions of the tests are derived by passing T to infinity, with N fixed. We then apply bootstrap method to the approximated autoregressions to obtain critical values for the panel unit root tests, and establish the asymptotic validity of such bootstrap panel unit root tests under general conditions. The proposed bootstrap tests are indeed quite general covering a wide class of panel models. They in particular allow for very general dynamic structures which may vary across individual units, and more importantly for the presence of arbitrary cross-sectional dependency. The finite sample performance of the bootstrap tests is examined via simulations, and compared to that of commonly used panel unit root tests. We find that our bootstrap tests perform relatively well, especially when N is small.     

Bootstrapping sequential change-point tests for linear regression

Bootstrap methods for sequential change-point detection procedures in linear regression models are proposed. The corresponding monitoring procedures are designed to control the overall significance level. The bootstrap critical values are updated constantly by including new observations obtained from the monitoring. The theoretical properties of these sequential bootstrap procedures are investigated, showing their asymptotic validity. Bootstrap and asymptotic methods are compared in a simulation study, showing that the studentized bootstrap tests hold the overall level better especially for small historic sample sizes while having a comparable power and run length.     

Testing for non-nested conditional moment restrictions using unconditional empirical likelihood

We propose non-nested hypothesis tests for conditional moment restriction models based on the method of generalized empirical likelihood (GEL). By utilizing the implied GEL probabilities from a sequence of unconditional moment restrictions that contains equivalent information of the conditional moment restrictions, we construct Kolmogorov–Smirnov and Cramér–von Mises type moment encompassing tests. Advantages of our tests over Otsu and Whang’s (2011) tests are: (i) they are free from smoothing parameters, (ii) they can be applied to weakly dependent data, and (iii) they allow non-smooth moment functions. We derive the null distributions, validity of a bootstrap procedure, and local and global power properties of our tests. The simulation results show that our tests have reasonable size and power performance in finite samples.     

Median unbiased forecasts for highly persistent autoregressive processes

This paper considers the construction of median unbiased forecasts for near-integrated autoregressive processes. It derives the appropriately scaled limiting distribution of the deviation of the forecast from the true conditional mean. The dependence of the limiting distribution on nuisance parameters precludes the use of the standard asymptotic and bootstrap methods for bias correction. We propose a bootstrap method that generates samples backward in time and approximates the median function of the predictive distribution on a grid of values for the nuisance parameter. The method can be easily adapted to approximate any quantile of the conditional predictive distribution.     

Testing cointegration relationship in a semiparametric varying coefficient model

In this paper, we develop two cointegration tests for two varying coefficient cointegration regression models, respectively. Our test statistics are residual based. We derive the asymptotic distributions of test statistics under the null hypothesis of cointegration and show that they are consistent against the alternative hypotheses. We also propose a wild bootstrap procedure companioned with the continuous moving block bootstrap method proposed in  Paparoditis and Politis (2001) and  Phillips (2010) to rectify severe distortions found in simulations when the sample size is small. We apply the proposed test statistic to examine the purchasing power parity (PPP) hypothesis between the US and Canada. In contrast to the existing results from linear cointegration tests, our varying coefficient cointegration test does not reject that PPP holds between the US and Canada.     

Testing the parametric form of the volatility in continuous time diffusion models—a stochastic process approach

We present new tests for the form of the volatility function which are based on stochastic processes of the integrated volatility. We prove weak convergence of these processes to centered processes whose conditional distributions are Gaussian. In the case of testing for a constant volatility the limiting process are standard Brownian bridges. As a consequence an asymptotic distribution free test and bootstrap tests (for testing of a general parametric form) can easily be implemented. It is demonstrated that the new tests are more than the currently available procedures. The new approach is also demonstrated by means of a simulation study.     

Bootstrap HAC Tests for Ordinary Least Squares Regression*

There is a need for tests that are derived from the ordinary least squares (OLS) estimators of regression coefficients and are useful in the presence of unspecified forms of heteroskedasticity and autocorrelation. A method that uses the moving block bootstrap and quasi‐estimators in order to derive a consistent estimator of the asymptotic covariance matrix for the OLS estimators and robust significance tests is proposed. The method is shown to be asymptotically valid and Monte Carlo evidence indicates that it is capable of providing good control of significance levels in finite samples and good power compared with two other bootstrap tests.     

An approximation method to derive confidence intervals for quantiles with some applications

Standard jackknife confidence intervals for a quantile Q _y (β) are usually preferred to confidence intervals based on analytical variance estimators due to their operational simplicity. However, the standard jackknife confidence intervals can give undesirable coverage probabilities for small samples sizes and large or small values of β. In this paper confidence intervals for a population quantile based on several existing estimators of a quantile are derived. These intervals are based on an approximation for the cumulative distribution function of a studentized quantile estimator. Confidence intervals are empirically evaluated by using real data and some applications are illustrated. Results derived from simulation studies show that proposed confidence intervals are narrower than confidence intervals based on the standard jackknife technique, which assumes normal approximation. Proposed confidence intervals also achieve coverage probabilities above to their nominal level. This study indicates that the proposed method can be an alternative to the asymptotic confidence intervals, which can be unknown in practice, and the standard jackknife confidence intervals, which can have poor coverage probabilities and give wider intervals.     

Joint and marginal specification tests for conditional mean and variance models

This article proposes a class of joint and marginal spectral diagnostic tests for parametric conditional means and variances of linear and nonlinear time series models. The use of joint and marginal tests is motivated from the fact that marginal tests for the conditional variance may lead to misleading conclusions when the conditional mean is misspecified. The new tests are based on a generalized spectral approach and do not need to choose a lag order depending on the sample size or to smooth the data. Moreover, the proposed tests are robust to higher order dependence of unknown form, in particular to conditional skewness and kurtosis. It turns out that the asymptotic null distributions of the new tests depend on the data generating process. Hence, we implement the tests with the assistance of a wild bootstrap procedure. A simulation study compares the finite sample performance of the proposed and competing tests, and shows that our tests can play a valuable role in time series modeling. Finally, an application to the S&P 500 highlights the merits of our approach.     

A nonparametric test for equality of distributions with mixed categorical and continuous data

In this paper we consider the problem of testing for equality of two density or two conditional density functions defined over mixed discrete and continuous variables. We smooth both the discrete and continuous variables, with the smoothing parameters chosen via least-squares cross-validation. The test statistics are shown to have (asymptotic) normal null distributions. However, we advocate the use of bootstrap methods in order to better approximate their null distribution in finite-sample settings and we provide asymptotic validity of the proposed bootstrap method. Simulations show that the proposed tests have better power than both conventional frequency-based tests and smoothing tests based on ad hoc smoothing parameter selection, while a demonstrative empirical application to the joint distribution of earnings and educational attainment underscores the utility of the proposed approach in mixed data settings.     

Exact and asymptotic tests for possibly non-regular hypotheses on stochastic volatility models

We study the problem of testing hypotheses on the parameters of one- and two-factor stochastic volatility models (SV), allowing for the possible presence of non-regularities such as singular moment conditions and unidentified parameters, which can lead to non-standard asymptotic distributions. We focus on the development of simulation-based exact procedures–whose level can be controlled in finite samples–as well as on large-sample procedures which remain valid under non-regular conditions. We consider Wald-type, score-type and likelihood-ratio-type tests based on a simple moment estimator, which can be easily simulated. We also propose a C(α)-type test which is very easy to implement and exhibits relatively good size and power properties. Besides usual linear restrictions on the SV model coefficients, the problems studied include testing homoskedasticity against a SV alternative (which involves singular moment conditions under the null hypothesis) and testing the null hypothesis of one factor driving the dynamics of the volatility process against two factors (which raises identification difficulties). Three ways of implementing the tests based on alternative statistics are compared: asymptotic critical values (when available), a local Monte Carlo (or parametric bootstrap) test procedure, and a maximized Monte Carlo (MMC) procedure. The size and power properties of the proposed tests are examined in a simulation experiment. The results indicate that the C(α)-based tests (built upon the simple moment estimator available in closed form) have good size and power properties for regular hypotheses, while Monte Carlo tests are much more reliable than those based on asymptotic critical values. Further, in cases where the parametric bootstrap appears to fail (for example, in the presence of identification problems), the MMC procedure easily controls the level of the tests. Moreover, MMC-based tests exhibit relatively good power performance despite the conservative feature of the procedure. Finally, we present an application to a time series of returns on the Standard and Poor’s Composite Price Index.     

Two-stage stationary bootstrapping for bivariate average realized volatility matrix under market microstructure noise and asynchronicity

Under the two important modern financial market features of noise and non-synchronicity for multiple assets, for consistent estimators of the integrated covariations, we adopt the two-time scale average realized volatility matrix (ARVM) which is a matrix extension of the two-time scale realized volatilities of Zhang et al. (2005). An asymptotic normal theory is provided for the two-time scale ARVM and resulting realized covariations. The asymptotic normality is not directly applicable in practice to construct statistical methods owning to nuisance parameters. To bypass the nuisance parameter problem, two-stage stationary bootstrapping is proposed. We establish consistencies of the bootstrap distributions, and construct confidence intervals and hypothesis tests for the integrated covariance, regression coefficient and correlation coefficient. The validity of the stationary bootstrap for the high frequency heterogeneous returns is proved by showing that there exist parameters of the stationary bootstrap blocks so that the bootstrap consistencies hold. The proposed bootstrap methods extend the i.i.d. bootstrapping methods for realized covariations by Dovonon et al. (2013), that are confined to synchronous noise-free sampling. For high frequency noisy asynchronous samples, a Monte-Carlo experiment shows better finite sample performances of the proposed stationary bootstrap methods based on the two-time scale ARVM estimator than the wild blocks of blocks bootstrap methods of Hounyo (2017), based on pre-averaged truncated estimator.     

Specification testing for regression models with dependent data

We examine a consistent test for the correct specification of a regression function with dependent data. The test is based on the supremum of the difference between the parametric and nonparametric estimates of the regression model. Rather surprisingly, the behaviour of the test depends on whether the regressors are deterministic or stochastic. In the former situation, the normalization constants necessary to obtain the limiting Gumbel distribution are data dependent and difficult to estimate, so it may be difficult to obtain valid critical values, whereas, in the latter, the asymptotic distribution may not be even known. Because of that, under very mild regularity conditions, we describe a bootstrap analogue for the test, showing its asymptotic validity and finite sample behaviour in a small Monte-Carlo experiment.     

External bootstrap tests for parameter stability

This article considers tests for parameter stability over time in general econometric models, possibly nonlinear-in-variables. Existing test statistics are commonly not asymptotically pivotal under nonstandard conditions. In such cases, the external bootstrap tests proposed in this paper are appealing from a practical viewpoint. We propose to use bootstrap versions of the asymptotic critical values based on a first-order asymptotic expansion of the test statistics under the null hypothesis, which consists of a linear transformation of the unobserved “innovations” partial sum process. The nature of these transformations under nonstandard conditions is discussed for the main testing principles. Also, we investigate the small sample performance of the proposed bootstrap tests by means of a small Monte Carlo experiment.     

Asymptotic and bootstrap prediction regions for vector autoregression

Small sample properties of asymptotic and bootstrap prediction regions for VAR models are evaluated and compared. Monte Carlo simulations reveal that the bootstrap prediction region based on the percentile-t method outperforms its asymptotic and other bootstrap alternatives in small samples. It provides the most accurate assessment of future uncertainty under both normal and non-normal innovations. The use of an asymptotic prediction region may result in a serious under-estimation of future uncertainty when the sample size is small. When the model is near non-stationary, the use of the bootstrap region based on the percentile-t method is recommended, although extreme care should be taken when it is used for medium to long-term forecasting.     

Testing the adequacy of varying coefficient models with missing responses at random

In this paper, we investigate checking the adequacy of varying coefficient models with response missing at random. In doing so, we first construct two completed data sets based on imputation and marginal inverse probability weighted methods, respectively. The empirical process-based tests by using these two completed data sets are suggested and the asymptotic properties of the test statistics under the null and local alternative hypotheses are studied. Because the limiting null distribution is intractable, a Monte Carlo approach is applied to approximate the distribution to determine critical values. Simulation studies are carried out to examine the performance of our method, and a real data set from an environmental study is analyzed for illustration.