Generalized empirical likelihood tests in time series models with potential identification failure

We introduce test statistics based on generalized empirical likelihood methods that can be used to test simple hypotheses involving the unknown parameter vector in moment condition time series models. The test statistics generalize those in Guggenberger and Smith [2005. Generalized empirical likelihood estimators and tests under partial, weak and strong identification. Econometric Theory 21 (4), 667–709] from the i.i.d. to the time series context and are alternatives to those in Kleibergen [2005a. Testing parameters in GMM without assuming that they are identified. Econometrica 73 (4), 1103–1123] and Otsu [2006. Generalized empirical likelihood inference for nonlinear and time series models under weak identification. Econometric Theory 22 (3), 513–527]. The main feature of these tests is that their empirical null rejection probabilities are not affected much by the strength or weakness of identification. More precisely, we show that the statistics are asymptotically distributed as chi-square under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright [2000. GMM with weak identification. Econometrica 68 (5), 1055–1096]. We also introduce a modification to Otsu's (2006) statistic that is computationally more attractive. A Monte Carlo study reveals that the finite-sample performance of the suggested tests is very competitive.     

The optimal choice of moments in dynamic panel data models

This paper derives an approximation of the mean square error (MSE) of the GMM estimator in dynamic panel data models. The approximation is based on higher-order asymptotic theory under double asymptotics. While first-order theory under double asymptotics provides information about the bias, it does not provide enough information about the variance of the estimator. Higher-order theory enables us to obtain information about the variance. From this result, a procedure for choosing the number of instruments is proposed. The simulations confirm that the proposed procedure improves the precision of the estimator.     

Performance of conditional Wald tests in IV regression with weak instruments

We compare the powers of five tests of the coefficient on a single endogenous regressor in instrumental variables regression. Following Moreira [2003, A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048], all tests are implemented using critical values that depend on a statistic which is sufficient under the null hypothesis for the (unknown) concentration parameter, so these conditional tests are asymptotically valid under weak instrument asymptotics. Four of the tests are based on k-class Wald statistics (two-stage least squares, LIML, Fuller's [Some properties of a modification of the limited information estimator. Econometrica 45, 939–953], and bias-adjusted TSLS); the fifth is Moreira's (2003) conditional likelihood ratio (CLR) test. The heretofore unstudied conditional Wald (CW) tests are found to perform poorly, compared to the CLR test: in many cases, the CW tests have almost no power against a wide range of alternatives. Our analysis is facilitated by a new algorithm, presented here, for the computation of the asymptotic conditional p-value of the CLR test.     

Short run and long run causality in time series: inference

We propose methods for testing hypothesis of non-causality at various horizons, as defined in Dufour and Renault (Econometrica 66, (1998) 1099–1125). We study in detail the case of VAR models and we propose linear methods based on running vector autoregressions at different horizons. While the hypotheses considered are nonlinear, the proposed methods only require linear regression techniques as well as standard Gaussian asymptotic distributional theory. Bootstrap procedures are also considered. For the case of integrated processes, we propose extended regression methods that avoid nonstandard asymptotics. The methods are applied to a VAR model of the US economy.     

Edgeworth expansions for realized volatility and related estimators

This paper shows that the asymptotic normal approximation is often insufficiently accurate for volatility estimators based on high frequency data. To remedy this, we derive Edgeworth expansions for such estimators. The expansions are developed in the framework of small-noise asymptotics. The results have application to Cornish–Fisher inversion and help setting intervals more accurately than those relying on normal distribution.     

Asymptotics of the principal components estimator of large factor models with weakly influential factors

This paper introduces a drifting-parameter asymptotic framework to derive accurate approximations to the finite sample distribution of the principal components (PC) estimator in situations when the factors’ explanatory power does not strongly dominate the explanatory power of the cross-sectionally and temporally correlated idiosyncratic terms. Under our asymptotics, the PC estimator is inconsistent. We find explicit formulae for the amount of the inconsistency, and propose an estimator of the number of factors for which the PC estimator works reasonably well. For the special case when the idiosyncratic terms are cross-sectionally but not temporally correlated (or vice versa), we show that the coefficients in the OLS regressions of the PC estimates of factors (loadings) on the true factors (true loadings) are asymptotically normal, and find explicit formulae for the corresponding asymptotic covariance matrix. We explain how to estimate the parameters of the derived asymptotic distributions. Our Monte Carlo analysis suggests that our asymptotic formulae and estimators work well even for relatively small n$n$ and T$T$. We apply our theoretical results to test a hypothesis about the factor content of the US stock return data.     

First difference maximum likelihood and dynamic panel estimation

First difference maximum likelihood (FDML) seems an attractive estimation methodology in dynamic panel data modeling because differencing eliminates fixed effects and, in the case of a unit root, differencing transforms the data to stationarity, thereby addressing both incidental parameter problems and the possible effects of nonstationarity. This paper draws attention to certain pathologies that arise in the use of FDML that have gone unnoticed in the literature and that affect both finite sample performance and asymptotics. FDML uses the Gaussian likelihood function for first differenced data and parameter estimation is based on the whole domain over which the log-likelihood is defined. However, extending the domain of the likelihood beyond the stationary region has certain consequences that have a major effect on finite sample and asymptotic performance. First, the extended likelihood is not the true likelihood even in the Gaussian case and it has a finite upper bound of definition. Second, it is often bimodal, and one of its peaks can be so peculiar that numerical maximization of the extended likelihood frequently fails to locate the global maximum. As a result of these pathologies, the FDML estimator is a restricted estimator, numerical implementation is not straightforward and asymptotics are hard to derive in cases where the peculiarity occurs with non-negligible probabilities. The peculiarities in the likelihood are found to be particularly marked in time series with a unit root. In this case, the asymptotic distribution of the FDMLE has bounded support and its density is infinite at the upper bound when the time series sample size T→∞$T\to \infty$. As the panel width n→∞$n\to \infty$ the pathology is removed and the limit theory is normal. This result applies even for T$T$ fixed and we present an expression for the asymptotic distribution which does not depend on the time dimension. We also show how this limit theory depends on the form of the extended likelihood.     

Inference on transformed stationary time series

The paper is about an approach for parametric inference on instantaneously transformed stationary processes. The paper discusses the asymptotics of the Whittle estimator of the parameters involved and also provides the explicit expression of the asymptotic covariance matrix which does not necessarily require the innovation Gaussianity assumption. As a specific instantaneous transformation, the paper introduces a new version of the Box–Cox transformation and investigates in detail the vector ARMA processes implemented by that transformation, proposing a computation-intensive procedure for parametric estimation and testing. As a computationally feasible test not relying upon the knowledge of the explicit analytic form of the asymptotic covariance matrix or on the information equality, the paper proposes a Monte Carlo Wald test, providing illustrative simulation and real-data examples.     

GEL statistics under weak identification

The central concern of this paper is the provision in a time series moment condition framework of practical recommendations of confidence regions for parameters whose coverage probabilities are robust to the strength or weakness of identification. To this end we develop Pearson-type test statistics based on GEL implied probabilities formed from general kernel smoothed versions of the moment indicators. We also modify the statistics suggested in Guggenberger and Smith (2008) for a general kernel smoothing function. Importantly for our conclusions, we provide GEL time series counterparts to GMM and GEL conditional likelihood ratio statistics given in Kleibergen (2005) and Smith (2007). Our analysis not only demonstrates that these statistics are asymptotically (conditionally) pivotal under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright (2000) but also provides asymptotic power results in the weakly identified time series context. Consequently, the empirical null rejection probabilities of the associated tests and, thereby, the coverage probabilities of the corresponding confidence regions, should not be affected greatly by the strength or otherwise of identification. A comprehensive Monte Carlo study indicates that a number of the tests proposed here represent very competitive choices in comparison with those suggested elsewhere in the literature.     

CUE with many weak instruments and nearly singular design

This paper analyzes many weak moment asymptotics under the possibility of similar moments. The possibility of highly related moments arises when there are many of them. Knight and Fu (2000) designate the issue of similar regressors as the “nearly singular” design in the least squares case. In the nearly singular design, the sample variance converges to a singular limit term. However, Knight and Fu (2000) assume that on the nullspace of the limit term, the difference between the sample variance and the singular matrix converges in probability to a positive definite matrix when multiplied by an appropriate rate. We consider specifically Continuous Updating Estimator (CUE) with many weak moments under nearly singular design. We show that the nearly singular design affects the form of the limit of the many weak moment asymptotics that is introduced by Newey and Windmeijer (2009a). However, the estimator is still consistent and the Wald test has the standard χ²${\chi }^2$ limit.     

Estimation for spatial dynamic panel data with fixed effects: The case of spatial cointegration

Yu et al. (2008) establish asymptotic properties of quasi-maximum likelihood estimators for a stable spatial dynamic panel model with fixed effects when both the number of individuals n and the number of time periods T are large. This paper investigates unstable cases where there are unit roots generated by temporal and spatial correlations. We focus on the spatial cointegration model where some eigenvalues of the data generating process are equal to 1 and the outcomes of spatial units are cointegrated as in a vector autoregressive system. The asymptotics of the QML estimators are developed by reparameterization, and bias correction for the estimators is proposed. We also consider the 2SLS and GMM estimations when T could be small.     

Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics

The technique of Monte Carlo (MC) tests [Dwass (1957, Annals of Mathematical Statistics 28, 181–187); Barnard (1963, Journal of the Royal Statistical Society, Series B 25, 294)] provides a simple method for building exact tests from statistics whose finite sample distribution is intractable but can be simulated (when no nuisance parameter is involved). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing it to statistics whose null distribution involves nuisance parameters [maximized MC (MMC) tests]. Simplified asymptotically justified versions of the MMC method are also proposed: these provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics.     

On bootstrapping panel factor series

This paper studies the asymptotic validity of sieve bootstrap for nonstationary panel factor series. Two main results are shown. Firstly, a bootstrap Invariance Principle is derived pointwise in i$i$, obtaining an upper bound for the order of truncation of the AR polynomial that depends on n$n$ and T$T$. Consistent estimation of the long run variances is also studied for (n,T)→∞$(n,T)\to \infty$. Secondly, joint bootstrap asymptotics is also studied, investigating the conditions under which the bootstrap is valid. In particular, the extent of cross sectional dependence which can be allowed for is investigated. Whilst we show that, for general forms of cross dependence, consistent estimation of the long run variance (and therefore validity of the bootstrap) is fraught with difficulties, however we show that “one-cross-sectional-unit-at-a-time” resampling schemes yield valid bootstrap based inference under weak forms of cross-sectional dependence.     

Robust trend inference with series variance estimator and testing-optimal smoothing parameter

The paper develops a novel testing procedure for hypotheses on deterministic trends in a multivariate trend stationary model. The trends are estimated by the OLS estimator and the long run variance (LRV) matrix is estimated by a series type estimator with carefully selected basis functions. Regardless of whether the number of basis functions K is fixed or grows with the sample size, the Wald statistic converges to a standard distribution. It is shown that critical values from the fixed-K asymptotics are second-order correct under the large-K asymptotics. A new practical approach is proposed to select K that addresses the central concern of hypothesis testing: the selected smoothing parameter is testing-optimal in that it minimizes the type II error while controlling for the type I error. Simulations indicate that the new test is as accurate in size as the nonstandard test of Vogelsang and Franses (2005) and as powerful as the corresponding Wald test based on the large-K asymptotics. The new test therefore combines the advantages of the nonstandard test and the standard Wald test while avoiding their main disadvantages (power loss and size distortion, respectively).     

Predictive regression under various degrees of persistence and robust long-horizon regression

The paper proposes a novel inference procedure for long-horizon predictive regression with persistent regressors, allowing the autoregressive roots to lie in a wide vicinity of unity. The invalidity of conventional tests when regressors are persistent has led to a large literature dealing with inference in predictive regressions with local to unity regressors. Magdalinos and Phillips (2009b) recently developed a new framework of extended IV procedures (IVX) that enables robust chi-square testing for a wider class of persistent regressors. We extend this robust procedure to an even wider parameter space in the vicinity of unity and apply the methods to long-horizon predictive regression. Existing methods in this model, which rely on simulated critical values by inverting tests under local to unity conditions, cannot be easily extended beyond the scalar regressor case or to wider autoregressive parametrizations. In contrast, the methods developed here lead to standard chi-square tests, allow for multivariate regressors, and include predictive processes whose roots may lie in a wide vicinity of unity. As such they have many potential applications in predictive regression. In addition to asymptotics under the null hypothesis of no predictability, the paper investigates validity under the alternative, showing how balance in the regression may be achieved through the use of localizing coefficients and developing local asymptotic power properties under such alternatives. These results help to explain some of the empirical difficulties that have been encountered in establishing predictability of stock returns.     

An econometric analysis of asymmetric volatility: Theory and application to patents

The purpose in registering patents is to protect the intellectual property of the rightful owners. Deterministic and stochastic trends in registered patents can be used to describe a country's technological capabilities and act as a proxy for innovation. This paper presents an econometric analysis of the symmetric and asymmetric volatility of the patent share, which is based on the number of registered patents for the top 12 foreign patenting countries in the USA. International rankings based on the number of foreign US patents, patent intensity (or patents per capita), patent share, the rate of assigned patents for commercial exploitation, and average rank scores, are given for the top 12 foreign countries. Monthly time series data from the United States Patent and Trademark Office for January 1975 to December 1998 are used to estimate symmetric and asymmetric models of the time-varying volatility of the patent share, namely US patents registered by each of the top 12 foreign countries relative to total US patents. A weak sufficient condition for the consistency and asymptotic normality of the quasi-maximum likelihood estimator (QMLE) of the univariate GJR(1,1) model is established under non-normality of the conditional shocks. The empirical results provide a diagnostic validation of the regularity conditions underlying the GJR(1,1) model, specifically the log-moment condition for consistency and asymptotic normality of the QMLE, and the computationally more straightforward but stronger second and fourth moment conditions. Of the symmetric and asymmetric models estimated, AR(1)–EGARCH(1,1) is found to be suitable for most countries, while AR(1)–GARCH(1,1) and AR(1)–GJR(1,1) also provide useful insights. Non-nested procedures are developed to test AR(1)–GARCH(1,1) versus AR(1)–EGARCH(1,1), and AR(1)–GJR(1,1) versus AR(1)–EGARCH(1,1).     

A class of simple distribution-free rank-based unit root tests

We propose a class of distribution-free rank-based tests for the null hypothesis of a unit root. This class is indexed by the choice of a reference densityg, which need not coincide with the unknown actual innovation density f. The validity of these tests, in terms of exact finite-sample size, is guaranteed, irrespective of the actual underlying density, by distribution-freeness. Those tests are locally and asymptotically optimal under a particular asymptotic scheme, for which we provide a complete analysis of asymptotic relative efficiencies. Rather than stressing asymptotic optimality, however, we emphasize finite-sample performances, which also depend, quite heavily, on initial values. It appears that our rank-based tests significantly outperform the traditional Dickey-Fuller tests, as well as the more recent procedures proposed by Elliott et al. (1996), Ng and Perron (2001), and Elliott and Müller (2006), for a broad range of initial values and for heavy-tailed innovation densities. Thus, they provide a useful complement to existing techniques.     

A simple approach to the parametric estimation of potentially nonstationary diffusions

A simple and robust approach is proposed for the parametric estimation of scalar homogeneous stochastic differential equations. We specify a parametric class of diffusions and estimate the parameters of interest by minimizing criteria based on the integrated squared difference between kernel estimates of the drift and diffusion functions and their parametric counterparts. The procedure does not require simulations or approximations to the true transition density and has the simplicity of standard nonlinear least-squares methods in discrete time. A complete asymptotic theory for the parametric estimates is developed. The limit theory relies on infill and long span asymptotics and is robust to deviations from stationarity, requiring only recurrence.     

Testing for a break in trend when the order of integration is unknown

Harvey, Leybourne and Taylor [Harvey, D.I., Leybourne, S.J., Taylor, A.M.R. 2009. Simple, robust and powerful tests of the breaking trend hypothesis. Econometric Theory 25, 995–1029] develop a test for the presence of a broken linear trend at an unknown point in the sample whose size is asymptotically robust as to whether the (unknown) order of integration of the data is either zero or one. This test is not size controlled, however, when this order assumes fractional values; its asymptotic size can be either zero or one in such cases. In this paper we suggest a new test, based on a sup-Wald statistic, which is asymptotically size-robust across fractional values of the order of integration (including zero or one). We examine the asymptotic power of the test under a local trend break alternative. The finite sample properties of the test are also investigated.     

Local polynomial estimation of nonparametric simultaneous equations models

We define a new procedure for consistent estimation of nonparametric simultaneous equations models under the conditional mean independence restriction of Newey et al. [1999. Nonparametric estimation of triangular simultaneous equation models. Econometrica 67, 565–603]. It is based upon local polynomial regression and marginal integration techniques. We establish the asymptotic distribution of our estimator under weak data dependence conditions. Simulation evidence suggests that our estimator may significantly outperform the estimators of Pinkse [2000. Nonparametric two-step regression estimation when regressors and errors are dependent. Canadian Journal of Statistics 28, 289–300] and Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578].