Sparse estimators and the oracle property,or the return of Hodges’ estimator

We point out some pitfalls related to the concept of an oracle property as used in Fan and Li [2001. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348–1360; 2002. Variable selection for Cox's proportional hazards model and frailty model. Annals of Statistics 30, 74–99; 2004. New estimation and model selection procedures for semiparametric modeling in longitudinal data analysis. Journal of the American Statistical Association 99, 710–723] which are reminiscent of the well-known pitfalls related to Hodges’ estimator. The oracle property is often a consequence of sparsity of an estimator. We show that any estimator satisfying a sparsity property has maximal risk that converges to the supremum of the loss function; in particular, the maximal risk diverges to infinity whenever the loss function is unbounded. For ease of presentation the result is set in the framework of a linear regression model, but generalizes far beyond that setting. In a Monte Carlo study we also assess the extent of the problem in finite samples for the smoothly clipped absolute deviation (SCAD) estimator introduced in Fan and Li [2001. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348–1360]. We find that this estimator can perform rather poorly in finite samples and that its worst-case performance relative to maximum likelihood deteriorates with increasing sample size when the estimator is tuned to sparsity.     

Semiparametric efficient estimation of dynamic panel data models

This paper extends the semiparametric efficient treatment of panel data models pursued by Park and Simar [Park, B.U., Simar, L., 1994. Efficient semiparametric estimation in stochastic frontier models. Journal of the American Statistical Association 89, 929–936] and Park et al. [Park, B.U., Sickles, R.C., Simar, L., 1998. Stochastic frontiers: a semiparametric approach. Journal of Econometrics 84, 273–301; Park, B.U., Sickles, R.C., Simar, L., 2003. Semiparametric efficient estimation of AR(1) panel data models. Journal of Econometrics 117, 279–309] to a dynamic panel setting. We develop a semiparametric efficient estimator under minimal assumptions when the panel model contains a lagged dependent variable. We apply this new estimator to analyze the structure of demand between city pairs for selected U.S. airlines during the period 1979 I–1992 IV.     

Generalizing weak instrument robust IV statistics towards multiple parameters,unrestricted covariance matrices and identification statistics

We generalize the weak instrument robust score or Lagrange multiplier and likelihood ratio instrumental variables (IV) statistics towards multiple parameters and a general covariance matrix so they can be used in the generalized method of moments (GMM). The GMM extension of Moreira's [2003. A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048] conditional likelihood ratio statistic towards GMM preserves its expression except that it becomes conditional on a statistic that tests the rank of a matrix. We analyze the spurious power decline of Kleibergen's [2002. Pivotal statistics for testing structural parameters in instrumental variables regression. Econometrica 70, 1781–1803, 2005. Testing parameters in GMM without assuming that they are identified. Econometrica 73, 1103–1124] score statistic and show that an independent misspecification pre-test overcomes it. We construct identification statistics that reflect if the confidence sets of the parameters are bounded. A power study and the possible shapes of confidence sets illustrate the analysis.     

Non-parametric tests of productive efficiency with errors-in-variables

We develop a non-parametric test of productive efficiency that accounts for errors-in-variables, following the approach of Varian. [1985. Nonparametric analysis of optimizing behavior with measurement error. Journal of Econometrics 30(1/2), 445–458]. The test is based on the general Pareto–Koopmans notion of efficiency, and does not require price data. Statistical inference is based on the sampling distribution of the L_∞ norm of errors. The test statistic can be computed using a simple enumeration algorithm. The finite sample properties of the test are analyzed by means of a Monte Carlo simulation using real-world data of large EU commercial banks.     

Inverse probability weighted estimation for general missing data problems

I study inverse probability weighted M-estimation under a general missing data scheme. Examples include M-estimation with missing data due to a censored survival time, propensity score estimation of the average treatment effect in the linear exponential family, and variable probability sampling with observed retention frequencies. I extend an important result known to hold in special cases: estimating the selection probabilities is generally more efficient than if the known selection probabilities could be used in estimation. For the treatment effect case, the setup allows a general characterization of a “double robustness” result due to Scharfstein et al. [1999. Rejoinder. Journal of the American Statistical Association 94, 1135–1146].     

Short and long run causality measures: Theory and inference

The concept of causality introduced by Wiener [Wiener, N., 1956. The theory of prediction, In: E.F. Beckenback, ed., The Theory of Prediction, McGraw-Hill, New York (Chapter 8)] and Granger [Granger, C. W.J., 1969. Investigating causal relations by econometric models and cross-spectral methods, Econometrica 37, 424–459] is defined in terms of predictability one period ahead. This concept can be generalized by considering causality at any given horizon h$h$ as well as tests for the corresponding non-causality [Dufour, J.-M., Renault, E., 1998. Short-run and long-run causality in time series: Theory. Econometrica 66, 1099–1125; Dufour, J.-M., Pelletier, D., Renault, É., 2006. Short run and long run causality in time series: Inference, Journal of Econometrics 132 (2), 337–362]. Instead of tests for non-causality at a given horizon, we study the problem of measuring causality between two vector processes. Existing causality measures have been defined only for the horizon 1, and they fail to capture indirect causality. We propose generalizations to any horizon h$h$ of the measures introduced by Geweke [Geweke, J., 1982. Measurement of linear dependence and feedback between multiple time series. Journal of the American Statistical Association 77, 304–313]. Nonparametric and parametric measures of unidirectional causality and instantaneous effects are considered. On noting that the causality measures typically involve complex functions of model parameters in VAR and VARMA models, we propose a simple simulation-based method to evaluate these measures for any VARMA model. We also describe asymptotically valid nonparametric confidence intervals, based on a bootstrap technique. Finally, the proposed measures are applied to study causality relations at different horizons between macroeconomic, monetary and financial variables in the US.     

Testing for short- and long-run causality: A frequency-domain approach

The framework of Geweke (1982. Journal of the American Statistical Association 77, 304–324.) and Hosoya (1991. Probability Theory and Related Fields 88, 429–444.) is adopted to construct a simple test for causality in the frequency domain. This test can also be applied to cointegrated systems. To study the large sample properties of the test, we analyze the power against a sequence of local alternatives. The finite sample properties are investigated by means of Monte Carlo simulations. Our methodology is applied to investigate the predictive content of the yield spread for future output growth. Using quarterly US data we observe reasonable leading indicator properties at frequencies around one year and typical business cycle frequencies.     

Unit root quantile autoregression testing using covariates

This paper extends unit root tests based on quantile regression proposed by Koenker and Xiao [Koenker, R., Xiao, Z., 2004. Unit root quantile autoregression inference, Journal of the American Statistical Association 99, 775–787] to allow stationary covariates and a linear time trend. The limiting distribution of the test is a convex combination of Dickey–Fuller and standard normal distributions, with weight determined by the correlation between the equation error and the regression covariates. A simulation experiment is described, illustrating the finite sample performance of the unit root test for several types of distributions. The test based on quantile autoregression turns out to be especially advantageous when innovations are heavy-tailed. An application to the CPI-based real exchange rates using four different countries suggests that real exchange rates are not constant unit root processes.     

On Critical Values of Tests against a Change in Persistence*

Kim, Belaire‐Franch and Amador [Journal of Econometrics (2002) Vol. 109, pp. 389–392] and Busetti and Taylor [Journal of Econometrics (2004) Vol. 123, pp. 33–66] present different percentiles for the same mean score test statistic. We find that the difference by a factor 0.6 is due to systematically different sample analogues. Furthermore, we clarify which sample versions of the mean‐exponential test statistic should be correctly used with which set of critical values. At the same time, we correct some of the limiting distributions found in the literature.     

Determining the cointegrating rank in nonstationary fractional systems by the exact local Whittle approach

We propose to extend the cointegration rank determination procedure of Robinson and Yajima [2002. Determination of cointegrating rank in fractional systems. Journal of Econometrics 106, 217–242] to accommodate both (asymptotically) stationary and nonstationary fractionally integrated processes as the common stochastic trends and cointegrating errors by applying the exact local Whittle analysis of Shimotsu and Phillips [2005. Exact local Whittle estimation of fractional integration. Annals of Statistics 33, 1890–1933]. The proposed method estimates the cointegrating rank by examining the rank of the spectral density matrix of the d$d$th differenced process around the origin, where the fractional integration order, d$d$, is estimated by the exact local Whittle estimator. Similar to other semiparametric methods, the approach advocated here only requires information about the behavior of the spectral density matrix around the origin, but it relies on a choice of (multiple) bandwidth(s) and threshold parameters. It does not require estimating the cointegrating vector(s) and is easier to implement than regression-based approaches, but it only provides a consistent estimate of the cointegration rank, and formal tests of the cointegration rank or levels of confidence are not available except for the special case of no cointegration. We apply the proposed methodology to the analysis of exchange rate dynamics among a system of seven exchange rates. Contrary to both fractional and integer-based parametric approaches, which indicate at most one cointegrating relation, our results suggest three or possibly four cointegrating relations in the data.     

Productivity trends in U.S. manufacturing: Evidence from the NQ and AIM cost functions

In this paper, we take the econometric approach to productivity measurement in United States manufacturing, using KLEM data over the period from 1953 to 2001. We are also interested in technical change bias, price elasticities, and elasticities of substitution in the U.S. manufacturing industry. We present an empirical comparison and evaluation of the effectiveness of four well-known flexible cost functions—the locally flexible generalized Leontief (see Diewert [1971. An application of the Shephard duality theorem: a generalized Leontief production function. Journal of Political Economy 79, 481–507]), translog (see Christensen et al. [1975. Transendendal logarithmic utility functions. American Economic Review 65, 367–364]), and normalized quadratic (see Diewert and Wales [1987. Flexible functional forms and global curvature conditions. Econometrica 55, 43–68])—and the globally flexible asymptotically ideal model (see Barnett et al. [1991. Semi-nonparametric Bayesian estimation of the asymptotically ideal production model. Journal of Econometrics 49, 5–50]), the latter modified to introduce technical change by means of Thomsen's [2000. Short cuts to dynamic factor demand modelling. Journal of Econometrics 97, 1–23] factor-augmenting efficiency index approach.     

Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics

The technique of Monte Carlo (MC) tests [Dwass (1957, Annals of Mathematical Statistics 28, 181–187); Barnard (1963, Journal of the Royal Statistical Society, Series B 25, 294)] provides a simple method for building exact tests from statistics whose finite sample distribution is intractable but can be simulated (when no nuisance parameter is involved). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing it to statistics whose null distribution involves nuisance parameters [maximized MC (MMC) tests]. Simplified asymptotically justified versions of the MMC method are also proposed: these provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics.     

Local polynomial estimation of nonparametric simultaneous equations models

We define a new procedure for consistent estimation of nonparametric simultaneous equations models under the conditional mean independence restriction of Newey et al. [1999. Nonparametric estimation of triangular simultaneous equation models. Econometrica 67, 565–603]. It is based upon local polynomial regression and marginal integration techniques. We establish the asymptotic distribution of our estimator under weak data dependence conditions. Simulation evidence suggests that our estimator may significantly outperform the estimators of Pinkse [2000. Nonparametric two-step regression estimation when regressors and errors are dependent. Canadian Journal of Statistics 28, 289–300] and Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578].     

No unbounded arbitrage,weak no market arbitrage and no arbitrage price system conditions; Equivalent conditions

Page and Wooders [Page Jr., F.H., Wooders, M., 1996. A necessary and sufficient condition for compactness of individually rational and feasible outcomes and existence of an equilibrium. Economics Letters 52, 153–162] prove that the no unbounded arbitrage (NUBA), a special case of a condition in Page [Page, F.H., 1987. On equilibrium in Hart’s securities exchange model. Journal of Economic Theory 41, 392–404], is equivalent to the existence of a no arbitrage price system (NAPS) when no agent has non-null useless vectors. Allouch et al. [Allouch, N., Le Van, C., Page F.H., 2002. The geometry of arbitrage and the existence of competitive equilibrium. Journal of Mathematical Economics 38, 373–391] extend the NAPS introduced by Werner [Werner, J., 1987. Arbitrage and the existence of competitive equilibrium. Econometrica 55, 1403–1418] and show that this condition is equivalent to the weak no market arbitrage (WNMA) of Hart [Hart, O., 1974. On the existence of an equilibrium in a securities model. Journal of Economic Theory 9, 293–311]. They mention that this result implies the one given by Page and Wooders [Page Jr., F.H., Wooders, M., 1996. A necessary and sufficient condition for compactness of individually rational and feasible outcomes and existence of an equilibrium. Economics Letters 52, 153–162]. In this note, we show that all these conditions are equivalent.     

Finite sample multivariate structural change tests with application to energy demand models

This paper considers finite sample motivated structural change tests in the multivariate linear regression model with application to energy demand models, in which case commonly used structural change tests remain asymptotic. As in Dufour and Kiviet [1996. Exact tests for structural change in first-order dynamic models. Journal of Econometrics 70, 39–68], we account for intervening nuisance parameters through a two-stage maximized Monte Carlo test procedure. Our contributions can be classified into five categories: (i) we extend tests for which a finite-sample theory has been supplied for Gaussian distributions to the non-Gaussian context; (ii) we show that Bai et al. [1998. Testing and dating common breaks in multi-variate time series. The Review of Economic Studies 65 (3), 395–432] test severely over-rejects and propose exact variants of this test; (iii) we consider predictive break test approaches which generalize tests in Dufour [1980. Dummy variables and predictive tests for structural change. Economics Letters 6, 241–247] and Dufour and Kiviet [1996. Exact tests for structural change in first-order dynamic models. Journal of Econometrics 70, 39–68]; (iv) we propose exact (non-Bonferonni based) extensions of the multivariate outliers test from Wilks [1963. Multivariate statistical outliers. Sankhya Series A 25, 407–426] to models with covariates; (v) we apply these tests to the energy demand system analyzed by Arsenault et al. [1995. A total energy demand model of Québec: forecasting properties. Energy Economics 17 (2), 163–171]. For two out of the six industrial sectors analyzed over the 1962–2000 period, break and further goodness-of-fit and diagnostic tests allow to identify (and correct) specification problems arising from historical regulatory changes or (possibly random) industry-specific effects. The procedures we propose have potential useful applications in statistics, econometrics and finance (e.g. event studies).     

Measuring and testing Granger causality over the spectrum: An application to European production expectation surveys

Decomposing Granger causality over the spectrum allows us to disentangle potentially different Granger causality relationships over different frequencies. This may yield new and complementary insights compared to traditional versions of Granger causality. In this paper, we compare two existing approaches in the frequency domain, proposed originally by Pierce [Pierce, D. A. (1979). R-squared measures for time series. Journal of the American Statistical Association, 74, 901–910] and Geweke [Geweke, J. (1982). Measurement of linear dependence and feedback between multiple time series. Journal of the American Statistical Association, 77, 304–324], and introduce a new testing procedure for the Pierce spectral Granger causality measure. To provide insights into the relative performance of this test, we study its power properties by means of Monte Carlo simulations. In addition, we apply the methodology in the context of the predictive value of the European production expectation surveys. This predictive content is found to vary widely with the frequency considered, illustrating the usefulness of not restricting oneself to a single overall test statistic.     

The Beveridge–Nelson decomposition in retrospect and prospect

Beveridge and Nelson [Beveridge, Stephen, Nelson, Charles R., 1981. A new approach to decomposition of economic time series into permanent and transitory components with particular attention to measurement of the ‘business cycle’. Journal of Monetary Economics 7, 151–174] proposed that the long-run forecast is a measure of trend for time series such as GDP that do not follow a deterministic path in the long run. They showed that if the series is stationary in first differences, then the estimated trend is a random walk with drift that accounts for growth, and the cycle is stationary. In contrast to linear de-trending, the smoother of Hodrick and Prescott (1981) and Hodrick and Prescott [Hodrick, Robert, Prescott, Edward C., 1997. Post-war US business cycles: An empirical investigation. Journal of Money Credit and Banking 29 (1), 1–16] and the unobserved components model of Harvey, [Harvey, A.C., 1985. Trends and cycles in macroeconomic time series. Journal of Business and Economic Statistics 3, 216–227]. Watson [Watson, Mark W., 1986. Univariate detrending methods with stochastic trends Journal of Monetary Economics 18, 49–75] and Clark [Clark, Peter K., 1987. The cyclical component of US economic activity. The Quarterly Journal of Economics 102 (4), 797–814], the BN decomposition attributes most variation in GDP to trend shocks while the cycles are short and brief. Since each is an estimate of the transitory part of GDP that will die out, it seems natural to compare cycle measures by their ability to forecast future growth. The results presented here suggest that cycle measures contain little if any information beyond the short-term momentum captured by BN.     

Testing for stochastic dominance using the weighted McFadden-type statistic

We demonstrate that when testing for stochastic dominance of order three and above, using a weighted version of the Kolmogorov–Smirnov-type statistic proposed by McFadden [1989. In: Fomby, T.B., Seo, T.K. (Eds.), Studies in the Economics of Uncertainty. Springer, New York, pp. 113–134] is necessary for obtaining a non-degenerate asymptotic distribution. Since the asymptotic distribution is complex, we discuss a bootstrap approximation for it in the context of a real application.     

Generalized empirical likelihood tests in time series models with potential identification failure

We introduce test statistics based on generalized empirical likelihood methods that can be used to test simple hypotheses involving the unknown parameter vector in moment condition time series models. The test statistics generalize those in Guggenberger and Smith [2005. Generalized empirical likelihood estimators and tests under partial, weak and strong identification. Econometric Theory 21 (4), 667–709] from the i.i.d. to the time series context and are alternatives to those in Kleibergen [2005a. Testing parameters in GMM without assuming that they are identified. Econometrica 73 (4), 1103–1123] and Otsu [2006. Generalized empirical likelihood inference for nonlinear and time series models under weak identification. Econometric Theory 22 (3), 513–527]. The main feature of these tests is that their empirical null rejection probabilities are not affected much by the strength or weakness of identification. More precisely, we show that the statistics are asymptotically distributed as chi-square under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright [2000. GMM with weak identification. Econometrica 68 (5), 1055–1096]. We also introduce a modification to Otsu's (2006) statistic that is computationally more attractive. A Monte Carlo study reveals that the finite-sample performance of the suggested tests is very competitive.     

Approximately normal tests for equal predictive accuracy in nested models

Forecast evaluation often compares a parsimonious null model to a larger model that nests the null model. Under the null that the parsimonious model generates the data, the larger model introduces noise into its forecasts by estimating parameters whose population values are zero. We observe that the mean squared prediction error (MSPE) from the parsimonious model is therefore expected to be smaller than that of the larger model. We describe how to adjust MSPEs to account for this noise. We propose applying standard methods [West, K.D., 1996. Asymptotic inference about predictive ability. Econometrica 64, 1067–1084] to test whether the adjusted mean squared error difference is zero. We refer to nonstandard limiting distributions derived in Clark and McCracken [2001. Tests of equal forecast accuracy and encompassing for nested models. Journal of Econometrics 105, 85–110; 2005a. Evaluating direct multistep forecasts. Econometric Reviews 24, 369–404] to argue that use of standard normal critical values will yield actual sizes close to, but a little less than, nominal size. Simulation evidence supports our recommended procedure.