Evaluating a Model by Forecast Performance*

Although out‐of‐sample forecast performance is often deemed to be the ‘gold standard’ of evaluation, it is not in fact a good yardstick for evaluating models in general. The arguments are illustrated with reference to a recent paper by Carruth, Hooker and Oswald [Review of Economics and Statistics (1998) , Vol. 80, pp. 621–628], who suggest that the good dynamic forecasts of their model support the efficiency‐wage theory on which it is based.     

Evaluating PcGets and RETINA as Automatic Model Selection Algorithms*

The paper describes two automatic model selection algorithms, RETINA and PcGets, briefly discussing how the algorithms work and what their performance claims are. RETINA's Matlab implementation of the code is explained, then the program is compared with PcGets on the data in Perez‐Amaral, Gallo and White (2005 , Econometric Theory, Vol. 21, pp. 262–277), ‘A Comparison of Complementary Automatic Modelling Methods: RETINA and PcGets’, and Hoover and Perez (1999 , Econometrics Journal, Vol. 2, pp. 167–191), ‘Data Mining Reconsidered: Encompassing and the General‐to‐specific Approach to Specification Search’. Monte Carlo simulation results assess the null and non‐null rejection frequencies of the RETINA and PcGets model selection algorithms in the presence of nonlinear functions.     

Truth and Robustness in Cross‐country Growth Regressions*

We re‐examine studies of cross‐country growth regressions by Levine and Renelt (American Economic Review, Vol. 82, 1992, pp. 942–963) and Sala‐i‐Martin (American Economic Review, Vol. 87, 1997a, pp. 178–183; Economics Department, Columbia, University, 1997b). In a realistic Monte Carlo experiment, their variants of Edward Leamer's extreme‐bounds analysis are compared with a cross‐sectional version of the general‐to‐specific search methodology associated with the LSE approach to econometrics. Levine and Renelt's method has low size and low power, while Sala‐i‐Martin's method has high size and high power. The general‐to‐specific methodology is shown to have a near nominal size and high power. Sala‐i‐Martin's method and the general‐to‐specific method are then applied to the actual data from Sala‐i‐Martin's original study.     

Fluctuation Tests for a Change in Persistence*

In this paper, we develop a set of new persistence change tests which are similar in spirit to those of Kim [Journal of Econometrics (2000) Vol. 95, pp. 97–116], Kim et al. [Journal of Econometrics (2002) Vol. 109, pp. 389–392] and Busetti and Taylor [Journal of Econometrics (2004) Vol. 123, pp. 33–66]. While the exisiting tests are based on ratios of sub‐sample Kwiatkowski et al. [Journal of Econometrics (1992) Vol. 54, pp. 158–179]‐type statistics, our proposed tests are based on the corresponding functions of sub‐sample implementations of the well‐known maximal recursive‐estimates and re‐scaled range fluctuation statistics. Our statistics are used to test the null hypothesis that a time series displays constant trend stationarity [I(0)] behaviour against the alternative of a change in persistence either from trend stationarity to difference stationarity [I(1)], or vice versa. Representations for the limiting null distributions of the new statistics are derived and both finite‐sample and asymptotic critical values are provided. The consistency of the tests against persistence change processes is also demonstrated. Numerical evidence suggests that our proposed tests provide a useful complement to the extant persistence change tests. An application of the tests to US inflation rate data is provided.     

Cointegration Testing in Panels with Common Factors*

Panel unit‐root and no‐cointegration tests that rely on cross‐sectional independence of the panel unit experience severe size distortions when this assumption is violated, as has, for example, been shown by Banerjee, Marcellino and Osbat [Econometrics Journal (2004), Vol. 7, pp. 322–340; Empirical Economics (2005), Vol. 30, pp. 77–91] via Monte Carlo simulations. Several studies have recently addressed this issue for panel unit‐root tests using a common factor structure to model the cross‐sectional dependence, but not much work has been done yet for panel no‐cointegration tests. This paper proposes a model for panel no‐cointegration using an unobserved common factor structure, following the study by Bai and Ng [Econometrica (2004), Vol. 72, pp. 1127–1177] for panel unit roots. We distinguish two important cases: (i) the case when the non‐stationarity in the data is driven by a reduced number of common stochastic trends, and (ii) the case where we have common and idiosyncratic stochastic trends present in the data. We discuss the homogeneity restrictions on the cointegrating vectors resulting from the presence of common factor cointegration. Furthermore, we study the asymptotic behaviour of some existing residual‐based panel no‐cointegration tests, as suggested by Kao [Journal of Econometrics (1999), Vol. 90, pp. 1–44] and Pedroni [Econometric Theory (2004a), Vol. 20, pp. 597–625]. Under the data‐generating processes (DGP) used, the test statistics are no longer asymptotically normal, and convergence occurs at rate T rather than as for independent panels. We then examine the possibilities of testing for various forms of no‐cointegration by extracting the common factors and individual components from the observed data directly and then testing for no‐cointegration using residual‐based panel tests applied to the defactored data.     

Panel Stationarity Test with Structural Breaks*

In this paper, we extend the heterogeneous panel data stationarity test of Hadri [Econometrics Journal, Vol. 3 (2000) pp. 148–161] to the cases where breaks are taken into account. Four models with different patterns of breaks under the null hypothesis are specified. Two of the models have been already proposed by Carrion‐i‐Silvestre et al. [Econometrics Journal, Vol. 8 (2005) pp. 159–175]. The moments of the statistics corresponding to the four models are derived in closed form via characteristic functions. We also provide the exact moments of a modified statistic that do not asymptotically depend on the location of the break point under the null hypothesis. The cases where the break point is unknown are also considered. For the model with breaks in the level and no time trend and for the model with breaks in the level and in the time trend, Carrion‐i‐Silvestre et al. [Econometrics Journal, Vol. 8 (2005) pp. 159–175] showed that the number of breaks and their positions may be allowed to differ across individuals for cases with known and unknown breaks. Their results can easily be extended to the proposed modified statistic. The asymptotic distributions of all the statistics proposed are derived under the null hypothesis and are shown to be normally distributed. We show by simulations that our suggested tests have in general good performance in finite samples except the modified test. In an empirical application to the consumer prices of 22 OECD countries during the period from 1953 to 2003, we found evidence of stationarity once a structural break and cross‐sectional dependence are accommodated.     

Correcting Standard Errors in Two‐stage Estimation Procedures with Generated Regressands*

Feenstra and Hanson [NBER Working Paper No. 6052 (1997)] propose a procedure to correct the standard errors in a two‐stage regression with generated dependent variables. Their method has subsequently been used in two‐stage mandated wage models [Feenstra and Hanson, Quarterly Journal of Economics (1999) Vol. 114, pp. 907–940; Haskel and Slaughter, The Economic Journal (2001) Vol. 111, pp. 163–187; Review of International Economics (2003) Vol. 11, pp. 630–650] and for the estimation of the sector bias of skill‐biased technological change [Haskel and Slaughter, European Economic Review (2002) Vol. 46, pp. 1757–1783]. Unfortunately, the proposed correction is negatively biased (sometimes even resulting in negative estimated variances) and therefore leads to overestimation of the inferred significance. We present an unbiased correction procedure and apply it to the models reported by Feenstra and Hanson (1999) and Haskel and Slaughter (2002) .     

A Note on Some Properties of STUR Processes*

This note presents some properties of the stochastic unit‐root processes developed in Granger and Swanson [Journal of Econometrics (1997) Vol. 80, pp. 35–62] and Leybourne, McCabe and Tremayne [Journal of Business & Economic Statistics (1996) Vol. 14, pp. 435–446] that have not been or only implicitly discussed in the literature.     

Intergenerational Transmission of Fertility Patterns*

Recent studies by economists have focused on cultural transmission from the origin country rather than the origin family. Our paper extends this research by investigating how family‐specific‘cultural transmission’ can affect fertility rates. Following Machado and Santos Silva [Journal of the American Statistical Association (2005) Vol. 100, p. 1226] and Miranda [Journal of Population Economics (2008) Vol. 21, p. 67], we estimate count data quantile regression models using the British Household Panel Survey. We find that a woman's origin‐family size is positively associated with completed fertility in her destination family. A woman's country of birth also matters for her fertility. For a sub‐sample of continuously partnered men and women, both partners’ origin‐family sizes significantly affect destination‐family fertility.     

Local Asymptotic Power of Breitung's Test*

In this article, we derive the local asymptotic power function of the unit root test proposed by Breitung [Journal of Econometrics (2002) Vol. 108, pp. 343–363]. Breitung's test is a non‐parametric test and is free of nuisance parameters. We compare the local power curve of the Breitungs’ test with that of the Dickey–Fuller test. This comparison is in fact a quantification of the loss of power that one has to accept when applying a non‐parametric test.     

Trend and Initial Condition in Stationarity Tests: The Asymptotic Analysis

In this article, we investigate the behaviour of stationarity tests proposed by Müller [Journal of Econometrics (2005) Vol. 128, pp. 195–213] and Harris et al. [Econometric Theory (2007) Vol. 23, pp. 355–363] with uncertainty over the trend and/or initial condition. As different tests are efficient for different magnitudes of local trend and initial condition, following Harvey et al. [Journal of Econometrics (2012) Vol. 169, pp. 188–195], we propose decision rule based on the rejection of null hypothesis for multiple tests. Additionally, we propose a modification of this decision rule, relying on additional information about the magnitudes of the local trend and/or the initial condition that is obtained through pre‐testing. The resulting modification has satisfactory size properties under both uncertainty types.     

Testing for Multicointegration in Panel Data with Common Factors*

This paper addresses the concept of multicointegration in a panel data framework and builds upon the panel data cointegration procedures developed in Pedroni [Econometric Theory (2004), Vol. 20, pp. 597–625]. When individuals are either cross‐section independent, or cross‐section dependence can be removed by cross‐section demeaning, our approach can be applied to the wider framework of mixed I(2) and I(1) stochastic processes. The paper also deals with the issue of cross‐section dependence using approximate common‐factor models. Finite sample performance is investigated through Monte Carlo simulations. Finally, we illustrate the use of the procedure investigating an inventories, sales and production relationship for a panel of US industries.     

Factors influencing ethical climate in a nonprofit organisation: an empirical investigation

Drawing from Victor and Cullen's[Victor, B. and Cullen, J. B. (1987) ‘A theory and measure of ethical climate in organizations’, Research in Corporate Social Performance and Policy, Vol. 9, pp. 51–71.],[Victor, B. and Cullen, J. B. (1988) ‘The organizational bases of ethical work climates’, Administrative Science Quarterly, Vol. 33, pp. 101–125.] theoretical framework a recent study by Agarwal and Malloy[Agarwal, J. and Malloy, D. C. (1999) ‘Ethical work climate dimensions in a not‐for‐profit organization: An empirical study’, Journal of Business Ethics, Vol. 20, pp. 1–14.] examined ethical work climate dimensions in the context of a nonprofit organisation. This paper reviews the framework and extends the study further by investigating several factors that influence the perception of ethical work climate in a nonprofit organisation. The multiple analysis of variance (MANOVA) procedure is employed to test nine hypotheses. Results demonstrate somewhat unique findings regarding factors that influence ethical climate perception in a nonprofit context. Specifically, the findings of this study point to the level of education, decision style and the influence that superiors and volunteers have upon ethical perception. Results also demonstrate that factors that have been employed traditionally by forprofit management, such as length of service, codes of ethics, size of the organisation and peer pressure, do not effectively influence ethical perception in the nonprofit context. Finally implications of this study are discussed. Copyright © 2003 Henry Stewart Publications     

On Critical Values of Tests against a Change in Persistence*

Kim, Belaire‐Franch and Amador [Journal of Econometrics (2002) Vol. 109, pp. 389–392] and Busetti and Taylor [Journal of Econometrics (2004) Vol. 123, pp. 33–66] present different percentiles for the same mean score test statistic. We find that the difference by a factor 0.6 is due to systematically different sample analogues. Furthermore, we clarify which sample versions of the mean‐exponential test statistic should be correctly used with which set of critical values. At the same time, we correct some of the limiting distributions found in the literature.     

The Incremental Predictive Information Associated with Using Theoretical New Keynesian DSGE Models vs. Simple Linear Econometric Models*

In this paper we construct output gap and inflation predictions using a variety of dynamic stochastic general equilibrium (DSGE) sticky price models. Predictive density accuracy tests related to the test discussed in Corradi and Swanson [Journal of Econometrics (2005a), forthcoming] as well as predictive accuracy tests due to Diebold and Mariano [Journal of Business and Economic Statistics (1995) , Vol. 13, pp. 253–263]; and West [Econometrica (1996) , Vol. 64, pp. 1067–1084] are used to compare the alternative models. A number of simple time‐series prediction models (such as autoregressive and vector autoregressive (VAR) models) are additionally used as strawman models. Given that DSGE model restrictions are routinely nested within VAR models, the addition of our strawman models allows us to indirectly assess the usefulness of imposing theoretical restrictions implied by DSGE models on unrestricted econometric models. With respect to predictive density evaluation, our results suggest that the standard sticky price model discussed in Calvo [Journal of Monetary Economics (1983), Vol. XII, pp. 383–398] is not outperformed by the same model augmented either with information or indexation, when used to predict the output gap. On the other hand, there are clear gains to using the more recent models when predicting inflation. Results based on mean square forecast error analysis are less clear‐cut, although the standard sticky price model fares best at our longest forecast horizon of 3 years, it performs relatively poorly at shorter horizons. When the strawman time‐series models are added to the picture, we find that the DSGE models still fare very well, often outperforming our forecast competitions, suggesting that theoretical macroeconomic restrictions yield useful additional information for forming macroeconomic forecasts.     

Modified CADF and CIPS Panel Unit Root Statistics with Standard Chi‐squared and Normal Limiting Distributions

In an influential paper Pesaran (‘A simple panel unit root test in presence of cross‐section dependence’, Journal of Applied Econometrics, Vol. 22, pp. 265–312, 2007) proposes two unit root tests for panels with a common factor structure. These are the CADF and CIPS test statistics, which are amongst the most popular test statistics in the literature. One feature of these statistics is that their limiting distributions are highly non‐standard, making for relatively complicated implementation. In this paper, we take this feature as our starting point to develop modified CADF and CIPS test statistics that support standard chi‐squared and normal inference.     

Further Evidence on PPP Adjustment Speeds: the Case of Effective Real Exchange Rates and the EMS*

Two different approaches intend to resolve the ‘puzzling’ slow convergence to purchasing power parity (PPP) reported in the literature [see Rogoff (1996) , Journal of Economic Literature, Vol. 34.] On the one hand, there are models that consider a non‐linear adjustment of real exchange rate to PPP induced by transaction costs. Such costs imply the presence of a certain transaction band where adjustment is too costly to be undertaken. On the other hand, there are models that relax the ‘classical’ PPP assumption of constant equilibrium real exchange rates. A prominent theory put together by Balassa (1964, Journal of Political Economy, Vol. 72) and Samuelson (1964 Review of Economics and Statistics, Vol. 46) , the BS effect, suggests that a non‐constant real exchange rate equilibrium is induced by different productivity growth rates between countries. This paper reconciles those two approaches by considering an exponential smooth transition‐in‐deviation non‐linear adjustment mechanism towards non‐constant equilibrium real exchange rates within the EMS (European Monetary System) and effective rates. The equilibrium is proxied, in a theoretically appealing manner, using deterministic trends and the relative price of non‐tradables to proxy for BS effects. The empirical results provide further support for the hypothesis that real exchange rates are well described by symmetric, nonlinear processes. Furthermore, the half‐life of shocks in such models is found to be dramatically shorter than that obtained in linear models.     

A Note on the Theme of Too Many Instruments*

The difference and system generalized method of moments (GMM) estimators are growing in popularity. As implemented in popular software, the estimators easily generate instruments that are numerous and, in system GMM, potentially suspect. A large instrument collection overfits endogenous variables even as it weakens the Hansen test of the instruments’ joint validity. This paper reviews the evidence on the effects of instrument proliferation, and describes and simulates simple ways to control it. It illustrates the dangers by replicating Forbes [American Economic Review (2000) Vol. 90, pp. 869–887] on income inequality and Levine et al. [Journal of Monetary Economics] (2000) Vol. 46, pp. 31–77] on financial sector development. Results in both papers appear driven by previously undetected endogeneity.     

Bayesian Model Selection with an Uninformative Prior*

Bayesian model selection with posterior probabilities and no subjective prior information is generally not possible because of the Bayes factors being ill‐defined. Using careful consideration of the parameter of interest in cointegration analysis and a re‐specification of the triangular model of Phillips (Econometrica, Vol. 59, pp. 283–306, 1991), this paper presents an approach that allows for Bayesian comparison of models of cointegration with ‘ignorance’ priors. Using the concept of Stiefel and Grassman manifolds, diffuse priors are specified on the dimension and direction of the cointegrating space. The approach is illustrated using a simple term structure of the interest rates model.     

Dickey–Fuller Type of Tests against Nonlinear Dynamic Models*

In this paper, we introduce several test statistics testing the null hypothesis of a random walk (with or without drift) against models that accommodate a smooth nonlinear shift in the level, the dynamic structure and the trend. We derive analytical limiting distributions for all the tests. The power performance of the tests is compared with that of the unit‐root tests by Phillips and Perron [Biometrika (1988), Vol. 75, pp. 335–346], and Leybourne, Newbold and Vougas [Journal of Time Series Analysis (1998), Vol. 19, pp. 83–97]. In the presence of a gradual change in the deterministics and in the dynamics, our tests are superior in terms of power.