General‐to‐Specific Model Selection Procedures for Structural Vector Autoregressions*

Structural vector autoregressive (SVAR) models have emerged as a dominant research strategy in empirical macroeconomics, but suffer from the large number of parameters employed and the resulting estimation uncertainty associated with their impulse responses. In this paper, we propose general‐to‐specific (Gets) model selection procedures to overcome these limitations. It is shown that single‐equation procedures are generally efficient for the reduction of recursive SVAR models. The small‐sample properties of the proposed reduction procedure (as implemented using PcGets) are evaluated in a realistic Monte Carlo experiment. The impulse responses generated by the selected SVAR are found to be more precise and accurate than those of the unrestricted VAR. The proposed reduction strategy is then applied to the US monetary system considered by Christiano, Eichenbaum and Evans (Review of Economics and Statistics, Vol. 78, pp. 16–34, 1996) . The results are consistent with the Monte Carlo and question the validity of the impulse responses generated by the full system.     

We Ran One Regression*

The controversy over the selection of ‘growth regressions’ was precipitated by some remarkably numerous ‘estimation’ strategies, including two million regressions by Sala‐i‐Martin [American Economic Review (1997b) Vol. 87, pp. 178–183]. Only one regression is really needed, namely the general unrestricted model, appropriately reduced to a parsimonious encompassing, congruent representation. We corroborate the findings of Hoover and Perez [Oxford Bulletin of Economics and Statistics (2004) Vol. 66], who also adopt an automatic general‐to‐simple approach, despite the complications of data imputation. Such an outcome was also achieved in just one run of PcGets, within a few minutes of receiving the data set in Fernández, Ley and Steel [Journal of Applied Econometrics (2001) Vol. 16, pp. 563–576] from Professor Ley.     

Spurious Fixed Effects Regression*

This article shows that spurious regression results can occur for a fixed effects model with weak time series variation in the regressor and/or strong time series variation in the regression errors when the first‐differenced and Within‐OLS estimators are used. Asymptotic properties of these estimators and the related t‐tests and model selection criteria are studied by sending the number of cross‐sectional observations to infinity. This article shows that the first‐differenced and Within‐OLS estimators diverge in probability, that the related t‐tests are inconsistent, that R²s converge to zero in probability and that AIC and BIC diverge to ?∞ in probability. The results of the article warn that one should not jump to the use of fixed effects regressions without considering the degree of time series variations in the data.     

Evaluating PcGets and RETINA as Automatic Model Selection Algorithms*

The paper describes two automatic model selection algorithms, RETINA and PcGets, briefly discussing how the algorithms work and what their performance claims are. RETINA's Matlab implementation of the code is explained, then the program is compared with PcGets on the data in Perez‐Amaral, Gallo and White (2005 , Econometric Theory, Vol. 21, pp. 262–277), ‘A Comparison of Complementary Automatic Modelling Methods: RETINA and PcGets’, and Hoover and Perez (1999 , Econometrics Journal, Vol. 2, pp. 167–191), ‘Data Mining Reconsidered: Encompassing and the General‐to‐specific Approach to Specification Search’. Monte Carlo simulation results assess the null and non‐null rejection frequencies of the RETINA and PcGets model selection algorithms in the presence of nonlinear functions.     

Leading Indicators for Euro‐area Inflation and GDP Growth*

In this paper, we evaluate the role of a set of variables as leading indicators for Euro‐area inflation and GDP growth. Our leading indicators are taken from the variables in the European Central Bank's (ECB) Euro‐area‐wide model database, plus a set of similar variables for the US. We compare the forecasting performance of each indicator ex post with that of purely autoregressive models. We also analyse three different approaches to combining the information from several indicators. First, ex post, we discuss the use as indicators of the estimated factors from a dynamic factor model for all the indicators. Secondly, within an ex ante framework, an automated model selection procedure is applied to models with a large set of indicators. No future information is used, future values of the regressors are forecast, and the choice of the indicators is based on their past forecasting records. Finally, we consider the forecasting performance of groups of indicators and factors and methods of pooling the ex ante single‐indicator or factor‐based forecasts. Some sensitivity analyses are also undertaken for different forecasting horizons and weighting schemes of forecasts to assess the robustness of the results.     

Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection*

This study investigates the small‐sample performance of meta‐regression methods for detecting and estimating genuine empirical effects in research literatures tainted by publication selection. Publication selection exists when editors, reviewers or researchers have a preference for statistically significant results. Meta‐regression methods are found to be robust against publication selection. Even if a literature is dominated by large and unknown misspecification biases, precision‐effect testing and joint precision‐effect and meta‐significance testing can provide viable strategies for detecting genuine empirical effects. Publication biases are greatly reduced by combining two biased estimates, the estimated meta‐regression coefficient on precision (1/Se) and the unadjusted‐average effect.     

Model selection with estimated factors and idiosyncratic components

This paper provides consistent information criteria for the selection of forecasting models that use a subset of both the idiosyncratic and common factor components of a big dataset. This hybrid model approach has been explored by recent empirical studies to relax the strictness of pure factor‐augmented model approximations, but no formal model selection procedures have been developed. The main difference to previous factor‐augmented model selection procedures is that we must account for estimation error in the idiosyncratic component as well as the factors. Our main contribution is to show the conditions required for selection consistency of a class of information criteria that reflect this additional source of estimation error. We show that existing factor‐augmented model selection criteria are inconsistent in circumstances where N is of larger order than , where N and T are the cross‐section and time series dimensions of the dataset respectively, and that the standard Bayesian information criterion is inconsistent regardless of the relationship between N and T. We therefore propose a new set of information criteria that guarantee selection consistency in the presence of estimated idiosyncratic components. The properties of these new criteria are explored through a Monte Carlo simulation study. The paper concludes with an empirical application to long‐horizon exchange rate forecasting using a recently proposed model with country‐specific idiosyncratic components from a panel of global exchange rates.     

Model selection criteria in multivariate models with multiple structural changes

This paper considers the issue of selecting the number of regressors and the number of structural breaks in multivariate regression models in the possible presence of multiple structural changes. We develop a modified Akaike information criterion (AIC), a modified Mallows’ C_p criterion and a modified Bayesian information criterion (BIC). The penalty terms in these criteria are shown to be different from the usual terms. We prove that the modified BIC consistently selects the regressors and the number of breaks whereas the modified AIC and the modified C_p criterion tend to overfit with positive probability. The finite sample performance of these criteria is investigated through Monte Carlo simulations and it turns out that our modification is successful in comparison to the classical model selection criteria and the sequential testing procedure robust to heteroskedasticity and autocorrelation.     

Testing for Multicointegration in Panel Data with Common Factors*

This paper addresses the concept of multicointegration in a panel data framework and builds upon the panel data cointegration procedures developed in Pedroni [Econometric Theory (2004), Vol. 20, pp. 597–625]. When individuals are either cross‐section independent, or cross‐section dependence can be removed by cross‐section demeaning, our approach can be applied to the wider framework of mixed I(2) and I(1) stochastic processes. The paper also deals with the issue of cross‐section dependence using approximate common‐factor models. Finite sample performance is investigated through Monte Carlo simulations. Finally, we illustrate the use of the procedure investigating an inventories, sales and production relationship for a panel of US industries.     

A Comprehensive Framework for Sustainable Project Portfolio Selection Based on Structural Equation Modeling

Project selection problems are inherently complex problems with multiple and often conflicting objectives. The complexity of project selection problems is due to the high number of projects from which a subset (portfolio) has to be chosen. Various analytical methods, ranging from the simple weighted sum to complex mathematical programming have been proposed to solving these problems. We propose an integrated approach for strategic and sustainable project portfolio selection, which is composed of two distinct but interrelated modules. In the first module, we use the strategic planning and sustainability concepts to select a set of promising projects. In the second module, we use a project portfolio selection procedure to choose among the promising projects identified in the first module. A structural equation model is used to analyze and explain the relationships among different factors in the proposed framework. More specifically, we investigate the effects of: (1) strategic level performance on sustainability, post‐implementation, and overall performance; (2) implementation performance on post‐implementation and overall performance; (3) portfolio selection performance on implementation and overall performance; and (4) post‐implementation performance on overall performance. A case study in investment banking is presented to demonstrate the applicability of the proposed model and exhibit the efficacy of the procedures and algorithms.     

Panel Unit‐root Tests for Cross‐sectionally Correlated Panels: A Monte Carlo Comparison*

This paper deals with the finite‐sample performance of a set of unit‐root tests for cross‐correlated panels. Most of the available macroeconomic time series cover short time periods. The lack of information, in terms of time observations, implies that univariate tests are not powerful enough to reject the null of a unit‐root while panel tests, by exploiting the large number of cross‐sectional units, have been shown to be a promising way of increasing the power of unit‐root tests. We investigate the finite sample properties of recently proposed panel unit‐root tests for cross‐sectionally correlated panels. Specifically, the size and power of Choi's [Econometric Theory and Practice: Frontiers of Analysis and Applied Research: Essays in Honor of Peter C. B. Phillips, Cambridge University Press, Cambridge (2001)], Bai and Ng's [Econometrica (2004), Vol. 72, p. 1127], Moon and Perron's [Journal of Econometrics (2004), Vol. 122, p. 81], and Phillips and Sul's [Econometrics Journal (2003), Vol. 6, p. 217] tests are analysed by a Monte Carlo simulation study. In synthesis, Moon and Perron's tests show good size and power for different values of T and N, and model specifications. Focusing on Bai and Ng's procedure, the simulation study highlights that the pooled Dickey–Fuller generalized least squares test provides higher power than the pooled augmented Dickey–Fuller test for the analysis of non‐stationary properties of the idiosyncratic components. Choi's tests are strongly oversized when the common factor influences the cross‐sectional units heterogeneously.     

Panel Stationarity Test with Structural Breaks*

In this paper, we extend the heterogeneous panel data stationarity test of Hadri [Econometrics Journal, Vol. 3 (2000) pp. 148–161] to the cases where breaks are taken into account. Four models with different patterns of breaks under the null hypothesis are specified. Two of the models have been already proposed by Carrion‐i‐Silvestre et al. [Econometrics Journal, Vol. 8 (2005) pp. 159–175]. The moments of the statistics corresponding to the four models are derived in closed form via characteristic functions. We also provide the exact moments of a modified statistic that do not asymptotically depend on the location of the break point under the null hypothesis. The cases where the break point is unknown are also considered. For the model with breaks in the level and no time trend and for the model with breaks in the level and in the time trend, Carrion‐i‐Silvestre et al. [Econometrics Journal, Vol. 8 (2005) pp. 159–175] showed that the number of breaks and their positions may be allowed to differ across individuals for cases with known and unknown breaks. Their results can easily be extended to the proposed modified statistic. The asymptotic distributions of all the statistics proposed are derived under the null hypothesis and are shown to be normally distributed. We show by simulations that our suggested tests have in general good performance in finite samples except the modified test. In an empirical application to the consumer prices of 22 OECD countries during the period from 1953 to 2003, we found evidence of stationarity once a structural break and cross‐sectional dependence are accommodated.     

Diagnostic Tests of Cross‐section Independence for Limited Dependent Variable Panel Data Models*

This article considers the problem of testing for cross‐section independence in limited dependent variable panel data models. It derives a Lagrangian multiplier (LM) test and shows that in terms of generalized residuals of Gourieroux et al. (1987) it reduces to the LM test of Breusch and Pagan (1980) . Because of the tendency of the LM test to over‐reject in panels with large N (cross‐section dimension), we also consider the application of the cross‐section dependence test (CD) proposed by Pesaran (2004) . In Monte Carlo experiments it emerges that for most combinations of N and T the CD test is correctly sized, whereas the validity of the LM test requires T (time series dimension) to be quite large relative to N. We illustrate the cross‐sectional independence tests with an application to a probit panel data model of roll‐call votes in the US Congress and find that the votes display a significant degree of cross‐section dependence.     

HEGY Tests in the Presence of Moving Averages*

We analyze the asymptotic distributions associated with the seasonal unit root tests of Hylleberg et al. (1990) for quarterly data when the innovations follow a moving average process. Although both the t‐ and F‐type tests suffer from scale and shift effects compared with the presumed null distributions when a fixed order of autoregressive augmentation is applied, these effects disappear when the order of augmentation is sufficiently large. However, as found by Burridge and Taylor (2001) for the autoregressive case, individual t‐ratio tests at the semi‐annual frequency are not pivotal even with high orders of augmentation, although the corresponding joint F‐type statistic is pivotal. Monte Carlo simulations verify the importance of the order of augmentation for finite samples generated by seasonally integrated moving average processes.     

Bias Reduction in Dynamic Panel Data Models by Common Recursive Mean Adjustment*

The within‐group estimator (same as the least squares dummy variable estimator) of the dominant root in dynamic panel regression is known to be biased downwards. This article studies recursive mean adjustment (RMA) as a strategy to reduce this bias for AR(p) processes that may exhibit cross‐sectional dependence. Asymptotic properties for N,T→∞ jointly are developed. When ( log ²T)(N/T)→ζ, where ζ is a non‐zero constant, the estimator exhibits nearly negligible inconsistency. Simulation experiments demonstrate that the RMA estimator performs well in terms of reducing bias, variance and mean square error both when error terms are cross‐sectionally independent and when they are not. RMA dominates comparable estimators when T is small and/or when the underlying process is persistent.     

Bayesian Model Selection with an Uninformative Prior*

Bayesian model selection with posterior probabilities and no subjective prior information is generally not possible because of the Bayes factors being ill‐defined. Using careful consideration of the parameter of interest in cointegration analysis and a re‐specification of the triangular model of Phillips (Econometrica, Vol. 59, pp. 283–306, 1991), this paper presents an approach that allows for Bayesian comparison of models of cointegration with ‘ignorance’ priors. Using the concept of Stiefel and Grassman manifolds, diffuse priors are specified on the dimension and direction of the cointegrating space. The approach is illustrated using a simple term structure of the interest rates model.     

Regression Models with Data‐based Indicator Variables*

Ordinary least squares estimation of an impulse‐indicator coefficient is inconsistent, but its variance can be consistently estimated. Although the ratio of the inconsistent estimator to its standard error has a t‐distribution, that test is inconsistent: one solution is to form an index of indicators. We provide Monte Carlo evidence that including a plethora of indicators need not distort model selection, permitting the use of many dummies in a general‐to‐specific framework. Although White's (1980) heteroskedasticity test is incorrectly sized in that context, we suggest an easy alteration. Finally, a possible modification to impulse ‘intercept corrections’ is considered.     

Cointegration Testing in Panels with Common Factors*

Panel unit‐root and no‐cointegration tests that rely on cross‐sectional independence of the panel unit experience severe size distortions when this assumption is violated, as has, for example, been shown by Banerjee, Marcellino and Osbat [Econometrics Journal (2004), Vol. 7, pp. 322–340; Empirical Economics (2005), Vol. 30, pp. 77–91] via Monte Carlo simulations. Several studies have recently addressed this issue for panel unit‐root tests using a common factor structure to model the cross‐sectional dependence, but not much work has been done yet for panel no‐cointegration tests. This paper proposes a model for panel no‐cointegration using an unobserved common factor structure, following the study by Bai and Ng [Econometrica (2004), Vol. 72, pp. 1127–1177] for panel unit roots. We distinguish two important cases: (i) the case when the non‐stationarity in the data is driven by a reduced number of common stochastic trends, and (ii) the case where we have common and idiosyncratic stochastic trends present in the data. We discuss the homogeneity restrictions on the cointegrating vectors resulting from the presence of common factor cointegration. Furthermore, we study the asymptotic behaviour of some existing residual‐based panel no‐cointegration tests, as suggested by Kao [Journal of Econometrics (1999), Vol. 90, pp. 1–44] and Pedroni [Econometric Theory (2004a), Vol. 20, pp. 597–625]. Under the data‐generating processes (DGP) used, the test statistics are no longer asymptotically normal, and convergence occurs at rate T rather than as for independent panels. We then examine the possibilities of testing for various forms of no‐cointegration by extracting the common factors and individual components from the observed data directly and then testing for no‐cointegration using residual‐based panel tests applied to the defactored data.     

Hablas vielleicht un peu la mia language? A comprehensive overview of the role of language differences in headquarters–subsidiary communication

The management of human resources in headquarters (HQ)–subsidiary relationships requires intensive communication, but effective communication often depends on having a shared language. Hence, language differences can be a serious threat to the successful management of human resources in multinational corporations. In this large-scale quantitative study, encompassing data from more than 800 subsidiaries in 13 countries, we investigated four related issues. First, in terms of the importance of language differences, we found that HQ–subsidiary relationships are clearly affected by language differences and that the latter form a distance category of their own, which should not be subsumed under the related, but separate concept of cultural differences. Second, regarding the consequences of language differences for communication outcomes, we found that a lack of a shared language is associated with misunderstanding, conflict and parallel information networks, which could harm HQ–subsidiary interactions. Third, with regard to the impact of language differences on communication methods, we found that a lack of a shared language is associated with a significantly lower level of oral (face-to-face and phone) communication, but not written communication. Fourth, and finally, in terms of a potential solution to communication problems caused by language differences, we found that expatriates can facilitate both communication and knowledge transfer between HQ and subsidiaries.     

Evaluating a Model by Forecast Performance*

Although out‐of‐sample forecast performance is often deemed to be the ‘gold standard’ of evaluation, it is not in fact a good yardstick for evaluating models in general. The arguments are illustrated with reference to a recent paper by Carruth, Hooker and Oswald [Review of Economics and Statistics (1998) , Vol. 80, pp. 621–628], who suggest that the good dynamic forecasts of their model support the efficiency‐wage theory on which it is based.