Professional forecasters and real-time forecasting with a DSGE model

This paper analyses the real-time forecasting performance of the New Keynesian DSGE model of Galí, Smets and Wouters (2012), estimated on euro area data. It investigates the extent to which the inclusion of forecasts of inflation, GDP growth and unemployment by professional forecasters improve the forecasting performance. We consider two approaches for conditioning on such information. Under the “noise” approach, the mean professional forecasts are assumed to be noisy indicators of the rational expectations forecasts implied by the DSGE model. Under the “news” approach, it is assumed that the forecasts reveal the presence of expected future structural shocks in line with those estimated in the past. The forecasts of the DSGE model are compared with those from a Bayesian VAR model, an AR(1) model, a sample mean and a random walk.     

Forecasting crude oil prices with DSGE models

In this study, we conducted an oil prices forecasting competition among a set of structural models, including vector autoregression and dynamic stochastic general equilibrium (DSGE) models. Our results highlight two principles. First, forecasts should exploit the fact that real oil prices are mean reverting over long horizons. Second, models should not replicate the high volatility of the oil prices observed in samples. By following these principles, we show that an oil sector DSGE model performs much better at real oil price forecasting than random walk or vector autoregression.     

Open economy forecasting with a DSGE-VAR: Head to head with the RBNZ published forecasts

We construct a DSGE-VAR model for competing head to head with the long history of published forecasts of the Reserve Bank of New Zealand. We also construct a Bayesian VAR model with a Minnesota prior for forecast comparison. The DSGE-VAR model combines a structural DSGE model with a statistical VAR model based on the in-sample fit over the majority of New Zealand’s inflation-targeting period. We evaluate the real-time out-of-sample forecasting performance of the DSGE-VAR model, and show that the forecasts from the DSGE-VAR are competitive with the Reserve Bank of New Zealand’s published, judgmentally-adjusted forecasts. The Bayesian VAR model with a Minnesota prior also provides a competitive forecasting performance, and generally, with a few exceptions, out-performs both the DSGE-VAR and the Reserve Bank’s own forecasts.     

DSGE forecasts of the lost recovery

The years following the Great Recession were challenging for forecasters. Unlike other deep downturns, this recession was not followed by a swift recovery, but instead generated a sizable and persistent output gap that was not accompanied by deflation as a traditional Phillips curve relationship would have predicted. Moreover, the zero lower bound and unconventional monetary policy generated an unprecedented policy environment. We document the actual real-time forecasting performance of the New York Fed dynamic stochastic general equilibrium (DSGE) model during this period and explain the results using the pseudo real-time forecasting performance results from a battery of DSGE models. We find the New York Fed DSGE model’s forecasting accuracy to be comparable to that of private forecasters, and notably better for output growth than the median forecasts from the FOMC’s Summary of Economic Projections. The model’s financial frictions were key in obtaining these results, as they implied a slow recovery following the financial crisis.     

Kernel-based calibration diagnostics for recession and inflation probability forecasts

A probabilistic forecast is the estimated probability with which a future event will occur. One interesting feature of such forecasts is their calibration, or the match between the predicted probabilities and the actual outcome probabilities. Calibration has been evaluated in the past by grouping probability forecasts into discrete categories. We show here that we can do this without discrete groupings; the kernel estimators that we use produce efficiency gains and smooth estimated curves relating the predicted and actual probabilities. We use such estimates to evaluate the empirical evidence on the calibration error in a number of economic applications, including the prediction of recessions and inflation, using both forecasts made and stored in real time and pseudo-forecasts made using the data vintage available at the forecast date. The outcomes are evaluated using both first-release outcome measures and subsequent revised data. We find substantial evidence of incorrect calibration in professional forecasts of recessions and inflation from the SPF, as well as in real-time inflation forecasts from a variety of output gap models.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

The implications of financial frictions and imperfect knowledge in the estimated DSGE model of the U.S. economy

In this paper, I study how alternative assumptions about expectation formation can modify the implications of financial frictions for the real economy. I incorporate a financial accelerator mechanism into a version of the Smets and Wouters (2007) DSGE framework and explore the properties of the model assuming, on the one hand, complete rationality of expectations and, alternatively, several learning algorithms that differ in terms of the information set used by agents to produce the forecasts. I show that the implications of the financial accelerator for the business cycle may vary depending on the approach to modeling the expectations. The results suggest that the learning scheme based on small forecasting functions is able to amplify the effects of financial frictions relative to the model with Rational Expectations. Specifically, I show that the dynamics of real variables under learning is driven to a significant extent by the time variation of agents’ beliefs about financial sector variables. During periods when agents perceive asset prices as being relatively more persistent, financial shocks lead to more pronounced macroeconomic outcomes. The amplification effect rises as financial frictions become more severe. At the same time, a learning specification in which agents use more information to generate predictions produces very different asset price and investment dynamics. In such a framework, learning cannot significantly alter the real effects of financial frictions implied by the Rational Expectations model.     

Short-term forecasting of GDP with a DSGE model augmented by monthly indicators

DSGE models are useful tools for evaluating the impact of policy changes, but their use for (short-term) forecasting is still in its infancy. Besides theory-based restrictions, the timeliness of data is an important issue. Since DSGE models are based on quarterly data, they suffer from the publication lag of quarterly national accounts. In this paper we present a framework for the short-term forecasting of GDP based on a medium-scale DSGE model for a small open economy within a currency area. We utilize the information available in monthly indicators based on the approach proposed by Giannone et al. (2009). Using Austrian data, we find that the forecasting performance of the DSGE model can be improved considerably by incorporating monthly indicators, while still maintaining the story-telling capability of the model.     

Evaluating the conditionality of judgmental forecasts

We propose a framework for evaluating the conditionality of forecasts. The crux of our framework is the observation that a forecast is conditional if revisions to the conditioning factor are incorporated faithfully into the remainder of the forecast. We consider whether the Greenbook, Blue Chip survey and Survey of Professional Forecasters exhibit systematic biases in the manner in which they incorporate interest rate projections into the forecasts of other macroeconomic variables. We do not find strong evidence of systematic biases in the three economic forecasts that we consider, as the interest rate projections in these forecasts appear to be incorporated efficiently into the forecasts of other economic variables.     

On the informational role of term structure in the US monetary policy rule

This paper uses a structural approach based on the indirect inference principle to estimate a standard version of the new Keynesian monetary (NKM) model augmented with term structure using both revised and real-time data. The estimation results show that the term spread and policy inertia are both important determinants of the US estimated monetary policy rule whereas the persistence of shocks plays a small but significant role when revised and real-time data of output and inflation are both considered. More importantly, the relative importance of term spread and persistent shocks in the policy rule and the shock transmission mechanism drastically change when it is taken into account that real-time data are not well behaved.     

The emperor's new clothes: a critique of the multivariate t regression model

Zellner (1976) proposed a regression model in which the data vector (or the error vector) is represented as a realization from the multivariate Student t distribution. This model has attracted considerable attention because it seems to broaden the usual Gaussian assumption to allow for heavier-tailed error distributions. A number of results in the literature indicate that the standard inference procedures for the Gaussian model remain appropriate under the broader distributional assumption, leading to claims of robustness of the standard methods. We show that, although mathematically the two models are different, for purposes of statistical inference they are indistinguishable. The empirical implications of the multivariate t model are precisely the same as those of the Gaussian model. Hence the suggestion of a broader distributional representation of the data is spurious, and the claims of robustness are misleading. These conclusions are reached from both frequentist and Bayesian perspectives.     

Conditional assessment of the impact of a Hausman pretest on confidence intervals

In the analysis of clustered and longitudinal data, which includes a covariate that varies both between and within clusters, a Hausman pretest is commonly used to decide whether subsequent inference is made using the linear random intercept model or the fixed effects model. We assess the effect of this pretest on the coverage probability and expected length of a confidence interval for the slope, conditional on the observed values of the covariate. This assessment has the advantages that it (i) relates to the values of this covariate at hand, (ii) is valid irrespective of how this covariate is generated, (iii) uses exact finite sample results, and (iv) results in an assessment that is determined by the values of this covariate and only two unknown parameters. For two real data sets, our conditional analysis shows that the confidence interval constructed after a Hausman pretest should not be used.     

An unobserved component model for multi-rate forecasting of telephone call demand: the design of a forecasting support system

An Unobserved Components (UC) Model based on an enhanced version of the Dynamic Harmonic Regression model, including new multi-rate and modulated cycle procedures, is used to develop a customised package for forecasting and signal extraction applied to hourly telephone call numbers made to Barclaycard plc. service centres, with a forecasting horizon of up to several weeks in advance. The paper outlines both the methodological and algorithmic aspects of the modelling, forecasting and signal extraction procedures, including the design and implementation of forecasting support software with a specially designed Graphical User Interface within the ^® computing environment. The forecasting performance is evaluated comprehensively in comparison with the well-known seasonal ARIMA approach.     

On the number of categories in an ordered regression model

We show that there is no formal statistical testing method to support combining categories in a standard ordered regression model. We discuss practical implications of this result.     

Evolving macroeconomic perceptions and the term structure of interest rates

We explore the role of evolving beliefs regarding the structure of the macroeconomy in improving our understanding of the term structure of interest rates within the context of a simple macro-finance model. Using quarterly vintages of real-time data and survey forecasts for the United States over the past 40 years, we show that a recursively estimated VAR on real GDP growth, inflation and the nominal short-term interest rate generates predictions that are more consistent with survey forecasts than a benchmark fixed-coefficient counterpart. We then estimate a simple term structure model under the assumption that investor risk attitude is driven by near-term expectations of the three state variables. When we allow for evolving beliefs about the macroeconomy, the resulting term structure model provides a better fit to the cross section of yields than the benchmark model, especially at longer maturities, and exhibits better performance in out-of-sample predictions of future yield movements.     

Macroeconomic forecasting with a vector arima model: A case study of the finnish economy

The vector ARIMA (VARIMA) model is a multivariate generalization of the univariate ARIMA model. VARIMA can accomodate assumptions on exogeneity and on contemporaneous relationships. Exogeneous forecasts and non-zero future shocks make it possible to generate alternative forecasts. In a case study VARIMA well describes developments in the 1970's and successfully competes with judgemental methods and ARIMA in providing a general outlook of the early 1980's.     

Measuring the performance of Internet companies using a two-stage data envelopment analysis model

In exploring the business operation of Internet companies, few researchers have used data envelopment analysis (DEA) to evaluate their performance. Since the Internet companies have a two-stage production process: marketability and profitability, this study employs a relational two-stage DEA model to assess the efficiency of the 40 dot com firms. The results show that our model performs better in measuring efficiency, and is able to discriminate the causes of inefficiency, thus helping business management to be more effective through providing more guidance to business performance improvement.     

A resilience-based model for performance evaluation of information systems: the case of a gas company

Information systems (IS) are strongly influenced by changes in new technology and should react swiftly in response to external conditions. Resilience engineering is a new method that can enable these systems to absorb changes. In this study, a new framework is presented for performance evaluation of IS that includes DeLone and McLean’s factors of success in addition to resilience. Hence, this study is an attempt to evaluate the impact of resilience on IS by the proposed model in Iranian Gas Engineering and Development Company via the data obtained from questionnaires and Fuzzy Data Envelopment Analysis (FDEA) approach. First, FDEA model with α-cut = 0.05 was identified as the most suitable model to this application by performing all Banker, Charnes and Cooper and Charnes, Cooper and Rhodes models of and FDEA and selecting the appropriate model based on maximum mean efficiency. Then, the factors were ranked based on the results of sensitivity analysis, which showed resilience had a significantly higher impact on the proposed model relative to other factors. The results of this study were then verified by conducting the related ANOVA test. This is the first study that examines the impact of resilience on IS by statistical and mathematical approaches.     

Human resource management systems and organizational performance: a test of a mediating model in the Greek manufacturing context

This paper investigates the relationship between systems of HRM policies and organizational performance. The research is based on a sample of 178 organizations operating in the Greek manufacturing sector. A mediation model is tested to examine the link between HRM and organizational performance. The results of this study support the hypothesis that the relationship between the HRM systems of resourcing–development and reward–relations, and organizational performance, is mediated through the HRM outcomes of skills and attitudes. The paper not only supports the theory that HRM systems have a positive impact on organizational performance but also explains the mechanisms through which HRM systems improve organizational performance.     

Labour adjustment costs: Estimation of a dynamic discrete choice model using panel data for Greek manufacturing firms

In this paper we estimate a dynamic structural model of employment at firm level. Our dataset consists of a balanced panel of 2790 Greek manufacturing firms. The empirical evidence of this dataset stresses three important stylized facts: (a) there are periods in which firms decide not to change their labour input, (b) there are periods of large employment changes (lumpy nature of labour adjustment) and (c) the commonality is employment spikes to be followed by smooth and low employment growth periods. Following Cooper and Haltiwanger [Cooper, R.W. and Haltiwanger, J. “On the Nature of Capital Adjustment Costs”, Review of Economic Studies, 2006; 73(3); 611–633], we consider a dynamic discrete choice model of a general specification of adjustment costs including convex, non-convex and “disruption of production” components. We use a method of simulated moments procedure to estimate the structural parameters. Our results indicate considerable fixed costs in the Greek employment adjustment.