On the Performance of Naïve, Analyst and Composite Earnings Forecasts: Evidence from Hong Kong

In this paper, we compare the information content and performance of naïve, analyst and composite forecasts in Hong Kong. Empirical evidence shows that superior performance can be obtained by a composite measure combining both analyst and naïve forecasts. In addition, analyst forecasts become more conditionally efficient over the naïve model as the actual announcement approaches. The superiority and timing advantage of analyst forecasts suggest that more emphasis should be placed on the services of analysts for predicting future earnings figures, particularly when the announcement is approaching.     

Does judgment improve macroeconomic density forecasts?

This paper presents empirical evidence on how judgmental adjustments affect the accuracy of macroeconomic density forecasts. Judgment is defined as the difference between professional forecasters’ densities and the forecast densities from statistical models. Using entropic tilting, we evaluate whether judgments about the mean, variance and skew improve the accuracy of density forecasts for UK output growth and inflation. We find that not all judgmental adjustments help. Judgments about point forecasts tend to improve density forecast accuracy at short horizons and at times of heightened macroeconomic uncertainty. Judgments about the variance hinder at short horizons, but can improve tail risk forecasts at longer horizons. Judgments about skew in general take value away, with gains seen only for longer horizon output growth forecasts when statistical models took longer to learn that downside risks had reduced with the end of the Great Recession. Overall, density forecasts from statistical models prove hard to beat.     

Time Series Based Errors and Empirical Errors in Fertility Forecasts in the Nordic Countries*

We use ARCH time series models to derive model based prediction intervals for the Total Fertility Rate (TFR) in Norway, Sweden, Finland, and Denmark up to 2050. For the short term (5–10 yrs), expected TFR‐errors are compared with empirical forecast errors observed in historical population forecasts prepared by the statistical agencies in these countries since 1969. Medium‐term and long‐term (up to 50 years) errors are compared with error patterns based on so‐called naïve forecasts, i.e. forecasts that assume that recently observed TFR‐levels also apply for the future.     

Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models

In a data-rich environment, forecasting economic variables amounts to extracting and organizing useful information from a large number of predictors. So far, the dynamic factor model and its variants have been the most successful models for such exercises. In this paper, we investigate a category of LASSO-based approaches and evaluate their predictive abilities for forecasting twenty important macroeconomic variables. These alternative models can handle hundreds of data series simultaneously, and extract useful information for forecasting. We also show, both analytically and empirically, that combing forecasts from LASSO-based models with those from dynamic factor models can reduce the mean square forecast error (MSFE) further. Our three main findings can be summarized as follows. First, for most of the variables under investigation, all of the LASSO-based models outperform dynamic factor models in the out-of-sample forecast evaluations. Second, by extracting information and formulating predictors at economically meaningful block levels, the new methods greatly enhance the interpretability of the models. Third, once forecasts from a LASSO-based approach are combined with those from a dynamic factor model by forecast combination techniques, the combined forecasts are significantly better than either dynamic factor model forecasts or the naïve random walk benchmark.     

Bait and ditch: Consumer naïveté and salesforce incentives

We analyze a model of price competition between a transparent retailer and a deceptive one in a market where a fraction of consumers is naïve. The transparent retailer is an independent shop managed by its owner. The deceptive retailer belongs to a chain and is operated by a manager. The two retailers sell an identical base product, but the deceptive one also offers an add‐on. Rational consumers never consider buying the add‐on while naïve ones can be “talked” into buying it. By offering the manager a contract that pushes him to never sell the base good without the add‐on, the chain can induce an equilibrium in which both retailers obtain more‐than‐competitive profits. The equilibrium features price dispersion and market segmentation, with the deceptive retailer targeting only naïve consumers whereas the transparent retailer serves only rational ones.     

Macroeconomic forecasting and structural change

The aim of this paper is to assess whether modeling structural change can help improving the accuracy of macroeconomic forecasts. We conduct a simulated real‐time out‐of‐sample exercise using a time‐varying coefficients vector autoregression (VAR) with stochastic volatility to predict the inflation rate, unemployment rate and interest rate in the USA. The model generates accurate predictions for the three variables. In particular, the forecasts of inflation are much more accurate than those obtained with any other competing model, including fixed coefficients VARs, time‐varying autoregressions and the naïve random walk model. The results hold true also after the mid 1980s, a period in which forecasting inflation was particularly hard. Copyright © 2011 John Wiley & Sons, Ltd.     

Recession forecasting using Bayesian classification

We demonstrate the use of a Naïve Bayes model as a recession forecasting tool. The approach is closely connected with Markov-switching models and logistic regression, but also has important differences. In contrast to Markov-switching models, our Naïve Bayes model treats National Bureau of Economic Research business cycle turning points as data, rather than as hidden states to be inferred by the model. Although Naïve Bayes and logistic regression are asymptotically equivalent under certain distributional assumptions, the assumptions do not hold for business cycle data. As a result, Naïve Bayes has a larger asymptotic error rate, but converges to the error rate more quickly than logistic regression, resulting in more accurate recession forecasts with limited data. We show that Naïve Bayes outperforms competing models and the Survey of Professional Forecasters consistently for real-time recession forecasting up to 12 months in advance. These results hold under standard error measures, and also under a novel measure that varies the penalty on false signals, depending on when they occur within a cycle; for example, a false signal in the middle of an expansion is penalized more heavily than one that occurs close to a turning point.     

An Evaluation of Financial Analysts' Earnings Forecasts for Hong Kong Firms

This study evaluates the accuracy and potential bias of analyst forecasts for Hong Kong firms published in the Estimate Directory and compares analyst forecasts to model forecasts. It also examines the association of forecast accuracy with various firm characteristics. The findings of the study show that on an overall basis analyst forecasts for Hong Kong firms are more accurate than model forecasts. Analyst forecasts for Earnings Per Share (EPS) are generally biased towards overstatement. The analysis of the association between forecast accuracy and company characteristics suggests that analyst forecasts for larger firms are comparatively more accurate than for smaller firms. As expected, the results also show that analyst forecasts with shorter time horizons are more accurate than forecasts with longer time horizons. The variability in firms' earnings, beta (market risk) or industry classification have no significant impact on the accuracy of analyst forecasts.     

Embrace the differences: Revisiting the PollyVote method of combining forecasts for U.S. presidential elections (2004 to 2020)

While combining forecasts is well-known to reduce error, the question of how to best combine forecasts remains. Prior research suggests that combining is most beneficial when relying on diverse forecasts that incorporate different information. Here, I provide evidence in support of this hypothesis by analyzing data from the PollyVote project, which has published combined forecasts of the popular vote in U.S. presidential elections since 2004. Prior to the 2020 election, the PollyVote revised its original method of combining forecasts by, first, restructuring individual forecasts based on their underlying information and, second, adding naïve forecasts as a new component method. On average across the last 100 days prior to the five elections from 2004 to 2020, the revised PollyVote reduced the error of the original specification by eight percent and, with a mean absolute error (MAE) of 0.8 percentage points, was more accurate than any of its component forecasts. The results suggest that, when deciding about which forecasts to include in the combination, forecasters should be more concerned about the component forecasts’ diversity than their historical accuracy.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

Using forecast evaluation to improve the accuracy of the Greenbook forecast

Recently, Patton and Timmermann (2012) proposed a more powerful kind of forecast efficiency regression at multiple horizons, and showed that it provides evidence against the efficiency of the Fed’s Greenbook forecasts. I use their forecast efficiency evaluation to propose a method for adjusting the Greenbook forecasts. Using this method in a real-time out-of-sample forecasting exercise, I find that it provides modest improvements in the accuracies of the forecasts for the GDP deflator and CPI, but not for other variables. The improvements are statistically significant in some cases, with magnitudes of up to 18% in root mean square prediction error.     

A Dynamic Panel Data Approach to the Forecasting of the GDP of German Länder

Abstract

In this paper, we make multi-step forecasts of the annual growth rates of the real GDP for each of the 16 German Länder simultaneously. We apply dynamic panel models accounting for spatial dependence between regional GDP. We find that both pooling and accounting for spatial effects help to improve the forecast performance substantially. We demonstrate that the effect of accounting for spatial dependence is more pronounced for longer forecasting horizons (the forecast accuracy gain is about 9% for a 1-year horizon and exceeds 40% for a 5-year horizon). We recommend incorporating a spatial dependence structure into regional forecasting models, especially when long-term forecasts are made.     

One model and various experts: Evaluating Dutch macroeconomic forecasts

The Netherlands Bureau for Economic Policy Analysis (CPB) uses a large macroeconomic model to create forecasts of various important macroeconomic variables. The outcomes of this model are usually filtered by experts, and it is the expert forecasts that are made available to the general public. In this paper we re-create the model forecasts for the period 1997-2008 and compare the expert forecasts with the pure model forecasts. Our key findings from the first time that this unique database has been analyzed are that (i) experts adjust upwards more often; (ii) expert adjustments are not autocorrelated, but their sizes do depend on the value of the model forecast; (iii) the CPB model forecasts are biased for a range of variables, but (iv) at the same time, the associated expert forecasts are more often unbiased; and that (v) expert forecasts are far more accurate than the model forecasts, particularly when the forecast horizon is short. In summary, the final CPB forecasts de-bias the model forecasts and lead to higher accuracies than the initial model forecasts.     

Forecast revisions of Mexican inflation and GDP growth

We analyze the forecasts of inflation and GDP growth contained in the Banco de México’s Survey of Professional Forecasters for the period 1995–2009. The forecasts are for the current and the following year, and comprise an unbalanced three-dimensional panel with multiple individual forecasters, target years, and forecast horizons. The fixed-event nature of the forecasts enables us to examine their efficiency by looking at the revision process. The panel structure allows us to control for aggregate shocks and to construct a measure of the news that impacted expectations in the period under study. We find that respondents anchor to their initial forecasts, updating their revisions smoothly as they receive more information. In addition, they do not seem to use publicly-known information in an efficient manner. These inefficiencies suggest clear areas of opportunity for improving the accuracy of the forecasts, for instance by taking into account the positive autocorrelation found in forecast revisions.     

Efficient estimation of forecast uncertainty based on recent forecast errors

Multi-step-ahead forecasts of the forecast uncertainty of an individual forecaster are often based on the horizon-specific sample means of his recent squared forecast errors, where the number of past forecast errors available decreases one-to-one with the forecast horizon. In this paper, the efficiency gains from the joint estimation of forecast uncertainty for all horizons in such samples are investigated. If the forecast uncertainty is estimated by seemingly unrelated regressions, it turns out that the covariance matrix of the squared forecast errors does not have to be estimated, but simply needs to have a certain structure, which is a very useful property in small samples. Considering optimal and non-optimal forecasts, it is found that the efficiency gains can be substantial for longer horizons in small samples. The superior performance of the seemingly-unrelated-regressions approach is confirmed in several empirical applications.     

Testing the predictive accuracy of COVID-19 forecasts

We test the predictive accuracy of forecasts of the number of COVID-19 fatalities produced by several forecasting teams and collected by the United States Centers for Disease Control and Prevention for the epidemic in the United States. We find three main results. First, at the short horizon (1 week ahead) no forecasting team outperforms a simple time-series benchmark. Second, at longer horizons (3 and 4 week ahead) forecasters are more successful and sometimes outperform the benchmark. Third, one of the best performing forecasts is the Ensemble forecast, that combines all available predictions using uniform weights. In view of these results, collecting a wide range of forecasts and combining them in an ensemble forecast may be a superior approach for health authorities, rather than relying on a small number of forecasts.     

Accounting and the Hope of Action

The paper discusses the role of hope in the construction of an accounting technology to realize a program, by looking at a process of choosing non-financial indicators in an effort to achieve healthier workplaces. By exploring the literature dealing with the concept of hope and by drawing on the debate on the relationship between accounting and action, we highlight the features of three hope-related concepts (hopelessness, naïve hope, and reflective hope). We also highlight how these concepts relate to different areas of uncertainty (validity, accuracy, and relevance) in the development of accounting technologies. Evidence collected through particiapant observation of a team involved in the construction of indicators offers empirical material to investigate the interplay between hopelessness, naïve hope, and reflective hope in relation to uncertainties concerning the link between accounting and action. Beyond analyzing how team members move from a naïve to a reflective hope in making the accounting–action link, the paper shows that among practitioners it is accepted that unintended consequences constitute the rule rather than the exception in the accounting–action link.     

Fiscal Surprises at the FOMC

We examine a new set of U.S. fiscal forecasts from the FOMC briefing books. These forecasts are precisely those that were presented to monetary policymakers, and include frequently-updated estimates covering six complete business cycles and several fiscal-policy regimes. We detail the performances of forecast federal expenditures, revenues, surpluses, and structural surpluses in terms of their accuracy, bias, and efficiency. We find that forecast errors can be large economically, even at relatively short forecast horizons. While economic activity became less volatile after 1990, fiscal policy became harder to forecast. Finally, cyclically-adjusted deficit forecasts appear to be over-optimistic around both peaks and troughs of the business cycle, suggesting that fiscal policy is counter-cyclical in downturns and pro-cyclical in the early stages of recoveries.     

Feature weighted naïve Bayes algorithm for information retrieval of enterprise systems

Automated information retrieval is critical for enterprise information systems to acquire knowledge from the vast amount of data sets. One challenge in information retrieval is text classification. Current practices rely heavily on the classical naïve Bayes algorithm due to its simplicity and robustness. However, results from this algorithm are not always satisfactory. In this article, the limitations of the naïve Bayes algorithm are discussed, and it is found that the assumption on the independence of terms is the main reason for an unsatisfactory classification in many real-world applications. To overcome the limitations, the dependent factors are considered by integrating a term frequency–inverse document frequency (TF-IDF) weighting algorithm in the naïve Bayes classification. Moreover, the TF-IDF algorithm itself is improved so that both frequencies and distribution information are taken into consideration. To illustrate the effectiveness of the proposed method, two simulation experiments were conducted, and the comparisons with other classification methods have shown that the proposed method has outperformed other existing algorithms in terms of precision and index recall rate.     

Forecasting with Global Vector Autoregressive Models: a Bayesian Approach

This paper develops a Bayesian variant of global vector autoregressive (B‐GVAR) models to forecast an international set of macroeconomic and financial variables. We propose a set of hierarchical priors and compare the predictive performance of B‐GVAR models in terms of point and density forecasts for one‐quarter‐ahead and four‐quarter‐ahead forecast horizons. We find that forecasts can be improved by employing a global framework and hierarchical priors which induce country‐specific degrees of shrinkage on the coefficients of the GVAR model. Forecasts from various B‐GVAR specifications tend to outperform forecasts from a naive univariate model, a global model without shrinkage on the parameters and country‐specific vector autoregressions. Copyright © 2016 John Wiley & Sons, Ltd.