The impact of institutional change on forecast accuracy: A case study of budget forecasting in Washington State

This paper explores the relationship between institutional change and forecast accuracy via an analysis of the entitlement caseload forecasting process in Washington State. This research extends the politics of forecasting literature beyond the current area of government revenue forecasting to include expenditure forecasting and introduces an in-depth longitudinal study to the existing set of cross-sectional studies. Employing a fixed-effects model and ordinary least squares regression analysis, this paper concludes that the establishment of an independent forecasting agency and subsequent formation of technical workgroups improve forecast accuracy. Additionally, this study finds that more frequent forecast revisions and structured domain knowledge improve forecast accuracy.     

On the selection of forecasting models

It is standard in applied work to select forecasting models by ranking candidate models by their prediction mean squared error (PMSE) in simulated out-of-sample (SOOS) forecasts. Alternatively, forecast models may be selected using information criteria (IC). We compare the asymptotic and finite-sample properties of these methods in terms of their ability to mimimize the true out-of-sample PMSE, allowing for possible misspecification of the forecast models under consideration. We show that under suitable conditions the IC method will be consistent for the best approximating model among the candidate models. In contrast, under standard assumptions the SOOS method, whether based on recursive or rolling regressions, will select overparameterized models with positive probability, resulting in excessive finite-sample PMSEs.     

Improved forecasting of autoregressive series by weighted least squares approximate REML estimation

Restricted maximum likelihood (REML) estimation has recently been shown to provide less biased estimates in autoregressive series. A simple weighted least squares approximate REML procedure has been developed that is particularly useful for vector autoregressive processes. Here, we compare the forecasts of such processes using both the standard ordinary least squares (OLS) estimates and the new approximate REML estimates. Forecasts based on the approximate REML estimates are found to provide a significant improvement over those obtained using the standard OLS estimates.     

Economic, organizational, and political influences on biases in forecasting state sales tax receipts

This paper investigates factors influencing fixed bias in forecasting state sales taxes revenues. By extending an existing model used to explain forecast accuracy to include a series of complex interactions related to the potential political and policy use of revenue forecasts, the paper extends our understanding of the forecasting process in government. Exploratory empirical analysis based on survey data is used to provide evidence that bias in forecasting results, at least in part, from political and policy manipulation. There is also evidence that institutional reforms associated with ‘good management’ practices affect forecast bias, but in complex ways depending upon the extent to which political competition exists within the state.     

The accuracy of IMF crises nowcasts

The International Monetary Fund (IMF) provides loans to countries in economic crises as a lender of last resort. IMF loan approvals are tied to policy reforms and quantitative targets that reflect the IMF’s crisis assessment. An extensive literature scrutinizes the efficacy of IMF loan programs, instead, we examine the accuracy of the IMF’s crisis assessments (nowcasts) that predicate program designs. Analyzing an unprecedented 602 IMF loan programs from 1992 to 2019, we contradict previous findings that IMF nowcasts are generally optimistic. Disentangling the structure of the IMF’s nowcast bias, we find the IMF systematically overestimates high-growth recoveries GDPs, while low-growth recoveries for low-income countries (LICs) are underestimated. In contrast, non-LICs’ nowcasts exhibit no statistically significant optimistic and pessimistic bias. Interestingly, shorter nowcast horizons do not improve accuracy, and GDP growth nowcasts improved substantially since 2013, while inflation nowcasts remain inefficient. We also isolate the sources of IMF nowcast inefficiencies according to ((i) program objectives, ((ii) program conditionality type, ((iii) geographic regions, ((iv) global crises, and ((v) geopolitics (elections, conflicts, and disasters).     

Validation and forecasting accuracy in models of climate change

Forecasting researchers, with few exceptions, have ignored the current major forecasting controversy: global warming and the role of climate modelling in resolving this challenging topic. In this paper, we take a forecaster’s perspective in reviewing established principles for validating the atmospheric-ocean general circulation models (AOGCMs) used in most climate forecasting, and in particular by the Intergovernmental Panel on Climate Change (IPCC). Such models should reproduce the behaviours characterising key model outputs, such as global and regional temperature changes. We develop various time series models and compare them with forecasts based on one well-established AOGCM from the UK Hadley Centre. Time series models perform strongly, and structural deficiencies in the AOGCM forecasts are identified using encompassing tests. Regional forecasts from various GCMs had even more deficiencies. We conclude that combining standard time series methods with the structure of AOGCMs may result in a higher forecasting accuracy. The methodology described here has implications for improving AOGCMs and for the effectiveness of environmental control policies which are focussed on carbon dioxide emissions alone. Critically, the forecast accuracy in decadal prediction has important consequences for environmental planning, so its improvement through this multiple modelling approach should be a priority.     

Investigating the accuracy of cross-learning time series forecasting methods

The M4 competition identified innovative forecasting methods, advancing the theory and practice of forecasting. One of the most promising innovations of M4 was the utilization of cross-learning approaches that allow models to learn from multiple series how to accurately predict individual ones. In this paper, we investigate the potential of cross-learning by developing various neural network models that adopt such an approach, and we compare their accuracy to that of traditional models that are trained in a series-by-series fashion. Our empirical evaluation, which is based on the M4 monthly data, confirms that cross-learning is a promising alternative to traditional forecasting, at least when appropriate strategies for extracting information from large, diverse time series data sets are considered. Ways of combining traditional with cross-learning methods are also examined in order to initiate further research in the field.     

Demographic shift, relative costs and the allocation of local public consumption in Norway

Local government responses to shifting demand and supply conditions are investigated. The desired allocation of local public consumption is determined in a voter group decision model where different age groups compete for services within an exogenous budget constraint. The model is implemented in an AIDS demand system built into a partial adjustment framework. The estimates indicate that the dramatic shift in the age composition of the population from the young to the elderly during the period studied has led to higher educational spending per pupil and less health care services per elderly. Age groups in decline are able to resist reallocations and gain in terms of spending per head.     

Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task

We conducted laboratory experiments for analyzing the accuracy of three structured approaches (nominal groups, Delphi, and prediction markets) relative to traditional face-to-face meetings (FTF). We recruited 227 participants (11 groups per method) who were required to solve a quantitative judgment task that did not involve distributed knowledge. This task consisted of ten factual questions, which required percentage estimates. While we did not find statistically significant differences in accuracy between the four methods overall, the results differed somewhat at the individual question level. Delphi was as accurate as FTF for eight questions and outperformed FTF for two questions. By comparison, prediction markets did not outperform FTF for any of the questions and were inferior for three questions. The relative performances of nominal groups and FTF were mixed and the differences were small. We also compared the results from the three structured approaches to prior individual estimates and staticized groups. The three structured approaches were more accurate than participants’ prior individual estimates. Delphi was also more accurate than staticized groups. Nominal groups and prediction markets provided little additional value relative to a simple average of the forecasts. In addition, we examined participants’ perceptions of the group and the group process. The participants rated personal communications more favorably than computer-mediated interactions. The group interactions in FTF and nominal groups were perceived as being highly cooperative and effective. Prediction markets were rated least favourably: prediction market participants were least satisfied with the group process and perceived their method as the most difficult.     

Out-of-sample tests of forecasting accuracy: an analysis and review

In evaluations of forecasting accuracy, including forecasting competitions, researchers have paid attention to the selection of time series and to the appropriateness of forecast-error measures. However, they have not formally analyzed choices in the implementation of out-of-sample tests, making it difficult to replicate and compare forecasting accuracy studies. In this paper, I (1) explain the structure of out-of-sample tests, (2) provide guidelines for implementing these tests, and (3) evaluate the adequacy of out-of-sample tests in forecasting software. The issues examined include series-splitting rules, fixed versus rolling origins, updating versus recalibration of model coefficients, fixed versus rolling windows, single versus multiple test periods, diversification through multiple time series, and design characteristics of forecasting competitions. For individual time series, the efficiency and reliability of out-of-sample tests can be improved by employing rolling-origin evaluations, recalibrating coefficients, and using multiple test periods. The results of forecasting competitions would be more generalizable if based upon precisely described groups of time series, in which the series are homogeneous within group and heterogeneous between groups. Few forecasting software programs adequately implement out-of-sample evaluations, especially general statistical packages and spreadsheet add-ins.     

人力资源管理在企业中的角色

文章对人力资源在企业发展中的作用和角色进行了阐述,尤其是在新形势下的人力资源管理职能成为企业战略性伙伴的作用产生了实践意义。     

Using forecast evaluation to improve the accuracy of the Greenbook forecast

Recently, Patton and Timmermann (2012) proposed a more powerful kind of forecast efficiency regression at multiple horizons, and showed that it provides evidence against the efficiency of the Fed’s Greenbook forecasts. I use their forecast efficiency evaluation to propose a method for adjusting the Greenbook forecasts. Using this method in a real-time out-of-sample forecasting exercise, I find that it provides modest improvements in the accuracies of the forecasts for the GDP deflator and CPI, but not for other variables. The improvements are statistically significant in some cases, with magnitudes of up to 18% in root mean square prediction error.     

Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions

Forecast evaluations aim to choose an accurate forecast for making decisions by using loss functions. However, different loss functions often generate different ranking results for forecasts, which complicates the task of comparisons. In this paper, we develop statistical tests for comparing performances of forecasting expectiles and quantiles of a random variable under consistent loss functions. The test statistics are constructed with the extremal consistent loss functions of Ehm et al. (2016). The null hypothesis of the tests is that a benchmark forecast at least performs equally well as a competing one under all extremal consistent loss functions. It can be shown that if such a null holds, the benchmark will also perform at least equally well as the competitor under all consistent loss functions. Thus under the null, when different consistent loss functions are used, the result that the competitor does not outperform the benchmark will not be altered. We establish asymptotic properties of the proposed test statistics and propose to use the re-centered bootstrap to construct their empirical distributions. Through simulations, we show that the proposed test statistics perform reasonably well. We then apply the proposed method to evaluations of several different forecast methods.     

The comparative forecast performance of univariate and multivariate models: an application to real interest rate forecasting

Does the use of information on the past history of the nominal interest rates and inflation entail improvement in forecasts of the ex ante real interest rate over its forecasts obtained from using just the past history of the realized real interest rates? To answer this question we set up a univariate unobserved components model for the realized real interest rates and a bivariate model for the nominal rate and inflation which imposes cointegration restrictions between them. The two models are estimated under normality with the Kalman filter. It is found that the error-correction model provides more accurate one-period ahead forecasts of the real rate within the estimation sample whereas the unobserved components model yields forecasts with smaller forecast variances. In the post-sample period, the forecasts from the bivariate model are not only more accurate but also have tighter confidence bounds than the forecasts from the unobserved components model.     

团体贷款运用于小额信贷的理论探索

本文对已有团体贷款的运作机制和在普通贷款领域的优势研究成果为基础,结合团体贷款和小额信贷的特点,研究了“团体贷款在小额信贷优势问题,指出了团体贷款能有效地克服目前小额信贷中存在的风险与不足,并为团体贷款在小额信贷中的运用与发展提出了理论依据。     

证券咨询机构预测能力分析--以新股定位为例

本文以四家证券咨询机构对108只新股的开盘价预测为研究对象,文中首先给出数据和研究方法;接着对各机构预测误差进行比较以检验不同机构的预测能力;紧接着分析了机构预测价对新股短期投资的参考价值。     

Electricity price forecasting: A review of the state-of-the-art with a look into the future

A variety of methods and ideas have been tried for electricity price forecasting (EPF) over the last 15 years, with varying degrees of success. This review article aims to explain the complexity of available solutions, their strengths and weaknesses, and the opportunities and threats that the forecasting tools offer or that may be encountered. The paper also looks ahead and speculates on the directions EPF will or should take in the next decade or so. In particular, it postulates the need for objective comparative EPF studies involving (i) the same datasets, (ii) the same robust error evaluation procedures, and (iii) statistical testing of the significance of one model’s outperformance of another.     

Forecast combinations of computational intelligence and linear models for the NN5 time series forecasting competition

In this work we introduce the forecasting model with which we participated in the NN5 forecasting competition (the forecasting of 111 time series representing daily cash withdrawal amounts at ATM machines). The main idea of this model is to utilize the concept of forecast combination, which has proven to be an effective methodology in the forecasting literature. In the proposed system we attempted to follow a principled approach, and make use of some of the guidelines and concepts that are known in the forecasting literature to lead to superior performance. For example, we considered various previous comparison studies and time series competitions as guidance in determining which individual forecasting models to test (for possible inclusion in the forecast combination system). The final model ended up consisting of neural networks, Gaussian process regression, and linear models, combined by simple average. We also paid extra attention to the seasonality aspect, decomposing the seasonality into weekly (which is the strongest one), day of the month, and month of the year seasonality.     

Stability in the inefficient use of forecasting systems: A case study in a supply chain company

Computer-based demand forecasting systems have been widely adopted in supply chain companies, but little research has studied how these systems are actually used in the forecasting process. We report the findings of a case study of demand forecasting in a pharmaceutical company over a 15-year period. At the start of the study, managers believed that they were making extensive use of their forecasting system that was marketed based on the accuracy of its advanced statistical methods. Yet most forecasts were obtained using the system’s facility for judgmentally overriding the automatic statistical forecasts. Carrying out the judgmental interventions involved considerable management effort as part of a sales & operations planning (S&OP) process, yet these often only served to reduce forecast accuracy. This study uses observations of the forecasting process, interviews with participants and data on the accuracy of forecasts to investigate why the managers continued to use non-normative forecasting practices for many years despite the potential economic benefits that could be achieved through change. The reasons for the longevity of these practices are examined both from the perspective of the individual forecaster and the organization as a whole.