On finite sample properties of alternative estimators of coefficients in a structural equation with many instruments

We compare four different estimation methods for the coefficients of a linear structural equation with instrumental variables. As the classical methods we consider the limited information maximum likelihood (LIML) estimator and the two-stage least squares (TSLS) estimator, and as the semi-parametric estimation methods we consider the maximum empirical likelihood (MEL) estimator and the generalized method of moments (GMM) (or the estimating equation) estimator. Tables and figures of the distribution functions of four estimators are given for enough values of the parameters to cover most linear models of interest and we include some heteroscedastic cases and nonlinear cases. We have found that the LIML estimator has good performance in terms of the bounded loss functions and probabilities when the number of instruments is large, that is, the micro-econometric models with “many instruments” in the terminology of recent econometric literature.     

FORECASTING REALIZED VOLATILITY WITH LINEAR AND NONLINEAR UNIVARIATE MODELS

Abstract In this paper, we consider a nonlinear model based on neural networks as well as linear models to forecast the daily volatility of the S&P 500 and FTSE 100 futures. As a proxy for daily volatility, we consider a consistent and unbiased estimator of the integrated volatility that is computed from high‐frequency intraday returns. We also consider a simple algorithm based on bagging (bootstrap aggregation) in order to specify the models analysed in this paper.     

Macroeconomic data transformations matter

In a low-dimensional linear regression setup, considering linear transformations/combinations of predictors does not alter predictions. However, when the forecasting technology either uses shrinkage or is nonlinear, it does. This is precisely the fabric of the machine learning (ML) macroeconomic forecasting environment. Pre-processing of the data translates to an alteration of the regularization – explicit or implicit – embedded in ML algorithms. We review old transformations and propose new ones, then empirically evaluate their merits in a substantial pseudo-out-sample exercise. It is found that traditional factors should almost always be included as predictors and moving average rotations of the data can provide important gains for various forecasting targets. Also, we note that while predicting directly the average growth rate is equivalent to averaging separate horizon forecasts when using OLS-based techniques, the latter can substantially improve on the former when regularization and/or nonparametric nonlinearities are involved.     

Nonparametric estimation and testing of fixed effects panel data models

In this paper we consider the problem of estimating nonparametric panel data models with fixed effects. We introduce an iterative nonparametric kernel estimator. We also extend the estimation method to the case of a semiparametric partially linear fixed effects model. To determine whether a parametric, semiparametric or nonparametric model is appropriate, we propose test statistics to test between the three alternatives in practice. We further propose a test statistic for testing the null hypothesis of random effects against fixed effects in a nonparametric panel data regression model. Simulations are used to examine the finite sample performance of the proposed estimators and the test statistics.     

Mixed random forest,cointegration, and forecasting gasoline prices

One of the most successful forecasting machine learning (ML) procedures is random forest (RF). In this paper, we propose a new mixed RF approach for modeling departures from linearity that helps identify (i) explanatory variables with nonlinear impacts, (ii) threshold values, and (iii) the closest parametric approximation. The methodology is applied to weekly forecasts of gasoline prices, cointegrated with international oil prices and exchange rates. Recent specifications for nonlinear error correction (NEC) models include threshold autoregressive models (TAR) and double-threshold smooth transition autoregressive (STAR) models. We propose a new mixed RF model specification strategy and apply it to the determinants of weekly prices of the Spanish gasoline market from 2010 to 2019. In particular, the mixed RF is able to identify nonlinearities in both the error correction term and the rate of change of oil prices. It provides the best weekly gasoline price forecasting performance and supports the logistic error correction model (ECM) approximation.     

R-estimation of the parameters of a multiple regression model with measurement errors

We consider the theory of R-estimation of the regression parameters of a multiple regression models with measurement errors. Using the standard linear rank statistics, R-estimators are defined and their asymptotic properties are studied as robust alternatives to the least squares estimator. This paper fills the gap of the rank theory for the estimation of regression parameters with measurement error models. Some simulation results are presented to show the effectiveness of the R-estimators.     

Estimation and inference in unstable nonlinear least squares models

There is compelling evidence that many macroeconomic and financial variables are not generated by linear models. This evidence is based on testing linearity against either smooth nonlinearity or piece-wise linearity, but there is no framework that encompasses both. This paper provides an econometric framework that allows for both breaks and smooth nonlinearity in between breaks. We estimate the unknown break-dates simultaneously with other parameters via nonlinear least-squares. Using new central limit results for nonlinear processes, we provide inference methods on break-dates and parameter estimates and several instability tests. We illustrate our methods via simulated and empirical smooth transition models with breaks.     

An efficient GMM estimator of spatial autoregressive models

In this paper, we consider GMM estimation of the regression and MRSAR models with SAR disturbances. We derive the best GMM estimator within the class of GMM estimators based on linear and quadratic moment conditions. The best GMM estimator has the merit of computational simplicity and asymptotic efficiency. It is asymptotically as efficient as the ML estimator under normality and asymptotically more efficient than the Gaussian QML estimator otherwise. Monte Carlo studies show that, with moderate-sized samples, the best GMM estimator has its biggest advantage when the disturbances are asymmetrically distributed. When the diagonal elements of the spatial weights matrix have enough variation, incorporating kurtosis of the disturbances in the moment functions will also be helpful.     

Bias in estimating multivariate and univariate diffusions

Multivariate continuous time models are now widely used in economics and finance. Empirical applications typically rely on some process of discretization so that the system may be estimated with discrete data. This paper introduces a framework for discretizing linear multivariate continuous time systems that includes the commonly used Euler and trapezoidal approximations as special cases and leads to a general class of estimators for the mean reversion matrix. Asymptotic distributions and bias formulae are obtained for estimates of the mean reversion parameter. Explicit expressions are given for the discretization bias and its relationship to estimation bias in both multivariate and in univariate settings. In the univariate context, we compare the performance of the two approximation methods relative to exact maximum likelihood (ML) in terms of bias and variance for the Vasicek process. The bias and the variance of the Euler method are found to be smaller than the trapezoidal method, which are in turn smaller than those of exact ML. Simulations suggest that when the mean reversion is slow, the approximation methods work better than ML, the bias formulae are accurate, and for scalar models the estimates obtained from the two approximate methods have smaller bias and variance than exact ML. For the square root process, the Euler method outperforms the Nowman method in terms of both bias and variance. Simulation evidence indicates that the Euler method has smaller bias and variance than exact ML, Nowman’s method and the Milstein method.     

Small sample properties of ML estimator in Vasicek and CIR models: a simulation experiment

Decisions in Economics and Finance - In this paper we analyze small sample properties of the ML estimation procedure in Vasicek and CIR models. In particular, we consider short time series, with a...     

Forecast combination through dimension reduction techniques

This paper considers several methods of producing a single forecast from several individual ones. We compare “standard” but hard to beat combination schemes (such as the average of forecasts at each period, or consensus forecast and OLS-based combination schemes) with more sophisticated alternatives that involve dimension reduction techniques. Specifically, we consider principal components, dynamic factor models, partial least squares and sliced inverse regression.Our source of forecasts is the Survey of Professional Forecasters, which provides forecasts for the main US macroeconomic aggregates. The forecasting results show that partial least squares, principal component regression and factor analysis have similar performances (better than the usual benchmark models), but sliced inverse regression shows an extreme behavior (performs either very well or very poorly).     

Growth Trends and Systematic Patterns of Booms and Busts‐Testing 200 Years of Business Cycle Dynamics

We study the dynamic pattern of business cycles using US GDP data between 1790 and 2015. To address difficulties in trend and cycle decomposition, we introduce a semiparametric estimation approach with an iterative plug‐in (IPI) algorithm for endogenous bandwidth selection. This algorithm identifies continuously moving growth trends with trend‐supporting growth periods. A simulation study demonstrates the value‐added of our trend identification. Afterwards, nonlinear SETAR models are fitted parametrically. Further, we test the trend using a recently developed test and the estimated SETAR models against their linear alternatives. The results indicate asymmetric characteristics during booms and busts.     

Short run and long run causality in time series: inference

We propose methods for testing hypothesis of non-causality at various horizons, as defined in Dufour and Renault (Econometrica 66, (1998) 1099–1125). We study in detail the case of VAR models and we propose linear methods based on running vector autoregressions at different horizons. While the hypotheses considered are nonlinear, the proposed methods only require linear regression techniques as well as standard Gaussian asymptotic distributional theory. Bootstrap procedures are also considered. For the case of integrated processes, we propose extended regression methods that avoid nonstandard asymptotics. The methods are applied to a VAR model of the US economy.     

The estimation of utility‐consistent labor supply models by means of simulated scores

We consider a utility‐consistent static labor supply model with flexible preferences and a nonlinear and possibly non‐convex budget set. Stochastic error terms are introduced to represent optimization and reporting errors, stochastic preferences, and heterogeneity in wages. Coherency conditions on the parameters and the support of error distributions are imposed for all observations. The complexity of the model makes it impossible to write down the probability of participation. Hence we use simulation techniques in the estimation. We compare our approach with various simpler alternatives proposed in the literature. Both in Monte Carlo experiments and for real data the various estimation methods yield very different results. Copyright © 2008 John Wiley & Sons, Ltd.     

Practical Problems with Reduced‐rank ML Estimators for Cointegration Parameters and a Simple Alternative*

Johansen's reduced‐rank maximum likelihood (ML) estimator for cointegration parameters in vector error correction models is known to produce occasional extreme outliers. Using a small monetary system and German data we illustrate the practical importance of this problem. We also consider an alternative generalized least squares (GLS) system estimator which has better properties in this respect. The two estimators are compared in a small simulation study. It is found that the GLS estimator can indeed be an attractive alternative to ML estimation of cointegration parameters.     

Nonparametric dynamic panel data models: Kernel estimation and specification testing

Motivated by the first-differencing method for linear panel data models, we propose a class of iterative local polynomial estimators for nonparametric dynamic panel data models with or without exogenous regressors. The estimators utilize the additive structure of the first-differenced model—the fact that the two additive components have the same functional form, and the unknown function of interest is implicitly defined as a solution of a Fredholm integral equation of the second kind. We establish the uniform consistency and asymptotic normality of the estimators. We also propose a consistent test for the correct specification of linearity in typical dynamic panel data models based on the _L2$L_2$ distance of our nonparametric estimates and the parametric estimates under the linear restriction. We derive the asymptotic distributions of the test statistic under the null hypothesis and a sequence of Pitman local alternatives, and prove its consistency against global alternatives. Simulations suggest that the proposed estimators and tests perform well for finite samples. We apply our new method to study the relationships among economic growth, the initial economic condition and capital accumulation, and find a significant nonlinear relation between economic growth and the initial economic condition.     

Examining bias in estimators of linear rational expectations models under misspecification

Most rational expectations models involve equations in which the dependent variable is a function of its lags and its expected future value. We investigate the asymptotic bias of generalized method of moment (GMM) and maximum likelihood (ML) estimators in such models under misspecification. We consider several misspecifications, and focus more specifically on the case of omitted dynamics in the dependent variable. In a stylized DGP, we derive analytically the asymptotic biases of these estimators. We establish that in many cases of interest the two estimators of the degree of forward-lookingness are asymptotically biased in opposite direction with respect to the true value of the parameter. We also propose a quasi-Hausman test of misspecification based on the difference between the GMM and ML estimators. Using Monte-Carlo simulations, we show that the ordering and direction of the estimators still hold in a more realistic New Keynesian macroeconomic model. In this set-up, misspecification is in general found to be more harmful to GMM than to ML estimators.     

Efficient modelling and forecasting with range based volatility models and its application

This paper considers an alternative method for fitting CARR models using the combined estimating functions (CEF) by showing its usefulness in applications in economics and quantitative finance. The associated information matrix for corresponding new estimates is derived to calculate the standard errors. Extensive simulation study is carried out to demonstrate its superiority relative to two other competitors: the linear estimating functions (LEF) and the maximum likelihood (ML). Results show that the CEF method is more efficient than the LEF and ML methods when the error distribution is mis-specified. Applying a real data set from financial market, we illustrate the applicability of the CEF method in practice and report some reliable forecast values for minimizing the risk in decision making process.     

Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination

In this paper, we examine the forecast accuracy of linear autoregressive, smooth transition autoregressive (STAR), and neural network (NN) time series models for 47 monthly macroeconomic variables of the G7 economies. Unlike previous studies that typically consider multiple but fixed model specifications, we use a single but dynamic specification for each model class. The point forecast results indicate that the STAR model generally outperforms linear autoregressive models. It also improves upon several fixed STAR models, demonstrating that careful specification of nonlinear time series models is of crucial importance. The results for neural network models are mixed in the sense that at long forecast horizons, an NN model obtained using Bayesian regularization produces more accurate forecasts than a corresponding model specified using the specific-to-general approach. Reasons for this outcome are discussed.     

Simultaneous confidence bands: Theory,implementation, and an application to SVARs

Simultaneous confidence bands are versatile tools for visualizing estimation uncertainty for parameter vectors, such as impulse response functions. In linear models, it is known that that the sup‐t confidence band is narrower than commonly used alternatives—for example, Bonferroni and projection bands. We show that the same ranking applies asymptotically even in general nonlinear models, such as vector autoregressions (VARs). Moreover, we provide further justification for the sup‐t band by showing that it is the optimal default choice when the researcher does not know the audience's preferences. Complementing existing plug‐in and bootstrap implementations, we propose a computationally convenient Bayesian sup‐t band with exact finite‐sample simultaneous credibility. In an application to structural VAR impulse response function estimation, the sup‐t band—which has been surprisingly overlooked in this setting—is at least 35% narrower than other off‐the‐shelf simultaneous bands.