Analytic derivatives of the matrix exponential for estimation of linear continuous-time models

Linear-in-variables continuous-time processes are estimated nonlinearly, because the coefficients of the implied linear-in-variables discrete-time estimating equations are the exponential of a matrix formed with the continuous-time parameters. Even with sampling complications such as irregular intervals, mixed frequencies, and stock and flow variables, using Van loan's (1978) results, the mapping from continuous- to discrete-time parameters and its derivatives can be expressed as the submatrix of a matrix exponential. For quicker estimation and more accurate hypothesis testing or sensitivity analysis, it is often better to compute analytically the first-order derivatives of the mapping. This paper explains how to compute efficiently the continuous- to discrete-time parameter mapping and its derivatives, without computing an eigenvalue decomposition, the common way of doing this. By linking present results with previous ones, a complete chain rule is obtained for computing the Gaussian likelihood function and its derivatives with respect to the continuous-time parameters.     

On the computational competitiveness of full-information maximum-likelihood and three-stage least-squares in the estimation of nonlinear,simultaneous-equations models

While full-information maximum-likehood (FIML) estimation has long been considered an important theoretical econometric estimation technique, computational considerations have greatly restricted its use in practice. Recent advances in numerical analysis and in computational software, however, have combined to provide algorithms capable of carrying out the FIML calculations quite efficiently relative to past standards. This paper compares the computational competitiveness of FIML with its most popular competitor, 3SLS, in the estimation of a variety of linear and non-linear (in parameters and variables) models. The nonlinear full-information maximum-likelihood (NLFIML) estimator is described and a computatíonally efficient approximation, TRUNFIML, is defined. Nonlinear three-stage least-squares (NL3SLS) is accomplished by the method of Jorgenson-Laffont. Comparisons are made on the basis of numbers of iterations to convergence, number of function evaluations, and total computer CPU time required, this latter figure being most relevant to a comparison of computational effort and cost.     

A remark on the recursive estimation of ARMA order

Summary It is well known how, for an ARMA process of order (p ₀,q ₀), max (p ₀,q ₀) may be recursively estimatedHannan/Rissanen. Assuming max (p ₀,q ₀) to be known and, in addition,p ₀q ₀, a simple procedure for the recursive estimation of (p ₀,q ₀) is presented.     

The invertibility of sampled and aggregated ARMA models

Summary Necessary and sufficient conditions for a sampled (resp. aggregated) stationary ARMA process to be invertible are derived. It is shown that a sampled (resp. aggregated) invertible stationary ARMA process is always invertible.     

Fully Bayesian analysis of ARMA time series models

Statistical analysis of autoregressive-moving average (ARMA) models is an important non-standard problem. No classical approach is widely accepted; legitimacy for most classical approaches is based solely on asymptotic grounds, while small sample sizes are common. The only obstacle to the Bayesian approach are designing a structure through which prior information can be incorporated and designing a practical computational method. The objective of this work is to overcome these two obstacles. In addition to the standard results, the Bayesian approach gives a different method of determining the order of the ARMA model, that is (p, q).     

FIML estimation of the dynamic simultaneous equations model with ARMA disturbances

A method is presented for the estimation of the parameters in the dynamic simultaneous equations model with vector autoregressive moving average disturbances. The estimation procedure is derived from the full information maximum likelihood approach and is based on Newton-Raphson techniques applied to the likelihood equations. The resulting two-step Newton-Raphson procedure involves only generalized instrumental variables estimation in the second step. This procedure also serves as the basis for an iterative scheme to solve the normal equations and obtain the maximum likelihood estimates of the conditional likelihood function. A nine-equation variant of the quarterly forecasting model of the US economy developed by Fair is then used as a realistic example to illustrate the estimation procedure described in the paper.     

Non-Gaussian models for CoVaR estimation

In this paper we show how to obtain estimates of CoVaR based on models that take into consideration some stylized facts about multivariate financial time series of equity log returns: heavy tails, negative skew, asymmetric dependence, and volatility clustering. While the volatility clustering effect is captured by AR-GARCH dynamics of the Glosten-Jagannathan-Runkle (GJR) type, the other stylized facts are explained by non-Gaussian multivariate models and copula functions. We compare the different models in the period from January 2007 to March 2020. Our empirical study conducted on a sample of listed banks in the euro area confirms that, in measuring CoVaR, it is important to capture the time-varying dynamics of the volatility. Additionally, a correct assessment of the heaviness of the tails and of the dependence structure is needed in the evaluation of this systemic risk measure.     

Robust estimation for the order of finite mixture models

In this paper, we study a robust and efficient estimation procedure for the order of finite mixture models based on the minimizing a penalized density power divergence estimator. For this task, we use the locally conic parametrization approach developed by Dacunha-Castelle and Gassiate (ESAIM Probab Stat 285–317, 1997a; Ann Stat 27:1178–1209, 1999), and verify that the minimizing a penalized density power divergence estimator is consistent. Simulation results are provided for illustration.     

An exact test for a column of the covariance matrix based on a single observation

In this paper, we derive an exact test for a column of the covariance matrix. The test statistic is calculated by using a single observation. The exact distributions of the test statistic are derived under both the null and alternative hypotheses. We also obtain an analytical expression of the power function of the test for the equality of a column of the covariance matrix to a given vector. It is shown that the information contained in a single vector is large enough to ensure a good performance of the test. Moreover, the suggested test can be applied for time-dependent multivariate Gaussian processes.     

Non-parametric, unconditional quantile estimation for efficiency analysis with an application to Federal Reserve check processing operations

This paper examines the technical efficiency of US Federal Reserve check processing offices over 1980–2003. We extend results from Park et al. [Park, B., Simar, L., Weiner, C., 2000. FDH efficiency scores from a stochastic point of view. Econometric Theory 16, 855–877] and Daouia and Simar [Daouia, A., Simar, L., 2007. Nonparametric efficiency analysis: a multivariate conditional quantile approach. Journal of Econometrics 140, 375–400] to develop an unconditional, hyperbolic, α-quantile estimator of efficiency. Our new estimator is fully non-parametric and robust with respect to outliers; when used to estimate distance to quantiles lying close to the full frontier, it is strongly consistent and converges at rate root-n, thus avoiding the curse of dimensionality that plagues data envelopment analysis (DEA) estimators. Our methods could be used by policymakers to compare inefficiency levels across offices or by managers of individual offices to identify peer offices.     

Large-sample estimation strategies for eigenvalues of a Wishart matrix

The problem of simultaneous asymptotic estimation of eigenvalues of covariance matrix of Wishart matrix is considered under a weighted quadratic loss function. James-Stein type of estimators are obtained which dominate the sample eigenvalues. The relative merits of the proposed estimators are compared to the sample eigenvalues using asymptotic quadratic distributional risk under loal alternatives. It is shown that the proposed estimators are asymptotically superior to the sample eigenvalues. Further, it is demonstrated that the James-Stein type estimator is dominated by its truncated part.     

Distribution of residual autocorrelations for multiplicative seasonal ARMA models with uncorrelated but nonindependent error terms

In this paper, we consider portmanteau tests for testing the adequacy of multiplicative seasonal autoregressive moving‐average models under the assumption that the errors are uncorrelated but not necessarily independent. We relax the standard independence assumption on the error terms in order to extend the range of applications of the seasonal autoregressive moving‐average models. We study the asymptotic distributions of residual and normalized residual empirical autocovariances and autocorrelations under weak assumptions on noise. We establish the asymptotic behavior of the proposed statistics. A set of Monte Carlo experiments and an application to monthly mean total sunspot number are presented.     

Robust estimation of ARIMA models

The paper discusses methods of estimating univariate ARIMA models with outliers. The approach calls for a state vector representation of a time-series model, on which we can then operate on using the Kalman filter. One of the additional advantages of Kalman filter operating on the state vector representation is that the method and code could easily be adapted to be applicable to the ARIMA model with missing observations. The paper investigates ways to calculate robust initial estimation of the parameters of the ARIMA model. The method proposed is based on the results obtained by R.D. Martin (1980).     

Bayesian estimation of agent-based models

We consider Bayesian inference techniques for agent-based (AB) models, as an alternative to simulated minimum distance (SMD). Three computationally heavy steps are involved: (i) simulating the model, (ii) estimating the likelihood and (iii) sampling from the posterior distribution of the parameters. Computational complexity of AB models implies that efficient techniques have to be used with respect to points (ii) and (iii), possibly involving approximations. We first discuss non-parametric (kernel density) estimation of the likelihood, coupled with Markov chain Monte Carlo sampling schemes. We then turn to parametric approximations of the likelihood, which can be derived by observing the distribution of the simulation outcomes around the statistical equilibria, or by assuming a specific form for the distribution of external deviations in the data. Finally, we introduce Approximate Bayesian Computation techniques for likelihood-free estimation. These allow embedding SMD methods in a Bayesian framework, and are particularly suited when robust estimation is needed. These techniques are first tested in a simple price discovery model with one parameter, and then employed to estimate the behavioural macroeconomic model of De Grauwe (2012), with nine unknown parameters.     

Heteroskedasticity-consistent covariance matrix estimators for spatial autoregressive models

In the presence of heteroskedasticity, conventional test statistics based on the ordinary least squares (OLS) estimator lead to incorrect inference results for the linear regression model. Given that heteroskedasticity is common in cross-sectional data, the test statistics based on various forms of heteroskedasticity-consistent covariance matrices (HCCMs) have been developed in the literature. In contrast to the standard linear regression model, heteroskedasticity is a more serious problem for spatial econometric models, generally causing inconsistent extremum estimators of model coefficients. This paper investigates the finite sample properties of the heteroskedasticity-robust generalized method of moments estimator (RGMME) for a spatial econometric model with an unknown form of heteroskedasticity. In particular, it develops various HCCM-type corrections to improve the finite sample properties of the RGMME and the conventional Wald test. The Monte Carlo results indicate that the HCCM-type corrections can produce more accurate results for inference on model parameters and the impact effects estimates in small samples.     

Consistent maximum-likelihood estimation with dependent observations: The general (non-normal) case and the normal case

In this paper we aim to establish intuitively appealing and verifiable conditions for the existence and weak consistency of ML estimators in a multi-parameter framework, assuming neither the independence nor the identical distribution of the observations. The paper has two parts. In the first part (Theorems 1 and 2) we assume that the joint density of the observations is known (except for the values of a finite number of parameters to be estimated), but we do not specify this distribution. In the second part (Theorems 3–6), we do specify the distribution and assume joint normality (but not independence) of the observations. Some examples are also provided.     

On the efficient estimation methods for the macro-economic models nonlinear in variables

All the macro-economic models have the nonlinearity in variables within their simultaneous equations systems. I propose a full information estimation method for such models. The method is (i) asymptotically efficient, (ii) feasible in the contemporary computer technology as it consists of calculations very much like the nonlinear multipliers, and (iii) hopefully applicable to the undersized sample case which prevails in the macro-economic model building. Though two other methods are also investigated, one is found to be asymptotically inefficient, and another turns out to be inapplicable to the undersized sample case.     

Kernel estimation for disequilibrium models for floorspace efficiency in retailing

Conclusions In this paper we have proposed new techniques for simplifying the estimation of disequilibrium models by avoiding constrained maximum likelihood methods (which cannot avoid numerous theoretical and practical difficulties mentioned above) including an unrealistic assumption of the independence of errors in demand and supply system of equations. In the proposed first stage, one estimates the relative magnitude of the residuals from the demand and supply equations nonparametrically, even though they suffer from omitted variables bias, because the coefficient of the omitted variable is known to be the same in both equations. The reason for using nonparametric methods is that they do not depend on parametric functional forms of biased (bent inward) demand and supply equations. The first stage compares the absolute values of residuals from conditional expectations in order to classify the data points as belonging to the demand or the supply curve. We estimate the economically meaningful scale elasticity and distribution parameters at the second stage from classified (separated) data.We extend nonparametric kernel estimation to the r = 4 case to improve the speed of convergence, as predicted by Singh's [1981] theory. In the first stage, r = 4 results give generally improved R² and ¦t¦ values in our study of the Dutch data—used by many authors concerned with the estimation of floorspace productivity. We find that one can obtain reasonable results by our approximate but simpler two stage methods. Detailed results are reported for four types of Dutch retail establishments. More research is needed to gain further experience and to extend the methodology to other disequilibrium models and other productivity estimation problems.This paper was processed by W. Eichhorn.     

Instrumental variable estimation of nonseparable models

There are many environments where knowledge of a structural relationship is required to answer questions of interest. Also, nonseparability of a structural disturbance is a key feature of many models. Here, we consider nonparametric identification and estimation of a model that is monotonic in a nonseparable scalar disturbance, which disturbance is independent of instruments. This model leads to conditional quantile restrictions. We give local identification conditions for the structural equations from those quantile restrictions. We find that a modified completeness condition is sufficient for local identification. We also consider estimation via a nonparametric minimum distance estimator. The estimator minimizes the sum of squares of predicted values from a nonparametric regression of the quantile residual on the instruments. We show consistency of this estimator.