Pre-averaging estimators of the ex-post covariance matrix in noisy diffusion models with non-synchronous data

We show how pre-averaging can be applied to the problem of measuring the ex-post covariance of financial asset returns under microstructure noise and non-synchronous trading. A pre-averaged realised covariance is proposed, and we present an asymptotic theory for this new estimator, which can be configured to possess an optimal convergence rate or to ensure positive semi-definite covariance matrix estimates. We also derive a noise-robust Hayashi–Yoshida estimator that can be implemented on the original data without prior alignment of prices. We uncover the finite sample properties of our estimators with simulations and illustrate their practical use on high-frequency equity data.     

Covariance measurement in the presence of non-synchronous trading and market microstructure noise

This paper studies the problem of covariance estimation when prices are observed non-synchronously and contaminated by i.i.d. microstructure noise. We derive closed form expressions for the bias and variance of three popular covariance estimators, namely realised covariance, realised covariance plus lead and lag adjustments, and the Hayashi and Yoshida estimator, and present a comprehensive investigation into their properties and relative efficiency. Our main finding is that the ordering of the covariance estimators in terms of efficiency crucially depends on the level of microstructure noise, as well as the level of correlation. In fact, for sufficiently high levels of noise, the standard realised covariance estimator (without any corrections for non-synchronous trading) can be most efficient. We also propose a sparse sampling implementation of the Hayashi and Yoshida estimator, study the robustness of our findings using simulations with stochastic volatility and correlation, and highlight some important practical considerations.     

Uncertainty Estimation for Pseudo‐Bayesian Inference Under Complex Sampling

Social and economic studies are often implemented as complex survey designs. For example, multistage, unequal probability sampling designs utilised by federal statistical agencies are typically constructed to maximise the efficiency of the target domain level estimator (e.g. indexed by geographic area) within cost constraints for survey administration. Such designs may induce dependence between the sampled units; for example, with employment of a sampling step that selects geographically indexed clusters of units. A sampling‐weighted pseudo‐posterior distribution may be used to estimate the population model on the observed sample. The dependence induced between coclustered units inflates the scale of the resulting pseudo‐posterior covariance matrix that has been shown to induce under coverage of the credibility sets. By bridging results across Bayesian model misspecification and survey sampling, we demonstrate that the scale and shape of the asymptotic distributions are different between each of the pseudo‐maximum likelihood estimate (MLE), the pseudo‐posterior and the MLE under simple random sampling. Through insights from survey‐sampling variance estimation and recent advances in computational methods, we devise a correction applied as a simple and fast postprocessing step to Markov chain Monte Carlo draws of the pseudo‐posterior distribution. This adjustment projects the pseudo‐posterior covariance matrix such that the nominal coverage is approximately achieved. We make an application to the National Survey on Drug Use and Health as a motivating example and we demonstrate the efficacy of our scale and shape projection procedure on synthetic data on several common archetypes of survey designs.     

Efficient estimation of factor models with time and cross‐sectional dependence

This paper studies the efficient estimation of large‐dimensional factor models with both time and cross‐sectional dependence assuming (N,T) separability of the covariance matrix. The asymptotic distribution of the estimator of the factor and factor‐loading space under factor stationarity is derived and compared to that of the principal component (PC) estimator. The paper also considers the case when factors exhibit a unit root. We provide feasible estimators and show in a simulation study that they are more efficient than the PC estimator in finite samples. In application, the estimation procedure is employed to estimate the Lee–Carter model and life expectancy is forecast. The Dutch gender gap is explored and the relationship between life expectancy and the level of economic development is examined in a cross‐country comparison.     

Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties

We examine several modified versions of the heteroskedasticity-consistent covariance matrix estimator of Hinkley (1977) and White (1980). On the basis of sampling experiments which compare the performance of quasi t-statistics, we find that one estimator, based on the jackknife, performs better in small samples than the rest. We also examine the finite-sample properties of using modified critical values based on Edgeworth approximations, as proposed by Rothenberg (1984). In addition, we compare the power of several tests for heteroskedasticity, and find that it may be wise to employ the jackknife heteroskedasticity-consistent covariance matrix even in the absence of detected heteroskedasticity.     

Do High‐Frequency Data Improve High‐Dimensional Portfolio Allocations?

This paper addresses the debate about the usefulness of high‐frequency (HF) data in large‐scale portfolio allocation. We construct global minimum variance portfolios based on the constituents of the S&P 500. HF‐based covariance matrix predictions are obtained by applying a blocked realized kernel estimator, different smoothing windows, various regularization methods and two forecasting models. We show that HF‐based predictions yield a significantly lower portfolio volatility than methods employing daily returns. Particularly during the 2008 financial crisis, these performance gains hold over longer horizons than previous studies have shown, translating into substantial utility gains for an investor with pronounced risk aversion. Copyright © 2013 John Wiley & Sons, Ltd.     

High dimensional covariance matrix estimation using a factor model

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality p$p$ tends to ∞$\infty$ as the sample size n$n$ increases. Motivated by the Arbitrage Pricing Theory in finance, a multi-factor model is employed to reduce dimensionality and to estimate the covariance matrix. The factors are observable and the number of factors K$K$ is allowed to grow with p$p$. We investigate the impact of p$p$ and K$K$ on the performance of the model-based covariance matrix estimator. Under mild assumptions, we have established convergence rates and asymptotic normality of the model-based estimator. Its performance is compared with that of the sample covariance matrix. We identify situations under which the factor approach increases performance substantially or marginally. The impacts of covariance matrix estimation on optimal portfolio allocation and portfolio risk assessment are studied. The asymptotic results are supported by a thorough simulation study.     

Estimation of spot volatility with superposed noisy data

By using high frequency financial data, we nonparametrically estimate the spot volatility at any given time point, while the simultaneous presence of multiple transactions and market microstructure noise in the observation procedure are considered. Our estimator is based on the summation of the locally ranged increments, while kernel smoothing give us spot volatility. Besides, the microstructure noise can be estimated and removed, if it is modeled as bid-ask spread, which is a frequently used assumption. The consistency and asymptotic normality of the estimator are established. We do some simulation studies to assess the finite sample performance of our estimator. The estimator is also applied to some real data sets, further, the relationship between multiple records and spot volatility is also explored.     

Spatiotemporal wind forecasting by learning a hierarchically sparse inverse covariance matrix using wind directions

Given the advances in online data acquisition systems, statistical learning models are increasingly used to forecast wind speed. In electricity markets, wind farm production forecasts are needed for the day-ahead, intra-day, and real-time markets. In this work, we use a spatiotemporal model that leverages wind dynamics to forecast wind speed. Using a priori knowledge of the wind direction, we propose a maximum likelihood estimate of the inverse covariance matrix regularized with a hierarchical sparsity-inducing penalty. The resulting inverse covariance estimate not only exhibits the benefits of a sparse estimator, but also enables meaningful sparse structures by considering wind direction. A proximal method is used to solve the underlying optimization problem. The proposed methodology is used to forecast six-hour-ahead wind speeds in 20-minute time intervals for a case study in Texas. We compare our method with a number of other statistical methods. Prediction performance measures and the Diebold–Mariano test show the potential of the proposed method, specifically when reasonably accurate estimates of the wind directions are available.     

Semiparametric maximum likelihood estimation in Cox proportional hazards model with covariate measurement errors

This paper studies semiparametric maximum likelihood estimators in the Cox proportional hazards model with covariate error, assuming that the conditional distribution of the true covariate given the surrogate is known. We show that the estimator of the regression coefficient is asymptotically normal and efficient, its covariance matrix can be estimated consistently by differentiation of the profile likelihood, and the likelihood ratio test is asymptotically chi-squared. We also provide efficient algorithms for the computations of the semiparametric maximum likelihood estimate and the profile likelihood. The performance of this method is successfully demonstrated in simulation studies.     

HAC estimation in a spatial framework

We suggest a non-parametric heteroscedasticity and autocorrelation consistent (HAC) estimator of the variance–covariance (VC) matrix for a vector of sample moments within a spatial context. We demonstrate consistency under a set of assumptions that should be satisfied by a wide class of spatial models. We allow for more than one measure of distance, each of which may be measured with error. Monte Carlo results suggest that our estimator is reasonable in finite samples. We then consider a spatial model containing various complexities and demonstrate that our HAC estimator can be applied in the context of that model.     

Two estimators of the long-run variance: Beyond short memory

This paper deals with the estimation of the long-run variance of a stationary sequence. We extend the usual Bartlett-kernel heteroskedasticity and autocorrelation consistent (HAC) estimator to deal with long memory and antipersistence. We then derive asymptotic expansions for this estimator and the memory and autocorrelation consistent (MAC) estimator introduced by Robinson [Robinson, P. M., 2005. Robust covariance matrix estimation: HAC estimates with long memory/antipersistence correction. Econometric Theory 21, 171–180]. We offer a theoretical explanation for the sensitivity of HAC to the bandwidth choice, a feature which has been observed in the special case of short memory. Using these analytical results, we determine the MSE-optimal bandwidth rates for each estimator. We analyze by simulations the finite-sample performance of HAC and MAC estimators, and the coverage probabilities for the studentized sample mean, giving practical recommendations for the choice of bandwidths.     

GMM estimation of a maximum entropy distribution with interval data

We develop a generalized method of moments (GMM) estimator for the distribution of a variable where summary statistics are available only for intervals of the random variable. Without individual data, one cannot calculate the weighting matrix for the GMM estimator. Instead, we propose a simulated weighting matrix based on a first-step consistent estimate. When the functional form of the underlying distribution is unknown, we estimate it using a simple yet flexible maximum entropy density. Our Monte Carlo simulations show that the proposed maximum entropy density is able to approximate various distributions extremely well. The two-step GMM estimator with a simulated weighting matrix improves the efficiency of the one-step GMM considerably. We use this method to estimate the U.S. income distribution and compare these results with those based on the underlying raw income data.     

Estimation of linear models with crossed-error structure

Sufficient conditions are presented under which the generalized least-squares estimator, with estimated covariance matrix, is unbiased for the parameters in the crossed-error model and has the same asymptotic distribution as the generalized least-squares estimator. The model permits the presence of independent variables that are constant over cross sections or time periods. The model does not require that the variance components associated with cross sections or time periods be positive.     

Fitting dynamic factor models to non-stationary time series

Factor modelling of a large time series panel has widely proven useful to reduce its cross-sectional dimensionality. This is done by explaining common co-movements in the panel through the existence of a small number of common components, up to some idiosyncratic behaviour of each individual series. To capture serial correlation in the common components, a dynamic structure is used as in traditional (uni- or multivariate) time series analysis of second order structure, i.e. allowing for infinite-length filtering of the factors via dynamic loadings. In this paper, motivated from economic data observed over long time periods which show smooth transitions over time in their covariance structure, we allow the dynamic structure of the factor model to be non-stationary over time by proposing a deterministic time variation of its loadings. In this respect we generalize the existing recent work on static factor models with time-varying loadings as well as the classical, i.e. stationary, dynamic approximate factor model. Motivated from the stationary case, we estimate the common components of our dynamic factor model by the eigenvectors of a consistent estimator of the now time-varying spectral density matrix of the underlying data-generating process. This can be seen as a time-varying principal components approach in the frequency domain. We derive consistency of this estimator in a “double-asymptotic” framework of both cross-section and time dimension tending to infinity. The performance of the estimators is illustrated by a simulation study and an application to a macroeconomic data set.     

Asymptotics of the principal components estimator of large factor models with weakly influential factors

This paper introduces a drifting-parameter asymptotic framework to derive accurate approximations to the finite sample distribution of the principal components (PC) estimator in situations when the factors’ explanatory power does not strongly dominate the explanatory power of the cross-sectionally and temporally correlated idiosyncratic terms. Under our asymptotics, the PC estimator is inconsistent. We find explicit formulae for the amount of the inconsistency, and propose an estimator of the number of factors for which the PC estimator works reasonably well. For the special case when the idiosyncratic terms are cross-sectionally but not temporally correlated (or vice versa), we show that the coefficients in the OLS regressions of the PC estimates of factors (loadings) on the true factors (true loadings) are asymptotically normal, and find explicit formulae for the corresponding asymptotic covariance matrix. We explain how to estimate the parameters of the derived asymptotic distributions. Our Monte Carlo analysis suggests that our asymptotic formulae and estimators work well even for relatively small n$n$ and T$T$. We apply our theoretical results to test a hypothesis about the factor content of the US stock return data.     

Estimation of the trace of the scaled covariance matrix of a multivariate t-model using a known information

The trace of the scaled covariance matrix of the multivariate t-distribution is considered for estimation using a power transformation. The proposed estimator always dominates the usual maximum likelihood estimator in the sense of having smaller risk under a quadratic loss function. The dominance behaviour is proved analytically as well as computationally by using Monte-Carlo simulation.     

Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood

The paper discusses the asymptotic validity of posterior inference of pseudo‐Bayesian quantile regression methods with complete or censored data when an asymmetric Laplace likelihood is used. The asymmetric Laplace likelihood has a special place in the Bayesian quantile regression framework because the usual quantile regression estimator can be derived as the maximum likelihood estimator under such a model, and this working likelihood enables highly efficient Markov chain Monte Carlo algorithms for posterior sampling. However, it seems to be under‐recognised that the stationary distribution for the resulting posterior does not provide valid posterior inference directly. We demonstrate that a simple adjustment to the covariance matrix of the posterior chain leads to asymptotically valid posterior inference. Our simulation results confirm that the posterior inference, when appropriately adjusted, is an attractive alternative to other asymptotic approximations in quantile regression, especially in the presence of censored data.     

Dynamics of state price densities

State price densities (SPDs) are an important element in applied quantitative finance. In a Black–Scholes world they are lognormal distributions, but in practice volatility changes and the distribution deviates from log-normality. In order to study the degree of this deviation, we estimate SPDs using EUREX option data on the DAX index via a nonparametric estimator of the second derivative of the (European) call pricing function. The estimator is constrained so as to satisfy no-arbitrage constraints and corrects for the intraday covariance structure in option prices. In contrast to existing methods, we do not use any parametric or smoothness assumptions.     

Asymptotic properties of estimators for the volume fractions of jointly stationary random sets

In the present paper, we show how a consistent estimator can be derived for the asymptotic covariance matrix of stationary 0–1-valued vector fields in R ^d , whose supports are jointly stationary random closed sets. As an example, which is of particular interest for statistical applications, we consider jointly stationary random closed sets associated with the Boolean model in R ^d such that the components indicate the frequency of coverage by the single grains of the Boolean model. For this model, a representation formula for the entries of the covariance matrix is obtained.