Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps

Green and Hollifield (1992) argue that the presence of a dominant factor would result in extreme negative weights in mean‐variance efficient portfolios even in the absence of estimation errors. In that case, imposing no‐short‐sale constraints should hurt, whereas empirical evidence is often to the contrary. We reconcile this apparent contradiction. We explain why constraining portfolio weights to be nonnegative can reduce the risk in estimated optimal portfolios even when the constraints are wrong. Surprisingly, with no‐short‐sale constraints in place, the sample covariance matrix performs as well as covariance matrix estimates based on factor models, shrinkage estimators, and daily data.     

Size matters: Optimal calibration of shrinkage estimators for portfolio selection

We carry out a comprehensive investigation of shrinkage estimators for asset allocation, and we find that size matters—the shrinkage intensity plays a significant role in the performance of the resulting estimated optimal portfolios. We study both portfolios computed from shrinkage estimators of the moments of asset returns (shrinkage moments), as well as shrinkage portfolios obtained by shrinking the portfolio weights directly. We make several contributions in this field. First, we propose two novel calibration criteria for the vector of means and the inverse covariance matrix. Second, for the covariance matrix we propose a novel calibration criterion that takes the condition number optimally into account. Third, for shrinkage portfolios we study two novel calibration criteria. Fourth, we propose a simple multivariate smoothed bootstrap approach to construct the optimal shrinkage intensity. Finally, we carry out an extensive out-of-sample analysis with simulated and empirical datasets, and we characterize the performance of the different shrinkage estimators for portfolio selection.     

Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix

The estimation of the inverse covariance matrix plays a crucial role in optimal portfolio choice. We propose a new estimation framework that focuses on enhancing portfolio performance. The framework applies the statistical methodology of shrinkage directly to the inverse covariance matrix using two non-parametric methods. The first minimises the out-of-sample portfolio variance while the second aims to increase out-of-sample risk-adjusted returns. We apply the resulting estimators to compute the minimum variance portfolio weights and obtain a set of new portfolio strategies. These strategies have an intuitive form which allows us to extend our framework to account for short-sale constraints, transaction costs and singular covariance matrices. A comparative empirical analysis against several strategies from the literature shows that the new strategies often offer higher risk-adjusted returns and lower levels of risk.     

Estimation error in the average correlation of security returns and shrinkage estimation of covariance and correlation matrices

The correlation matrix of security returns is an important input component for mean–variance portfolio analysis. This study uses the average of sample correlations to estimate the correlation matrix and derives an expression of its estimation error in terms of sampling variance. This study then considers the impact of such estimation error on shrinkage estimation, where a weighted average is sought between the sample covariance matrix and an average correlation target, and between the sample correlation matrix and the target. An illustrative example using monthly returns of the current Dow Jones stocks is provided.     

When do improved covariance matrix estimators enhance portfolio optimization? An empirical comparative study of nine estimators

The use of improved covariance matrix estimators as an alternative to the sample estimator is considered an important approach for enhancing portfolio optimization. Here we empirically compare the performance of nine improved covariance estimation procedures using daily returns of 90 highly capitalized US stocks for the period 1997–2007. We find that the usefulness of covariance matrix estimators strongly depends on the ratio between the estimation period T and the number of stocks N, on the presence or absence of short selling, and on the performance metric considered. When short selling is allowed, several estimation methods achieve a realized risk that is significantly smaller than that obtained with the sample covariance method. This is particularly true when T/N is close to one. Moreover, many estimators reduce the fraction of negative portfolio weights, while little improvement is achieved in the degree of diversification. On the contrary, when short selling is not allowed and T?>?N, the considered methods are unable to outperform the sample covariance in terms of realized risk, but can give much more diversified portfolios than that obtained with the sample covariance. When T?<?N, the use of the sample covariance matrix and of the pseudo-inverse gives portfolios with very poor performance.     

Covariance complexity and rates of return on assets

This paper considers the estimation of the expected rate of return on a set of risky assets. The approach to estimation focuses on the covariance matrix for the returns. The structure in the covariance matrix determines shared information which is useful in estimating the mean return for each asset. An empirical Bayes estimator is developed using the covariance structure of the returns distribution. The estimator is an improvement on the maximum likelihood and Bayes–Stein estimators in terms of mean squared error. The effect of reduced estimation error on accumulated wealth is analyzed for the portfolio choice model with constant relative risk aversion utility.     

Dominance of a Class of Stein type Estimators for Optimal Portfolio Weights When the Covariance Matrix is Unknown

For the estimation problem of mean-variance optimal portfolio weights, several previous studies have proposed applying Stein type estimators. However, few studies have addressed this problem analytically. Since the form of the loss function used in this problem is not of the quadratic type commonly used in statistical studies, there have been some difficulties in showing analytically the general dominance results. However, dominance results are given here of a class of Stein type estimators for the mean-variance optimal portfolio weights when the covariance matrix is unknown and is estimated. The class of estimators is broader than the one given in a previous study. The results we have obtained enable us to clarify conditions for some previously proposed estimators in finance to have smaller risks than the estimator which we obtain by plugging in the sample estimates.     

Improved estimation of the covariance matrix of stock returns with an application to portfolio selection

This paper proposes to estimate the covariance matrix of stock returns by an optimally weighted average of two existing estimators: the sample covariance matrix and single-index covariance matrix. This method is generally known as shrinkage, and it is standard in decision theory and in empirical Bayesian statistics. Our shrinkage estimator can be seen as a way to account for extra-market covariance without having to specify an arbitrary multifactor structure. For NYSE and AMEX stock returns from 1972 to 1995, it can be used to select portfolios with significantly lower out-of-sample variance than a set of existing estimators, including multifactor models.     

Portfolio analysis of intraday covariance matrix in the Greek equity market

The intraday nonparametric estimation of the variance–covariance matrix adds to the literature in portfolio analysis of the Greek equity market. This paper examines the economic value of various realized volatility and covariance estimators under the strategy of volatility timing. I use three types of portfolios: Global Minimum Variance, Capital Market Line and Capital Market Line with only positive weights. The estimators of volatilities and covariances use 5-min high-frequency intraday data. The dataset concerns the FTSE/ATHEX Large Cap index, FTSE/ATHEX Mid Cap index, and the FTSE/ATHEX Small Cap index of the Greek equity market (Athens Stock Exchange). As far as I know, this is the first work of its kind for the Greek equity market. Results concern not only the comparison of various estimators but also the comparison of different types of portfolios, in the strategy of volatility timing. The economic value of the contemporary non-parametric realized volatility estimators is more significant than this when the covariance is estimated by the daily squared returns. Moreover, the economic value (in b.p.s) of each estimator changes with the volatility timing.     

Smooth monotone covariance for elliptical distributions and applications in finance

Sample covariance is known to be a poor estimate when the data are scarce compared with the dimension. To reduce the estimation error, various structures are usually imposed on the covariance such as low-rank plus diagonal (factor models), banded models and sparse inverse covariances. We investigate a different non-parametric regularization method which assumes that the covariance is monotone and smooth. We study the smooth monotone covariance by analysing its performance in reducing various statistical distances and improving optimal portfolio selection. We also extend its use in non-Gaussian cases by incorporating various robust covariance estimates for elliptical distributions. Finally, we provide two empirical examples using Eurodollar futures and corporate bonds where the smooth monotone covariance improves the out-of-sample covariance prediction and portfolio optimization.     

Multivariate Shrinkage for Optimal Portfolio Weights

Abstract

This paper proposes a multivariate shrinkage estimator for the optimal portfolio weights. The estimated classical Markowitz weights are shrunk to the deterministic target portfolio weights. Assuming log asset returns to be i.i.d. Gaussian, explicit solutions are derived for the optimal shrinkage factors. The properties of the estimated shrinkage weights are investigated both analytically and using Monte Carlo simulations. The empirical study compares the competing portfolio selection approaches. Both simulation and empirical studies show that the proposed shrinkage estimator is robust and provides significant gains to the investor compared to benchmark procedures.     

Predictive regression: An improved augmented regression method

This paper proposes three modifications to the augmented regression method (ARM) for bias-reduced estimation and statistical inference in the predictive regression. They are in relation to improved bias-correction, stationarity-correction, and the use of matrix formulae for bias-correction and covariance matrix estimation. The improved ARM parameter estimators are unbiased to the order of n^− 1, and always satisfy the condition of stationarity. With the matrix formulae, the improved ARM can easily be implemented for a high order model with multiple predictors. From an extensive Monte Carlo experiment, it is found that the improved ARM delivers substantial gain in parameter estimation, statistical inference, and out-of-sample forecasting in small samples. As an application, the improved ARM is applied to monthly US stock return data to evaluate the predictive power of dividend yield in univariate and bivariate predictive models.     

Risk Reduction and Mean-Variance Analysis: An Empirical Investigation

Abstract:  I examine the performance of global minimum variance (GMV) and minimum tracking error variance (TEV) portfolios in UK stock returns using different models of the covariance matrix. I find that both GMV and TEV portfolios deliver portfolio risk reduction benefits in terms of significantly lower volatility and tracking error volatility relative to passive benchmarks for every model of the covariance matrix used. However, the GMV (TEV) portfolios do not provide significantly superior Sharpe (1966) (adjusted Sharpe) performance relative to passive benchmarks except for the restricted GMV portfolios. I find that a number of alternative covariance matrix models can improve the performance of the restricted TEV portfolio formed using the sample covariance matrix but not the restricted GMV portfolio. I also find that simpler covariance matrix models perform as well as the more sophisticated models.     

The Sampling Error in Estimates of Mean-Variance Efficient Portfolio Weights

This paper presents an exact finite-sample statistical procedure for testing hypotheses about the weights of mean-variance efficient portfolios. The estimation and inference procedures on efficient portfolio weights are performed in the same way as for the coefficients in an OLS regression. OLS t - and F -statistics can be used for tests on efficient weights, and when returns are multivariate normal, these statistics have exact t and F distributions in a finite sample. Using 20 years of data on 11 country stock indexes, we find that the sampling error in estimates of the weights of a global efficient portfolio is large.     

Volatility and covariation of financial assets: A high-frequency analysis

Using high frequency data for the price dynamics of equities we measure the impact that market microstructure noise has on estimates of the: (i) volatility of returns; and (ii) variance–covariance matrix of n assets. We propose a Kalman-filter-based methodology that allows us to deconstruct price series into the true efficient price and the microstructure noise. This approach allows us to employ volatility estimators that achieve very low Root Mean Squared Errors (RMSEs) compared to other estimators that have been proposed to deal with market microstructure noise at high frequencies. Furthermore, this price series decomposition allows us to estimate the variance covariance matrix of n assets in a more efficient way than the methods so far proposed in the literature. We illustrate our results by calculating how microstructure noise affects portfolio decisions and calculations of the equity beta in a CAPM setting.     

Jump robust two time scale covariance estimation and realized volatility budgets

We estimate the daily integrated variance and covariance of stock returns using high-frequency data in the presence of jumps, market microstructure noise and non-synchronous trading. For this we propose jump robust two time scale (co)variance estimators and verify their reduced bias and mean square error in simulation studies. We use these estimators to construct the ex-post portfolio realized volatility (RV) budget, determining each portfolio component’s contribution to the RV of the portfolio return. These RV budgets provide insight into the risk concentration of a portfolio. Furthermore, the RV budgets can be directly used in a portfolio strategy, called the equal-risk-contribution allocation strategy. This yields both a higher average return and lower standard deviation out-of-sample than the equal-weight portfolio for the stocks in the Dow Jones Industrial Average over the period October 2007–May 2009.     

Estimating correlation and covariance matrices by weighting of market similarity

We discuss a weighted estimation of correlation and covariance matrices from historical financial data. To this end, we introduce a weighting scheme that accounts for the similarity of previous market conditions to the present situation. The resulting estimators are less biased and show lower variance than either unweighted or exponentially weighted estimators. The weighting scheme is based on a similarity measure that compares the current correlation structure of the market to the structures at past times. Similarity is then measured by the matrix 2-norm of the difference of probe correlation matrices estimated for two different points in time. The method is validated in a simulation study and tested empirically in the context of mean–variance portfolio optimization. In the latter case we find an enhanced realized portfolio return as well as a reduced portfolio risk compared with alternative approaches based on different strategies and estimators.     

Estimating a covariance matrix for market risk management and the case of credit default swaps

We analyze covariance matrix estimation from the perspective of market risk management, where the goal is to obtain accurate estimates of portfolio risk across essentially all portfolios—even those with small standard deviations. We propose a simple but effective visualisation tool to assess bias across a wide range of portfolios. We employ a portfolio perspective to determine covariance matrix loss functions particularly suitable for market risk management. Proper regularisation of the covariance matrix estimate significantly improves performance. These methods are applied to credit default swaps, for which covariance matrices are used to set portfolio margin requirements for central clearing. Among the methods we test, the graphical lasso estimator performs particularly well. The graphical lasso and a hierarchical clustering estimator also yield economically meaningful representations of market structure through a graphical model and a hierarchy, respectively.     

On the distribution and estimation of trading costs

This paper investigates the uncertainty about the trading costs associated with a given portfolio strategy. I derive accurate approximations of the ex ante probability distributions of proportional trading costs and portfolio turnover under the conventional assumption of normal asset returns. Based on these approximations, I express the expected trading costs as a function of asset and portfolio characteristics. All else equal, the expected trading costs increase with: i) the deviations of the expected asset returns from the expected portfolio return, ii) the assets' volatility and iii) the portfolio volatility. At the same time, they decrease with the covariance between the assets and the portfolio. Furthermore, I propose novel estimators of the expected turnover and trading costs and show that they offer small bias and low variance, even when the sample size is small. Finally, I incorporate my results into a portfolio selection framework to produce portfolios with low levels of risk and trading costs. Several experiments with real and simulated data confirm the practical value of the results.     

The 1/n Pension Investment Puzzle

Abstract

This paper examines the so-called 1/n investment puzzle that has been observed in defined contribution plans whereby some participants divide their contributions equally among the available asset classes. It has been argued that this is a very naive strategy since it contradicts the fundamental tenets of modern portfolio theory. We use simple arguments to show that this behavior is perhaps less naive than it at first appears. It is well known that the optimal portfolio weights in a mean-variance setting are extremely sensitive to estimation errors, especially those in the expected returns. We show that when we account for estimation error, the 1/n rule has some advantages in terms of robustness; we demonstrate this with numerical experiments. This rule can provide a risk-averse investor with protection against very bad outcomes.