Bayesian robust designs for linear models with possible bias and correlated errors

Consider the design problem for the approximately linear model with serially correlated errors. The correlated structure is the qth degree moving average process, MA(q), especially for q = 1, 2. The optimal design is derived by using Bayesian approach. The Bayesian designs derived with various priors are compared with the classical designs with respect to some specific correlated structures. The results show that any prior knowledge about the sign of the MA(q) process parameters leads to designs that are considerately more efficient than the classical ones based on homoscedastic assumptions.     

Money‐output Causality Revisited – A Bayesian Logistic Smooth Transition VECM Perspective*

This article proposes a Bayesian approach to examining money‐output causality within the context of a logistic smooth transition vector error correction model. Our empirical results provide substantial evidence that the postwar US money‐output relationship is nonlinear, with regime changes mainly governed by the output growth and price levels. Furthermore, we obtain strong support for nonlinear Granger causality from money to output, although there is also some evidence for models indicating that money is not Granger causal or long‐run causal to output.     

Bayesian Estimation of Prediction Error and Variable Selection in Linear Regression

An important statistical application is the problem of determining an appropriate set of input variables for modelling a response variable. In such an application, candidate models are characterized by which input variables are included in the mean structure. A reasonable approach to gauging the propriety of a candidate model is to define a discrepancy function through the prediction error associated with this model. An optimal set of input variables is then determined by searching for the candidate model that minimizes the prediction error. In this paper, we focus on a Bayesian approach to estimating a discrepancy function based on prediction error in linear regression. It is shown how this approach provides an informative method for quantifying model selection uncertainty.     

A Review of Modern Computational Algorithms for Bayesian Optimal Design

Bayesian experimental design is a fast growing area of research with many real‐world applications. As computational power has increased over the years, so has the development of simulation‐based design methods, which involve a number of algorithms, such as Markov chain Monte Carlo, sequential Monte Carlo and approximate Bayes methods, facilitating more complex design problems to be solved. The Bayesian framework provides a unified approach for incorporating prior information and/or uncertainties regarding the statistical model with a utility function which describes the experimental aims. In this paper, we provide a general overview on the concepts involved in Bayesian experimental design, and focus on describing some of the more commonly used Bayesian utility functions and methods for their estimation, as well as a number of algorithms that are used to search over the design space to find the Bayesian optimal design. We also discuss other computational strategies for further research in Bayesian optimal design.     

Hidden group patterns in democracy developments: Bayesian inference for grouped heterogeneity

We propose a nonparametric Bayesian approach to estimate time‐varying grouped patterns of heterogeneity in linear panel data models. Unlike the classical approach in Bonhomme and Manresa (Econometrica, 2015, 83, 1147–1184), our approach can accommodate selection of the optimal number of groups and model estimation jointly, and also be readily extended to quantify uncertainties in the estimated group structure. Our proposed approach performs well in Monte Carlo simulations. Using our approach, we successfully replicate the estimated relationship between income and democracy in Bonhomme and Manresa and the group characteristics when we use the same number of groups. Furthermore, we find that the optimal number of groups could depend on model specifications on heteroskedasticity and discuss ways to choose models in practice.     

Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination

In this paper, we examine the forecast accuracy of linear autoregressive, smooth transition autoregressive (STAR), and neural network (NN) time series models for 47 monthly macroeconomic variables of the G7 economies. Unlike previous studies that typically consider multiple but fixed model specifications, we use a single but dynamic specification for each model class. The point forecast results indicate that the STAR model generally outperforms linear autoregressive models. It also improves upon several fixed STAR models, demonstrating that careful specification of nonlinear time series models is of crucial importance. The results for neural network models are mixed in the sense that at long forecast horizons, an NN model obtained using Bayesian regularization produces more accurate forecasts than a corresponding model specified using the specific-to-general approach. Reasons for this outcome are discussed.     

A Study of Vertical Integration and Vertical Divestiture: The Case of Store Brand Milk Sourcing in Boston

This article investigates whether a retailer’s store brand supply source impacts vertical pricing and supply channel profitability. Using chain‐level retail scanner data, a random coefficients logit demand model is estimated employing a Bayesian estimation approach. Supply models are specified conditional on demand parameter estimates. Bayesian decision theory is applied to select the best fitting pricing model. Results indicate that a vertically integrated retailer engages in linear pricing for brand manufacturers’ products while competing retailers make nonlinear pricing contracts with brand manufacturers for branded products and store brands. A simulated vertical divestiture based on real world events provides evidence for improved channel efficiency.     

Optimal Adaptive Designs with Inverse Ordinary Differential Equations

Many industrial and engineering applications are built on the basis of differential equations. In some cases, parameters of these equations are not known and are estimated from measurements leading to an inverse problem. Unlike many other papers, we suggest to construct new designs in the adaptive fashion ‘on the go’ using the A‐optimality criterion. This approach is demonstrated on determination of optimal locations of measurements and temperature sensors in several engineering applications: (1) determination of the optimal location to measure the height of a hanging wire in order to estimate the sagging parameter with minimum variance (toy example), (2) adaptive determination of optimal locations of temperature sensors in a one‐dimensional inverse heat transfer problem and (3) adaptive design in the framework of a one‐dimensional diffusion problem when the solution is found numerically using the finite difference approach. In all these problems, statistical criteria for parameter identification and optimal design of experiments are applied. Statistical simulations confirm that estimates derived from the adaptive optimal design converge to the true parameter values with minimum sum of variances when the number of measurements increases. We deliberately chose technically uncomplicated industrial problems to transparently introduce principal ideas of statistical adaptive design.     

Simultaneous confidence bands: Theory,implementation, and an application to SVARs

Simultaneous confidence bands are versatile tools for visualizing estimation uncertainty for parameter vectors, such as impulse response functions. In linear models, it is known that that the sup‐t confidence band is narrower than commonly used alternatives—for example, Bonferroni and projection bands. We show that the same ranking applies asymptotically even in general nonlinear models, such as vector autoregressions (VARs). Moreover, we provide further justification for the sup‐t band by showing that it is the optimal default choice when the researcher does not know the audience's preferences. Complementing existing plug‐in and bootstrap implementations, we propose a computationally convenient Bayesian sup‐t band with exact finite‐sample simultaneous credibility. In an application to structural VAR impulse response function estimation, the sup‐t band—which has been surprisingly overlooked in this setting—is at least 35% narrower than other off‐the‐shelf simultaneous bands.     

D‐optimal designs for a continuous predictor in longitudinal trials with discrete‐time survival endpoints

In designing an experiment with one single, continuous predictor, the questions are composed of what is the optimal number of the predictor's values, what are these values, and how many subjects should be assigned to each of these values. In this study, locally D‐optimal designs for such experiments with discrete‐time event occurrence data are studied by using a sequential construction algorithm. Using the Weibull survival function for modeling the underlying time to event function, it is shown that the optimal designs for a linear effect of the predictor have two points that coincide with the design region's boundaries, but the design weights highly depend on the predictor effect size and its direction, the survival pattern, and the number of time points. For a quadratic effect of the predictor, three or four design points are needed.     

Bayesian Analysis of a Sensitive Proportion for a Small Area

Without accounting for sensitive items in sample surveys, sampled units may not respond (nonignorable nonresponse) or they respond untruthfully. There are several survey designs that address this problem and we will review some of them. In our study, we have binary data from clusters within small areas, obtained from a version of the unrelated‐question design, and the sensitive proportion is of interest for each area. A hierarchical Bayesian model is used to capture the variation in the observed binomial counts from the clusters within the small areas and to estimate the sensitive proportions for all areas. Both our example on college cheating and a simulation study show significant reductions in the posterior standard deviations of the sensitive proportions under the small‐area model as compared with an analogous individual‐area model. The simulation study also demonstrates that the estimates under the small‐area model are closer to the truth than for the corresponding estimates under the individual‐area model. Finally, for small areas, we discuss many extensions to accommodate covariates, finite population sampling, multiple sensitive items and optional designs.     

Forecasting realized volatility: a Bayesian model‐averaging approach

How to measure and model volatility is an important issue in finance. Recent research uses high‐frequency intraday data to construct ex post measures of daily volatility. This paper uses a Bayesian model‐averaging approach to forecast realized volatility. Candidate models include autoregressive and heterogeneous autoregressive specifications based on the logarithm of realized volatility, realized power variation, realized bipower variation, a jump and an asymmetric term. Applied to equity and exchange rate volatility over several forecast horizons, Bayesian model averaging provides very competitive density forecasts and modest improvements in point forecasts compared to benchmark models. We discuss the reasons for this, including the importance of using realized power variation as a predictor. Bayesian model averaging provides further improvements to density forecasts when we move away from linear models and average over specifications that allow for GARCH effects in the innovations to log‐volatility. Copyright © 2009 John Wiley & Sons, Ltd.     

R-optimal designs for multi-factor models with heteroscedastic errors

In this paper, we consider the R-optimal design problem for multi-factor regression models with heteroscedastic errors. It is shown that a R-optimal design for the heteroscedastic Kronecker product model is given by the product of the R-optimal designs for the marginal one-factor models. However, R-optimal designs for the additive models can be constructed from R-optimal designs for the one-factor models only if sufficient conditions are satisfied. Several examples are presented to illustrate and check optimal designs based on R-optimality criterion.     

Totally positive regression: E-optimal designs

E-optimality of approximate designs in linear regression models is paired with a dual problem of nonlinear Chebyshev approximation. When the regression functions form a totally positive system, then the information matrices of designs for subparameters turn out to be “almost” totally positive, a property which allows to solve the nonlinear Chebyshev problem. Thereby we obtain explicit formulae for E-optimal designs in terms of equi-oscillating generalized polynomials. The considerations unify and generalize known results on E-optimality for particular regression setups.     

Labor market entry and earnings dynamics: Bayesian inference using mixtures‐of‐experts Markov chain clustering

This paper analyzes patterns in the earnings development of young labor market entrants over their life cycle. We identify four distinctly different types of transition patterns between discrete earnings states in a large administrative dataset. Further, we investigate the effects of labor market conditions at the time of entry on the probability of belonging to each transition type. To estimate our statistical model we use a model‐based clustering approach. The statistical challenge in our application comes from the difficulty in extending distance‐based clustering approaches to the problem of identifying groups of similar time series in a panel of discrete‐valued time series. We use Markov chain clustering, which is an approach for clustering discrete‐valued time series obtained by observing a categorical variable with several states. This method is based on finite mixtures of first‐order time‐homogeneous Markov chain models. In order to analyze group membership we present an extension to this approach by formulating a probabilistic model for the latent group indicators within the Bayesian classification rule using a multinomial logit model. Copyright © 2011 John Wiley & Sons, Ltd.     

Modelling Hospital Admission and Length of Stay by Means of Generalised Count Data Models

For a large heterogeneous group of patients, we analyse probabilities of hospital admission and distributional properties of lengths of hospital stay conditional on individual determinants. Bayesian structured additive regression models for zero‐inflated and overdispersed count data are employed. In addition, the framework is extended towards hurdle specifications, providing an alternative approach to cover particularly large frequencies of zero quotes in count data. As a specific merit, the model class considered embeds linear and nonlinear effects of covariates on all distribution parameters. Linear effects indicate that the quantity and severity of prior illness are positively correlated with the risk of hospital admission, while medical prevention (in the form of general practice visits) and rehabilitation reduce the expected length of future hospital stays. Flexible nonlinear response patterns are diagnosed for age and an indicator of a patients' socioeconomic status. We find that social deprivation exhibits a positive impact on the risk of admission and a negative effect on the expected length of future hospital stays of admitted patients. Copyright © 2015 John Wiley & Sons, Ltd.     

A unified approach to nonlinearity,structural change,and outliers

This paper demonstrates that the class of conditionally linear and Gaussian state-space models offers a general and convenient framework for simultaneously handling nonlinearity, structural change and outliers in time series. Many popular nonlinear time series models, including threshold, smooth transition and Markov-switching models, can be written in state-space form. It is then straightforward to add components that capture parameter instability and intervention effects. We advocate a Bayesian approach to estimation and inference, using an efficient implementation of Markov Chain Monte Carlo sampling schemes for such linear dynamic mixture models. The general modelling framework and the Bayesian methodology are illustrated by means of several examples. An application to quarterly industrial production growth rates for the G7 countries demonstrates the empirical usefulness of the approach.     

The Optimality of Single-group Designs for Certain Mixed Models

In this paper optimal designs for the estimation of the fixed effects (population parameters) in a certain class of mixed models are investigated. Two classes of designs are compared: the class of single-group designs, where all individuals are observed under the same approximate design, and the class of more-group designs with the same mean number of observations per individual as before, where each individual can be observed under a different approximate design. It is shown that any design that is Φ-optimal in the class of single-group designs is also Φ-optimal in the larger class of more-group designs. The considered optimality criteria only have to satisfy mild assumptions, which is eg the case for the D-criterion and all linear criteria.     

Optimal Designs for Asymmetric Linear Paired Comparisons with a Profile Strength Constraint

Within the linear model framework the problem of determining optimal designs for paired comparisons of alternatives which are described by a set of discrete attributes is considered under the constraint that the alternatives in a pair are only allowed to differ with regard to a certain number of attributes. Whereas in previous treatments of this problem it was assumed that all attributes possess the same number of levels, here the general asymmetric case is discussed. We provide a characterization of optimal designs and demonstrate how this can be used to derive a solution of the design problem for many situations of interest.     

Semi‐parametric Regression under Model Uncertainty: Economic Applications

Economic theory does not always specify the functional relationship between dependent and explanatory variables, or even isolate a particular set of covariates. This means that model uncertainty is pervasive in empirical economics. In this paper, we indicate how Bayesian semi‐parametric regression methods in combination with stochastic search variable selection can be used to address two model uncertainties simultaneously: (i) the uncertainty with respect to the variables which should be included in the model and (ii) the uncertainty with respect to the functional form of their effects. The presented approach enables the simultaneous identification of robust linear and nonlinear effects. The additional insights gained are illustrated on applications in empirical economics, namely willingness to pay for housing, and cross‐country growth regression.