Semiparametric analysis of clustered survival data under nonparametric frailty

In this article a novel approach to analyze clustered survival data that are subject to extravariation encountered through clustering of survival times is proposed. This is accomplished by extending the Cox proportional hazard model to a frailty model where the cluster-specific shared frailty is modeled nonparametrically. We assume a nonparametric Dirichlet process for the distribution of frailty. In such a semiparametric setup, we propose a hybrid method to draw model-based inferences. In the framework of the proposed hybrid method, the estimation of parameters is performed by implementing Monte Carlo expected conditional maximization algorithm. A simulation study is conducted to study the efficiency of our methodology. The proposed methodology is, thereafter, illustrated by a real-life data on recurrence time to infections in kidney patient.     

Additive cubic spline regression with Dirichlet process mixture errors

The goal of this article is to develop a flexible Bayesian analysis of regression models for continuous and categorical outcomes. In the models we study, covariate (or regression) effects are modeled additively by cubic splines, and the error distribution (that of the latent outcomes in the case of categorical data) is modeled as a Dirichlet process mixture. We employ a relatively unexplored but attractive basis in which the spline coefficients are the unknown function ordinates at the knots. We exploit this feature to develop a proper prior distribution on the coefficients that involves the first and second differences of the ordinates, quantities about which one may have prior knowledge. We also discuss the problem of comparing models with different numbers of knots or different error distributions through marginal likelihoods and Bayes factors which are computed within the framework of Chib (1995) as extended to DPM models by Basu and Chib (2003). The techniques are illustrated with simulated and real data.     

On model selection in Bayesian regression

We discuss the problem of constructing a suitable regression model from a nonparametric Bayesian viewpoint. For this purpose, we consider the case when the error terms have symmetric and unimodal densities. By the Khintchine and Shepp theorem, the density of response variable can be written as a scale mixture of uniform densities. The mixing distribution is assumed to have a Dirichlet process prior. We further consider appropriate prior distributions for other parameters as the components of the predictive device. Among the possible submodels, we select the one which has the highest posterior probability. An example is given to illustrate the approach.     

Bayesian semiparametric stochastic volatility modeling

This paper extends the existing fully parametric Bayesian literature on stochastic volatility to allow for more general return distributions. Instead of specifying a particular distribution for the return innovation, nonparametric Bayesian methods are used to flexibly model the skewness and kurtosis of the distribution while the dynamics of volatility continue to be modeled with a parametric structure. Our semiparametric Bayesian approach provides a full characterization of parametric and distributional uncertainty. A Markov chain Monte Carlo sampling approach to estimation is presented with theoretical and computational issues for simulation from the posterior predictive distributions. An empirical example compares the new model to standard parametric stochastic volatility models.     

Bayesian semiparametric multivariate GARCH modeling

This paper proposes a Bayesian nonparametric modeling approach for the return distribution in multivariate GARCH models. In contrast to the parametric literature the return distribution can display general forms of asymmetry and thick tails. An infinite mixture of multivariate normals is given a flexible Dirichlet process prior. The GARCH functional form enters into each of the components of this mixture. We discuss conjugate methods that allow for scale mixtures and nonconjugate methods which provide mixing over both the location and scale of the normal components. MCMC methods are introduced for posterior simulation and computation of the predictive density. Bayes factors and density forecasts with comparisons to GARCH models with Student-t$t$ innovations demonstrate the gains from our flexible modeling approach.     

Semi- and Non-parametric Bayesian Analysis of Duration Models with Dirichlet Priors: A Survey

The object of this paper is to review the main results obtained in semi- and non-parametric Bayesian analysis of duration models. Standard nonparametric Bayesian models for independent and identically distributed observations are reviewed in line with Ferguson's pioneering papers. Recent results on the characterization of Dirichlet processes and on nonparametric treatment of censoring and of heterogeneity in the context of mixtures of Dirichlet processes are also discussed. The final section considers a Bayesian semiparametric version of the proportional hazards model.     

Improving forecasting performance using covariate-dependent copula models

Copulas provide an attractive approach to the construction of multivariate distributions with flexible marginal distributions and different forms of dependences. Of particular importance in many areas is the possibility of forecasting the tail-dependences explicitly. Most of the available approaches are only able to estimate tail-dependences and correlations via nuisance parameters, and cannot be used for either interpretation or forecasting. We propose a general Bayesian approach for modeling and forecasting tail-dependences and correlations as explicit functions of covariates, with the aim of improving the copula forecasting performance. The proposed covariate-dependent copula model also allows for Bayesian variable selection from among the covariates of the marginal models, as well as the copula density. The copulas that we study include the Joe-Clayton copula, the Clayton copula, the Gumbel copula and the Student’s $t$-copula. Posterior inference is carried out using an efficient MCMC simulation method. Our approach is applied to both simulated data and the S&P 100 and S&P 600 stock indices. The forecasting performance of the proposed approach is compared with those of other modeling strategies based on log predictive scores. A value-at-risk evaluation is also performed for the model comparisons.     

Beta-product dependent Pitman–Yor processes for Bayesian inference

Multiple time series data may exhibit clustering over time and the clustering effect may change across different series. This paper is motivated by the Bayesian non-parametric modelling of the dependence between clustering effects in multiple time series analysis. We follow a Dirichlet process mixture approach and define a new class of multivariate dependent Pitman–Yor processes (DPY). The proposed DPY are represented in terms of vectors of stick-breaking processes which determine dependent clustering structures in the time series. We follow a hierarchical specification of the DPY base measure to account for various degrees of information pooling across the series. We discuss some theoretical properties of the DPY and use them to define Bayesian non-parametric repeated measurement and vector autoregressive models. We provide efficient Monte Carlo Markov Chain algorithms for posterior computation of the proposed models and illustrate the effectiveness of the method with a simulation study and an application to the United States and the European Union business cycle.     

On the structure and estimation of hierarchical Archimedean copulas

In this paper we provide a method for estimating multivariate distributions defined through hierarchical Archimedean copulas. In general, the true structure of the hierarchy is unknown, but we develop a computationally efficient technique to determine it from the data. For this purpose we introduce a hierarchical estimation procedure for the parameters and provide an asymptotic analysis. We consider both parametric and nonparametric estimation of the marginal distributions. A simulation study and an empirical application show the effectiveness of the grouping procedure in the sense of structure selection.     

A Bayesian mixed logit–probit model for multinomial choice

In this paper, we introduce a new flexible mixed model for multinomial discrete choice where the key individual- and alternative-specific parameters of interest are allowed to follow an assumption-free nonparametric density specification, while other alternative-specific coefficients are assumed to be drawn from a multivariate Normal distribution, which eliminates the independence of irrelevant alternatives assumption at the individual level. A hierarchical specification of our model allows us to break down a complex data structure into a set of submodels with the desired features that are naturally assembled in the original system. We estimate the model, using a Bayesian Markov Chain Monte Carlo technique with a multivariate Dirichlet Process (DP) prior on the coefficients with nonparametrically estimated density. We employ a “latent class” sampling algorithm, which is applicable to a general class of models, including non-conjugate DP base priors. The model is applied to supermarket choices of a panel of Houston households whose shopping behavior was observed over a 24-month period in years 2004–2005. We estimate the nonparametric density of two key variables of interest: the price of a basket of goods based on scanner data, and driving distance to the supermarket based on their respective locations. Our semi-parametric approach allows us to identify a complex multi-modal preference distribution, which distinguishes between inframarginal consumers and consumers who strongly value either lower prices or shopping convenience.     

Computing marginal likelihoods from a single MCMC output

In this article, we propose new Monte Carlo methods for computing a single marginal likelihood or several marginal likelihoods for the purpose of Bayesian model comparisons. The methods are motivated by Bayesian variable selection, in which the marginal likelihoods for all subset variable models are required to compute. The proposed estimates use only a single Markov chain Monte Carlo (MCMC) output from the joint posterior distribution and it does not require the specific structure or the form of the MCMC sampling algorithm that is used to generate the MCMC sample to be known. The theoretical properties of the proposed method are examined in detail. The applicability and usefulness of the proposed method are demonstrated via ordinal data probit regression models. A real dataset involving ordinal outcomes is used to further illustrate the proposed methodology.     

Empirical Bayesball Remixed: Empirical Bayes Methods for Longitudinal Data

Empirical Bayes methods for Gaussian and binomial compound decision problems involving longitudinal data are considered. A recent convex optimization reformulation of the nonparametric maximum likelihood estimator of Kiefer and Wolfowitz (Annals of Mathematical Statistics 1956; 27 : 887–906) is employed to construct nonparametric Bayes rules for compound decisions. The methods are illustrated with an application to predict baseball batting averages, and the age profile of batting performance. An important aspect of the empirical application is the general bivariate specification of the distribution of heterogeneous location and scale effects for players that exhibits a weak positive association between location and scale attributes. Prediction of players' batting averages for 2012 based on performance in the prior decade using the proposed methods shows substantially improved performance over more naive methods with more restrictive treatment of unobserved heterogeneity. Comparisons are also made with nonparametric Bayesian methods based on Dirichlet process priors, which can be viewed as a regularized, or smoothed, version of the Kiefer–Wolfowitz method. Copyright © 2016 John Wiley & Sons, Ltd.     

Marginal likelihood and unit roots

We develop new tests for the hypothesis of unit roots that are based on the marginal likelihood of the general linear model. The marginal likelihood allows the incorporation of invariance arguments in the likelihood function. It turns out that marginal likelihood tests for unit roots appear to be more powerful than other unit root tests. For some basic models power functions almost coincide with the power envelopes, even in small samples. General correlation structures can be incorporated, either by standard likelihood procedures or by adjustments of the test statistics on the basis of asymptotic distributions.     

First-Order Integer-Valued Autoregressive (INAR (1)) Process: Distributional and Regression Properties

Some properties of a first-order integer-valued autoregressive process (INAR)) are investigated. The approach begins with discussing the self-decomposability and unimodality of the 1-dimensional marginals of the process {X_n} generated according to the scheme X_n=α° X _n-i +e_n, where α° X _n-1 denotes a sum of X_{n - 1}, independent 0 - 1 random variables Y^(n-1), independent of X _n-1 with Pr -( y ^{(n - 1)}= 1) = 1 - Pr ( y ^(n-i)= 0) =α. The distribution of the innovation process ( e _n) is obtained when the marginal distribution of the process ( X _n) is geometric. Regression behavior of the INAR(1) process shows that the linear regression property in the backward direction is true only for the Poisson INAR(1) process.     

Estimation and model selection of semiparametric multivariate survival functions under general censorship

We study estimation and model selection of semiparametric models of multivariate survival functions for censored data, which are characterized by possibly misspecified parametric copulas and nonparametric marginal survivals. We obtain the consistency and root-n$n$ asymptotic normality of a two-step copula estimator to the pseudo-true copula parameter value according to KLIC, and provide a simple consistent estimator of its asymptotic variance, allowing for a first-step nonparametric estimation of the marginal survivals. We establish the asymptotic distribution of the penalized pseudo-likelihood ratio statistic for comparing multiple semiparametric multivariate survival functions subject to copula misspecification and general censorship. An empirical application is provided.     

On multidimensional inequality with variable distribution mean

We compare inequality of alternative populations of individuals who differ in many characteristics besides income. To do so, we introduce a new criterion for ranking multivariate distributions with different means of marginals (hereafter marginal means) and show that some conditions, relevant in the analysis of multidimensional inequality, are equivalent to the ordering we propose.     

SEQUENTIAL MONTE CARLO SAMPLING FOR DSGE MODELS

We develop a sequential Monte Carlo (SMC) algorithm for estimating Bayesian dynamic stochastic general equilibrium (DSGE) models; wherein a particle approximation to the posterior is built iteratively through tempering the likelihood. Using two empirical illustrations consisting of the Smets and Wouters model and a larger news shock model we show that the SMC algorithm is better suited for multimodal and irregular posterior distributions than the widely used random walk Metropolis–Hastings algorithm. We find that a more diffuse prior for the Smets and Wouters model improves its marginal data density and that a slight modification of the prior for the news shock model leads to drastic changes in the posterior inference about the importance of news shocks for fluctuations in hours worked. Unlike standard Markov chain Monte Carlo (MCMC) techniques; the SMC algorithm is well suited for parallel computing. Copyright © 2014 John Wiley & Sons, Ltd.     

Rank tests for testing randomness of a regression coefficient in a linear regression model

We propose a class of nonparametric tests for testing non-stochasticity of the regression parameterβ in the regression modely _i =βx _i +ɛ _i ,i=1, ...,n. We prove that the test statistics are asymptotically normally distributed both underH ₀ and under contiguous alternatives. The asymptotic relative efficiencies (in the Pitman sense) with respect to the best parametric test have also been computed and they are quite high. Some simulation studies are carried out to illustrate the results. Research was supported by the University Grants Commission, India.     

Vector Stochastic Processes with Pólya‐Type Correlation Structure

This paper introduces a simple method to construct a stationary process on the real line with a Pólya‐type covariance function and with any infinitely divisible marginal distribution, by randomising the timescale of the increment of a second‐order Lévy process with an appropriate positive random variable. With the construction method extended to the multivariate case, we construct vector stochastic processes with Pólya‐type direct covariance functions and with any specified infinitely divisible marginal distributions. This makes available a new class of non‐Gaussian vector stochastic processes with flexible correlation structure for use in modelling and simulation.     

Nonparametric Bayes inference for concave distribution functions

Bayesian inference for concave distribution functions is investigated. This is made by transforming a mixture of Dirichlet processes on the space of distribution functions to the space of concave distribution functions. We give a method for sampling from the posterior distribution using a Pólya urn scheme in combination with a Markov chain Monte Carlo algorithm. The methods are extended to estimation of concave distribution functions for incompletely observed data.