A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation

A class of adaptive sampling methods is introduced for efficient posterior and predictive simulation. The proposed methods are robust in the sense that they can handle target distributions that exhibit non-elliptical shapes such as multimodality and skewness. The basic method makes use of sequences of importance weighted Expectation Maximization steps in order to efficiently construct a mixture of Student-t$t$ densities that approximates accurately the target distribution–typically a posterior distribution, of which we only require a kernel–in the sense that the Kullback–Leibler divergence between target and mixture is minimized. We label this approach Mixture of  t$t$by Importance Sampling weighted Expectation Maximization (MitISEM). The constructed mixture is used as a candidate density for quick and reliable application of either Importance Sampling (IS) or the Metropolis–Hastings (MH) method. We also introduce three extensions of the basic MitISEM approach. First, we propose a method for applying MitISEM in a sequential manner, so that the candidate distribution for posterior simulation is cleverly updated when new data become available. Our results show that the computational effort reduces enormously, while the quality of the approximation remains almost unchanged. This sequential approach can be combined with a tempering approach, which facilitates the simulation from densities with multiple modes that are far apart. Second, we introduce a permutation-augmented MitISEM approach. This is useful for importance or Metropolis–Hastings sampling from posterior distributions in mixture models without the requirement of imposing identification restrictions on the model’s mixture regimes’ parameters. Third, we propose a partial MitISEM approach, which aims at approximating the joint distribution by estimating a product of marginal and conditional distributions. This division can substantially reduce the dimension of the approximation problem, which facilitates the application of adaptive importance sampling for posterior simulation in more complex models with larger numbers of parameters. Our results indicate that the proposed methods can substantially reduce the computational burden in econometric models like DCC or mixture GARCH models and a mixture instrumental variables model.     

Estimation and testing of Euler equation models with time-varying reduced-form coefficients

This paper studies the estimation and testing of Euler equation models in the framework of the classical two-step minimum-distance method. The time-varying reduced-form model in the first step reflects the adaptation of private agents’ beliefs to the changing economic environment. The presumed ability of Euler conditions to deliver stable parameters indexing tastes and technology is interpreted as a time-invariant second-step model. This paper shows that, complementary to and independent of one another, both standard specification test and stability test are required for the evaluation of an Euler equation. As an empirical application, a widely used investment Euler equation is submitted to examination. The empirical outcomes appear to suggest that the standard investment model has not been a success for aggregate investment.     

What model for entry in first-price auctions? A nonparametric approach

We develop a selective entry model for first-price auctions that nests two polar models often estimated in the empirical literature on auctions, Levin and Smith (1994), and Samuelson (1985). The selective entry model features a pro-competitive selection effect. The selection effect is shown to be nonparametrically identifiable, and a nonparametric test for its presence is proposed. This test can be used to discriminate between the two polar models.     

Identification robust confidence set methods for inference on parameter ratios with application to discrete choice models

We study the problem of building confidence sets for ratios of parameters, from an identification robust perspective. In particular, we address the simultaneous confidence set estimation of a finite number of ratios. Results apply to a wide class of models suitable for estimation by consistent asymptotically normal procedures. Conventional methods (e.g. the delta method) derived by excluding the parameter discontinuity regions entailed by the ratio functions and which typically yield bounded confidence limits, break down even if the sample size is large ( Dufour, 1997). One solution to this problem, which we take in this paper, is to use variants of  Fieller’s ( 1940, 1954) method. By inverting a joint test that does not require identifying the ratios, Fieller-based confidence regions are formed for the full set of ratios. Simultaneous confidence sets for individual ratios are then derived by applying projection techniques, which allow for possibly unbounded outcomes. In this paper, we provide simple explicit closed-form analytical solutions for projection-based simultaneous confidence sets, in the case of linear transformations of ratios. Our solution further provides a formal proof for the expressions in Zerbe et al. (1982) pertaining to individual ratios. We apply the geometry of quadrics as introduced by  and , in a different although related context. The confidence sets so obtained are exact if the inverted test statistic admits a tractable exact distribution, for instance in the normal linear regression context. The proposed procedures are applied and assessed via illustrative Monte Carlo and empirical examples, with a focus on discrete choice models estimated by exact or simulation-based maximum likelihood. Our results underscore the superiority of Fieller-based methods.     

Exact permutation tests for non-nested non-linear regression models

This paper proposes exact distribution-free permutation tests for the specification of a non-linear regression model against one or more possibly non-nested alternatives. The new tests may be validly applied to a wide class of models, including models with endogenous regressors and lag structures. These tests build on the well-known J test developed by Davidson and MacKinnon [1981. Several tests for model specification in the presence of alternative hypotheses. Econometrica 49, 781–793] and their exactness holds under broader assumptions than those underlying the conventional J test. The J-type test statistics are used with a randomization or Monte Carlo resampling technique which yields an exact and computationally inexpensive inference procedure. A simulation experiment confirms the theoretical results and also shows the performance of the new procedure under violations of the maintained assumptions. The test procedure developed is illustrated by an application to inflation dynamics.     

Nonparametric identification of a binary random factor in cross section data

Suppose V and U are two independent mean zero random variables, where V has an asymmetric distribution with two mass points and U has some zero odd moments (having a symmetric distribution suffices). We show that the distributions of V and U are nonparametrically identified just from observing the sum V+U, and provide a pointwise rate root n estimator. This can permit point identification of average treatment effects when the econometrician does not observe who was treated. We extend our results to include covariates X, showing that we can nonparametrically identify and estimate cross section regression models of the form Y=g(X,D^∗)+U, where D^∗ is an unobserved binary regressor.     

Testing multivariate distributions in GARCH models

In this paper, we consider testing distributional assumptions in multivariate GARCH models based on empirical processes. Using the fact that joint distribution carries the same amount of information as the marginal together with conditional distributions, we first transform the multivariate data into univariate independent data based on the marginal and conditional cumulative distribution functions. We then apply the Khmaladze's martingale transformation (K-transformation) to the empirical process in the presence of estimated parameters. The K-transformation eliminates the effect of parameter estimation, allowing a distribution-free test statistic to be constructed. We show that the K-transformation takes a very simple form for testing multivariate normal and multivariate t-distributions. The procedure is applied to a multivariate financial time series data set.     

The zero-information-limit condition and spurious inference in weakly identified models

In many econometric models the asymptotic variance of a parameter estimate depends on the value of another structural parameter in such a way that the data contain little information about the former when the latter is close to a critical value. This paper introduces the zero-information-limit-condition (ZILC) to identify such models where ‘weak identification’ leads to spurious inference. We find that standard errors tend to be underestimated in these cases, but the size of the asymptotic t-test may either be too great (the intuitive case emphasized in the ‘weak instrument’ literature) or too small as in two cases illustrated here.     

Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables

Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578] and Ai and Chen [2003. Efficient estimation of conditional moment restrictions models containing unknown functions. Econometrica 71, 1795–1843] propose sieve minimum distance (SMD) estimation of both finite dimensional parameter (θ)$(\theta )$ and infinite dimensional parameter (h) that are identified through a conditional moment restriction model, in which h could depend on endogenous variables. This paper modifies their SMD procedure to allow for different conditioning variables to be used in different equations, and derives the asymptotic properties when the model may be misspecified  . Under low-level sufficient conditions, we show that: (i) the modified SMD estimators of both θ$\theta$ and h   converge to some pseudo-true values in probability; (ii) the SMD estimators of smooth functionals, including the θ$\theta$ estimator and the average derivative estimator, are asymptotically normally distributed; and (iii) the estimators for the asymptotic covariances of the SMD estimators of smooth functionals are consistent and easy to compute. These results allow for asymptotically valid tests of various hypotheses on the smooth functionals regardless of whether the semiparametric model is correctly specified or not.     

Model selection criteria in multivariate models with multiple structural changes

This paper considers the issue of selecting the number of regressors and the number of structural breaks in multivariate regression models in the possible presence of multiple structural changes. We develop a modified Akaike information criterion (AIC), a modified Mallows’ C_p criterion and a modified Bayesian information criterion (BIC). The penalty terms in these criteria are shown to be different from the usual terms. We prove that the modified BIC consistently selects the regressors and the number of breaks whereas the modified AIC and the modified C_p criterion tend to overfit with positive probability. The finite sample performance of these criteria is investigated through Monte Carlo simulations and it turns out that our modification is successful in comparison to the classical model selection criteria and the sequential testing procedure robust to heteroskedasticity and autocorrelation.     

Estimation of stable distributions by indirect inference

This article deals with the estimation of the parameters of an α-stable distribution with indirect inference, using the skewed-t distribution as an auxiliary model. The latter distribution appears as a good candidate since it has the same number of parameters as the α-stable distribution, with each parameter playing a similar role. To improve the properties of the estimator in finite sample, we use constrained indirect inference. In a Monte Carlo study we show that this method delivers estimators with good properties in finite sample. We provide an empirical application to the distribution of jumps in the S&P 500 index returns.     

A simple test for regression specification with non-nested alternatives

In this paper, I introduce a simple test for the presence of the data-generating process among several non-nested alternatives. The test is an extension of the classical J test for non-nested regression models. I also provide a bootstrap version of the test that avoids possible size distortions inherited from the J test.     

Common cyclical features analysis in VAR models with cointegration

The paper considers n-dimensional VAR models for variables exhibiting cointegration and common cyclical features. Two specific reduced rank vector error correction models are discussed. In one, named the “strong form” and denoted by SF, the collection of all coefficient matrices of a VECM has rank less than n, in the other, named the “weak form” and denoted by WF, the collection of all coefficient matrices except the matrix of coefficient of error correction terms has rank less than n. The paper explores the theoretical connections between these two forms, suggests asymptotic tests for each form and examines the small sample properties of these tests by Monte Carlo simulations.     

Semiparametric Bayesian inference in smooth coefficient models

We describe procedures for Bayesian estimation and testing in cross-sectional, panel data and nonlinear smooth coefficient models. The smooth coefficient model is a generalization of the partially linear or additive model wherein coefficients on linear explanatory variables are treated as unknown functions of an observable covariate. In the approach we describe, points on the regression lines are regarded as unknown parameters and priors are placed on differences between adjacent points to introduce the potential for smoothing the curves. The algorithms we describe are quite simple to implement—for example, estimation, testing and smoothing parameter selection can be carried out analytically in the cross-sectional smooth coefficient model.     

On the asymptotic optimality of the LIML estimator with possibly many instruments

We consider the estimation of the coefficients of a linear structural equation in a simultaneous equation system when there are many instrumental variables. We derive some asymptotic properties of the limited information maximum likelihood (LIML) estimator when the number of instruments is large; some of these results are new as well as old, and we relate them to results in some recent studies. We have found that the variance of the limiting distribution of the LIML estimator and its modifications often attain the asymptotic lower bound when the number of instruments is large and the disturbance terms are not necessarily normally distributed, that is, for the micro-econometric models of some cases recently called many instruments and many weak instruments.     

Efficient estimation and inference in linear pseudo-panel data models

We consider pseudo-panel data models constructed from repeated cross sections in which the number of individuals per group is large relative to the number of groups and time periods. First, we show that, when time-invariant group fixed effects are neglected, the OLS estimator does not converge in probability to a constant but rather to a random variable. Second, we show that, while the fixed-effects (FE) estimator is consistent, the usual t statistic is not asymptotically normally distributed, and we propose a new robust t statistic whose asymptotic distribution is standard normal. Third, we propose efficient GMM estimators using the orthogonality conditions implied by grouping and we provide t tests that are valid even in the presence of time-invariant group effects. Our Monte Carlo results show that the proposed GMM estimator is more precise than the FE estimator and that our new t test has good size and is powerful.     

Estimating fixed-effect panel stochastic frontier models by model transformation

Traditional panel stochastic frontier models do not distinguish between unobserved individual heterogeneity and inefficiency. They thus force all time-invariant individual heterogeneity into the estimated inefficiency. Greene (2005) proposes a true fixed-effect stochastic frontier model which, in theory, may be biased by the incidental parameters problem. The problem usually cannot be dealt with by model transformations owing to the nonlinearity of the stochastic frontier model. In this paper, we propose a class of panel stochastic frontier models which create an exception. We show that first-difference and within-transformation can be analytically performed on this model to remove the fixed individual effects, and thus the estimator is immune to the incidental parameters problem. Consistency of the estimator is obtained by either N→∞$N\to \infty$ or T→∞$T\to \infty$, which is an attractive property for empirical researchers.     

Dilation bootstrap

We propose a methodology for combining several sources of model and data incompleteness and partial identification, which we call Composition Theorem. We apply this methodology to the construction of confidence regions with partially identified models of general form. The region is obtained by inverting a test of internal consistency of the econometric structure. We develop a dilation bootstrap methodology to deal with sampling uncertainty without reference to the hypothesized economic structure. It requires bootstrapping the quantile process for univariate data and a novel generalization of the latter to higher dimensions. Once the dilation is chosen to control the confidence level, the unknown true distribution of the observed data can be replaced by the known empirical distribution and confidence regions can then be obtained as in Galichon and Henry (2011) and Beresteanu et al. (2011).     

Nonparametric testing for smooth structural changes in panel data models

Detecting and modeling structural changes in time series models have attracted great attention. However, relatively little effort has been paid to the testing of structural changes in panel data models despite their increasing importance in economics and finance. In this paper, we propose a new approach to testing structural changes in panel data models. Unlike the bulk of the literature on structural changes, which focuses on detection of abrupt structural changes, we consider smooth structural changes for which model parameters are unknown deterministic smooth functions of time except for a finite number of time points. We use nonparametric local smoothing method to consistently estimate the smooth changing parameters and develop two consistent tests for smooth structural changes in panel data models. The first test is to check whether all model parameters are stable over time. The second test is to check potential time-varying interaction while allowing for a common trend. Both tests have an asymptotic $N(0,1)$ distribution under the null hypothesis of parameter constancy and are consistent against a vast class of smooth structural changes as well as abrupt structural breaks with possibly unknown break points alternatives. Simulation studies show that the tests provide reliable inference in finite samples and two empirical examples with respect to a cross-country growth model and a capital structure model are discussed.     

Fixed effects estimation of structural parameters and marginal effects in panel probit models

Fixed effects estimators of nonlinear panel models can be severely biased due to the incidental parameters problem. In this paper, I characterize the leading term of a large-T expansion of the bias of the MLE and estimators of average marginal effects in parametric fixed effects panel binary choice models. For probit index coefficients, the former term is proportional to the true value of the coefficients being estimated. This result allows me to derive a lower bound for the bias of the MLE. I then show that the resulting fixed effects estimates of ratios of coefficients and average marginal effects exhibit no bias in the absence of heterogeneity and negligible bias for a wide variety of distributions of regressors and individual effects in the presence of heterogeneity. I subsequently propose new bias-corrected estimators of index coefficients and marginal effects with improved finite sample properties for linear and nonlinear models with predetermined regressors.