Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics

The technique of Monte Carlo (MC) tests [Dwass (1957, Annals of Mathematical Statistics 28, 181–187); Barnard (1963, Journal of the Royal Statistical Society, Series B 25, 294)] provides a simple method for building exact tests from statistics whose finite sample distribution is intractable but can be simulated (when no nuisance parameter is involved). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing it to statistics whose null distribution involves nuisance parameters [maximized MC (MMC) tests]. Simplified asymptotically justified versions of the MMC method are also proposed: these provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics.     

Goodness-of-fit tests based on series estimators in nonparametric instrumental regression

This paper proposes several tests of restricted specification in nonparametric instrumental regression. Based on series estimators, test statistics are established that allow for tests of the general model against a parametric or nonparametric specification as well as a test of exogeneity of the vector of regressors. The tests’ asymptotic distributions under correct specification are derived and their consistency against any alternative model is shown. Under a sequence of local alternative hypotheses, the asymptotic distributions of the tests are derived. Moreover, uniform consistency is established over a class of alternatives whose distance to the null hypothesis shrinks appropriately as the sample size increases. A Monte Carlo study examines finite sample performance of the test statistics.     

Non-parametric tests of productive efficiency with errors-in-variables

We develop a non-parametric test of productive efficiency that accounts for errors-in-variables, following the approach of Varian. [1985. Nonparametric analysis of optimizing behavior with measurement error. Journal of Econometrics 30(1/2), 445–458]. The test is based on the general Pareto–Koopmans notion of efficiency, and does not require price data. Statistical inference is based on the sampling distribution of the L_∞ norm of errors. The test statistic can be computed using a simple enumeration algorithm. The finite sample properties of the test are analyzed by means of a Monte Carlo simulation using real-world data of large EU commercial banks.     

Testing Exogeneity in the Bivariate Probit Model: A Monte Carlo Study*

We conduct an extensive Monte Carlo experiment to examine the finite sample properties of maximum‐likelihood‐based inference in the bivariate probit model with an endogenous dummy. We analyse the relative performance of alternative exogeneity tests, the impact of distributional misspecification and the role of exclusion restrictions to achieve parameter identification in practice. The results allow us to infer important guidelines for applied econometric practice.     

Information criteria for impulse response function matching estimation of DSGE models

We propose new information criteria for impulse response function matching estimators (IRFMEs). These estimators yield sampling distributions of the structural parameters of dynamic stochastic general equilibrium (DSGE) models by minimizing the distance between sample and theoretical impulse responses. First, we propose an information criterion to select only the responses that produce consistent estimates of the true but unknown structural parameters: the Valid Impulse Response Selection Criterion (VIRSC). The criterion is especially useful for mis-specified models. Second, we propose a criterion to select the impulse responses that are most informative about DSGE model parameters: the Relevant Impulse Response Selection Criterion (RIRSC). These criteria can be used in combination to select the subset of valid impulse response functions with minimal dimension that yields asymptotically efficient estimators. The criteria are general enough to apply to impulse responses estimated by VARs, local projections, and simulation methods. We show that the use of our criteria significantly affects estimates and inference about key parameters of two well-known new Keynesian DSGE models. Monte Carlo evidence indicates that the criteria yield gains in terms of finite sample bias as well as offering tests statistics whose behavior is better approximated by the first order asymptotic theory. Thus, our criteria improve existing methods used to implement IRFMEs.     

Bootstrapping cointegrating regressions

In this paper, we consider bootstrapping cointegrating regressions. It is shown that the method of bootstrap, if properly implemented, generally yields consistent estimators and test statistics for cointegrating regressions. For the cointegrating regression models driven by general linear processes, we employ the sieve bootstrap based on the approximated finite-order vector autoregressions for the regression errors and the first differences of the regressors. In particular, we establish the bootstrap consistency for OLS method. The bootstrap method can thus be used to correct for the finite sample bias of the OLS estimator and to approximate the asymptotic critical values of the OLS-based test statistics in general cointegrating regressions. The bootstrap OLS procedure, however, is not efficient. For the efficient estimation and hypothesis testing, we consider the procedure proposed by Saikkonen [1991. Asymptotically efficient estimation of cointegration regressions. Econometric Theory 7, 1–21] and Stock and Watson [1993. A simple estimator of cointegrating vectors in higher order integrating systems. Econometrica 61, 783–820] relying on the regression augmented with the leads and lags of differenced regressors. The bootstrap versions of their procedures are shown to be consistent, and can be used to do asymptotically valid inferences. A Monte Carlo study is conducted to investigate the finite sample performances of the proposed bootstrap methods.     

Robust Non‐nested Testing for Ordinary Least Squares Regression when Some of the Regressors are Lagged Dependent Variables*

The problem of testing non‐nested regression models that include lagged values of the dependent variable as regressors is discussed. It is argued that it is essential to test for error autocorrelation if ordinary least squares and the associated J and F tests are to be used. A heteroskedasticity–robust joint test against a combination of the artificial alternatives used for autocorrelation and non‐nested hypothesis tests is proposed. Monte Carlo results indicate that implementing this joint test using a wild bootstrap method leads to a well‐behaved procedure and gives better control of finite sample significance levels than asymptotic critical values.     

Confidence sets for partially identified parameters that satisfy a finite number of moment inequalities

This paper proposes a computationally simple way to construct confidence sets for a parameter of interest in models comprised of moment inequalities. Building on results from the literature on multivariate one-sided tests, I show how to test the hypothesis that any particular parameter value is logically consistent with the maintained moment inequalities. The associated test statistic has an asymptotic chi-bar-square distribution, and can be inverted to construct an asymptotic confidence set for the parameter of interest, even if that parameter is only partially identified. Critical values for the test are easily computed, and a Monte Carlo study demonstrates implementation and finite sample performance.     

Maximum likelihood estimation and Lagrange multiplier tests for panel seemingly unrelated regressions with spatial lag and spatial errors: An application to hedonic housing prices in Paris

This paper proposes maximum likelihood estimators for panel seemingly unrelated regressions with both spatial lag and spatial error components. We study the general case where spatial effects are incorporated via spatial errors terms and via a spatial lag dependent variable and where the heterogeneity in the panel is incorporated via an error component specification. We generalize the approach of Wang and Kockelman (2007) and propose joint and conditional Lagrange multiplier tests for spatial autocorrelation and random effects for this spatial SUR panel model. The small sample performance of the proposed estimators and tests are examined using Monte Carlo experiments. An empirical application to hedonic housing prices in Paris illustrate these methods. The proposed specification uses a system of three SUR equations corresponding to three types of flats within 80 districts of Paris over the period 1990-2003. We test for spatial effects and heterogeneity and find reasonable estimates of the shadow prices for housing characteristics.     

Exact permutation tests for non-nested non-linear regression models

This paper proposes exact distribution-free permutation tests for the specification of a non-linear regression model against one or more possibly non-nested alternatives. The new tests may be validly applied to a wide class of models, including models with endogenous regressors and lag structures. These tests build on the well-known J test developed by Davidson and MacKinnon [1981. Several tests for model specification in the presence of alternative hypotheses. Econometrica 49, 781–793] and their exactness holds under broader assumptions than those underlying the conventional J test. The J-type test statistics are used with a randomization or Monte Carlo resampling technique which yields an exact and computationally inexpensive inference procedure. A simulation experiment confirms the theoretical results and also shows the performance of the new procedure under violations of the maintained assumptions. The test procedure developed is illustrated by an application to inflation dynamics.     

No-arbitrage semi-martingale restrictions for continuous-time volatility models subject to leverage effects,jumps and i.i.d. noise: Theory and testable distributional implications

We develop a sequential procedure to test the adequacy of jump-diffusion models for return distributions. We rely on intraday data and nonparametric volatility measures, along with a new jump detection technique and appropriate conditional moment tests, for assessing the import of jumps and leverage effects. A novel robust-to-jumps approach is utilized to alleviate microstructure frictions for realized volatility estimation. Size and power of the procedure are explored through Monte Carlo methods. Our empirical findings support the jump-diffusive representation for S&P500 futures returns but reveal it is critical to account for leverage effects and jumps to maintain the underlying semi-martingale assumption.     

Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests*

Double bootstrap methods are used to control the overall significance level of a battery of diagnostic tests applied to a regression model estimated by ordinary least squares. Monte Carlo evidence on the finite sample performance of the bootstrap methods is reported and discussed.     

Exact and asymptotic tests for possibly non-regular hypotheses on stochastic volatility models

We study the problem of testing hypotheses on the parameters of one- and two-factor stochastic volatility models (SV), allowing for the possible presence of non-regularities such as singular moment conditions and unidentified parameters, which can lead to non-standard asymptotic distributions. We focus on the development of simulation-based exact procedures–whose level can be controlled in finite samples–as well as on large-sample procedures which remain valid under non-regular conditions. We consider Wald-type, score-type and likelihood-ratio-type tests based on a simple moment estimator, which can be easily simulated. We also propose a C(α)-type test which is very easy to implement and exhibits relatively good size and power properties. Besides usual linear restrictions on the SV model coefficients, the problems studied include testing homoskedasticity against a SV alternative (which involves singular moment conditions under the null hypothesis) and testing the null hypothesis of one factor driving the dynamics of the volatility process against two factors (which raises identification difficulties). Three ways of implementing the tests based on alternative statistics are compared: asymptotic critical values (when available), a local Monte Carlo (or parametric bootstrap) test procedure, and a maximized Monte Carlo (MMC) procedure. The size and power properties of the proposed tests are examined in a simulation experiment. The results indicate that the C(α)-based tests (built upon the simple moment estimator available in closed form) have good size and power properties for regular hypotheses, while Monte Carlo tests are much more reliable than those based on asymptotic critical values. Further, in cases where the parametric bootstrap appears to fail (for example, in the presence of identification problems), the MMC procedure easily controls the level of the tests. Moreover, MMC-based tests exhibit relatively good power performance despite the conservative feature of the procedure. Finally, we present an application to a time series of returns on the Standard and Poor’s Composite Price Index.     

Bootstrap testing for the null of no cointegration in a threshold vector error correction model

We develop a test for the linear no cointegration null hypothesis in a threshold vector error correction model. We adopt a sup-Wald type test and derive its null asymptotic distribution. A residual-based bootstrap is proposed, and the first-order consistency of the bootstrap is established. A set of Monte Carlo simulations shows that the bootstrap corrects size distortion of asymptotic distribution in finite samples, and that its power against the threshold cointegration alternative is significantly greater than that of conventional cointegration tests. Our method is illustrated with used car price indexes.     

Diagnostic testing for cointegration

We develop a sequence of tests for specifying the cointegrating rank of, possibly fractional, multiple time series. Memory parameters of observables are treated as unknown, as are those of possible cointegrating errors. The individual test statistics have standard null asymptotics and are related to Hausman specification test statistics: when the memory parameter is common to several series, an estimate of this parameter based on the assumption of no cointegration achieves an efficiency improvement over estimates based on individual series, whereas if the series are cointegrated the former estimate is generally inconsistent. However, a computationally simpler but asymptotically equivalent approach, which avoids explicit computation of the “efficient” estimate, is instead pursued here. Two versions of it are initially proposed, followed by one that robustifies to possible inequality between memory parameters of observables. Throughout, a semiparametric approach is pursued, modelling serial dependence only at frequencies near the origin, with the goal of validity under broad circumstances and computational convenience. The main development is in terms of stationary series, but an extension to non-stationary ones is also described. The algorithm for estimating cointegrating rank entails carrying out such tests based on potentially all subsets of two or more of the series, though outcomes of previous tests may render some or all subsequent ones unnecessary. A Monte Carlo study of finite sample performance is included.     

Efficient Monte Carlo pricing of European options¶using mean value control variates

We describe in this paper a variance reduction method based on control variates. The technique uses the fact that, if all stochastic assets but one are replaced in the payoff function by their mean, the resulting integral can most often be evaluated in closed form. We exploit this idea by applying the univariate payoff as control variate and develop a general Monte Carlo procedure, called Mean Monte Carlo (MMC). The method is then tested on a variety of multifactor options and compared to other Monte Carlo approaches or numerical techniques. The method is of easy and broad applicability and gives good results especially for low to medium dimension and in high volatility environments.     

Nonparametric cointegration analysis of fractional systems with unknown integration orders

In this paper a nonparametric variance ratio testing approach is proposed for determining the cointegration rank in fractionally integrated systems. The test statistic is easily calculated without prior knowledge of the integration order of the data, the strength of the cointegrating relations, or the cointegration vector(s). The latter property makes it easier to implement than regression-based approaches, especially when examining relationships between several variables with possibly multiple cointegrating vectors. Since the test is nonparametric, it does not require the specification of a particular model and is invariant to short-run dynamics. Nor does it require the choice of any smoothing parameters that change the test statistic without being reflected in the asymptotic distribution. Furthermore, a consistent estimator of the cointegration space can be obtained from the procedure. The asymptotic distribution theory for the proposed test is non-standard but easily tabulated or simulated. Monte Carlo simulations demonstrate excellent finite sample properties, even rivaling those of well-specified parametric tests. The proposed methodology is applied to the term structure of interest rates, where, contrary to both fractional- and integer-based parametric approaches, evidence in favor of the expectations hypothesis is found using the nonparametric approach.     

Exact Skewness–Kurtosis Tests for Multivariate Normality and Goodness‐of‐Fit in Multivariate Regressions with Application to Asset Pricing Models*

We study the problem of testing the error distribution in a multivariate linear regression (MLR) model. The tests are functions of appropriately standardized multivariate least squares residuals whose distribution is invariant to the unknown cross‐equation error covariance matrix. Empirical multivariate skewness and kurtosis criteria are then compared with a simulation‐based estimate of their expected value under the hypothesized distribution. Special cases considered include testing multivariate normal and stable error distributions. In the Gaussian case, finite‐sample versions of the standard multivariate skewness and kurtosis tests are derived. To do this, we exploit simple, double and multi‐stage Monte Carlo test methods. For non‐Gaussian distribution families involving nuisance parameters, confidence sets are derived for the nuisance parameters and the error distribution. The tests are applied to an asset pricing model with observable risk‐free rates, using monthly returns on New York Stock Exchange (NYSE) portfolios over 5‐year subperiods from 1926 to 1995.     

Testing Convergence in Income Distribution*

The generalized method of moments (GMM) estimator is often used to test for convergence in income distribution in a dynamic panel set‐up. We argue that though consistent, the GMM estimator utilizes the sample observations inefficiently. We propose a simple ordinary least squares (OLS) estimator with more efficient use of sample information. Our Monte Carlo study shows that the GMM estimator can be very imprecise and severely biased in finite samples. In contrast, the OLS estimator overcomes these shortcomings.     

Partial rank estimation of duration models with general forms of censoring

In this paper we propose estimators for the regression coefficients in censored duration models which are distribution free, impose no parametric specification on the baseline hazard function, and can accommodate general forms of censoring. The estimators are shown to have desirable asymptotic properties and Monte Carlo simulations demonstrate good finite sample performance. Among the data features the new estimators can accommodate are covariate-dependent censoring, double censoring, and fixed (individual or group specific) effects. We also examine the behavior of the estimator in an empirical illustration.