Specification tests based on the heterogeneous generalized gamma model of duration: With an application to Kennan's strike data

In this paper, tests for neglected heterogeneity and functional form misspecification of some commonly used parametric distributions are derived within a heterogeneous generalized gamma model. It is argued that the conventional test of heterogeneity may not be valid when the underlying hazard function is misspecified. Hence, if the estimated hazard function is deemed restrictive, tests for functional form misspecification should accompany any test of heterogeneity. An empirical illustration based on Kennan's (1985) model of strikes is used to show that incorrect inferences may be drawn, as in a number of previous analyses, if the relevant restrictions are not tested jointly.     

A lagrange multiplier interpretation of disturbance estimators with an application to testing for nonlinearity

This paper describes a Lagrange multiplier interpretation of LUF disturbance estimators and an associated means of constructing residuals and procedures for testing for certain kinds of misspecification. Together with a recent technique for partially ordering multivariate data, the methods are used to devise an F test for nonlinearity in some or all of the explanatory variables in multiple regression. Unlike several alternatives, the proposed test does not require all misspecified variables to be positively correlated. Power computations, and comparisons with other procedures, yield encouraging results.     

Testing a linear dynamic panel data model against nonlinear alternatives

The most popular econometric models in the panel data literature are the class of linear panel data models with unobserved individual- and/or time-specific effects. The consistency of parameter estimators and the validity of their economic interpretations as marginal effects depend crucially on the correct functional form specification of the linear panel data model. In this paper, a new class of residual-based tests is proposed for checking the validity of dynamic panel data models with both large cross-sectional units and time series dimensions. The individual and time effects can be fixed or random, and panel data can be balanced or unbalanced. The tests can detect a wide range of model misspecifications in the conditional mean of a dynamic panel data model, including functional form and lag misspecification. They check a large number of lags so that they can capture misspecification at any lag order asymptotically. No common alternative is assumed, thus allowing for heterogeneity in the degrees and directions of functional form misspecification across individuals. Thanks to the use of panel data with large $N$ and $T$, the proposed nonparametric tests have an asymptotic normal distribution under the null hypothesis without requiring the smoothing parameters to grow with the sample sizes. This suggests better nonparametric asymptotic approximation for the panel data than for time series or cross sectional data. This is confirmed in a simulation study. We apply the new tests to test linear specification of cross-country growth equations and found significant nonlinearities in mean for OECD countries’ growth equation for annual and quintannual panel data.     

Alternative Versions of the RESET Test for Binary Response Index Models: A Comparative Study*

Binary response index models may be affected by several forms of misspecification, which range from pure functional form problems (e.g. incorrect specification of the link function, neglected heterogeneity, heteroskedasticity) to various types of sampling issues (e.g. covariate measurement error, response misclassification, endogenous stratification, missing data). In this article we examine the ability of several versions of the RESET test to detect such misspecifications in an extensive Monte Carlo simulation study. We find that: (i) the best variants of the RESET test are clearly those based on one or two fitted powers of the response index; and (ii) the loss of power resulting from using the RESET instead of a test directed against a specific type of misspecification is very small in many cases.     

Practical Considerations for Choosing Between Tobit and SCLS or CLAD Estimators for Censored Regression Models with an Application to Charitable Giving*

Practical considerations for choosing between Tobit, symmetrically censored least squares (SCLS) and censored least absolute deviations (CLAD) estimators are offered. Practical considerations deal with when a Hausman test is better than a conditional moment test for judging the severity of a misspecification, the need to bootstrap the sampling distributions of the Hausman tests, what to look for in a graphical examination of the residuals and the limited value of SCLS. The practical considerations are applied to a model of the intergenerational transmission of charitable giving using new data from the Panel Study of Income Dynamics (PSID). The paper shows how to use relative distribution methods to calculate CLAD‐based marginal effects on the observable dependent variable.     

Generalized method of moments specification testing

This paper analyzes the asymptotic power properties of specification tests which are based on a finite set of moment conditions. It shows that any such test may fail against general misspecification that causes estimator inconsistency. The mutual asymptotic equivalence of maximal degree of freedom tests is shown and the form of optimal tests against specific forms of misspecification is derived. Applications to testing for exogeneity of a set of instrumental variables are presented.     

Residual based tests for cointegration in dependent panels

In the paper, we propose residual based tests for cointegration in general panels with cross-sectional dependency, endogeneity and various heterogeneities. The residuals are obtained from the usual least squares estimation of the postulated cointegrating relationships from each individual unit, and the nonlinear IV panel unit root testing procedure is applied to the panels of the fitted residuals using as instruments the nonlinear transformations of the adaptively   fitted lagged residuals. The t$t$-ratio, based on the nonlinear IV estimator, is then constructed to test for unit root in the fitted residuals for each cross-section. We show that such nonlinear IV t$t$-ratios are asymptotically normal and cross-sectionally independent under the null hypothesis of no cointegration. The average or the minimum of the IVt$t$-ratios can, therefore, be used to test for the null of a fully non-cointegrated panel against the alternative of a mixed panel, i.e., a panel with only some cointegrated units. We also consider the maximum of the IV t$t$-ratios to test for a mixed panel against a fully cointegrated panel. The critical values of the minimum, maximum as well as the average tests are easily obtained from the standard normal distribution function. Our simulation results indicate that the residual based tests for cointegration perform quite well in finite samples.     

Diagnostics for IV Regressions

The use of residuals from the structural equations in a simultaneous- equations model can lead to misleading measures of association and to invalid diagnostic statistics for heterosedasticity and functional form misspecifications. In an important paper, Pagan and Hall (1983) suggest a few principals upon which asymptotically valid tests can be constructed, while the issue of appropriate measures of goodness-of-fit for IV regressions is addressed in Pesaran and Smith (1994). This paper is concerned with the optimal construction of diagnostics for IV regression, and examines the finite-sample properties of several tests for functional form misspecifications and heteroscedasticity.     

Harmonic alternatives to the Almon polynomial technique

The Almon technique for estimating distributed lag coefficients uses polynomial approximations to the true but unknown distributed lag function. The technique is used primarily to increase the efficiency of the estimators over OLS estimators. This paper proposes the use of harmonic approximations which is at least as reasonable a priori as approximations by polynomials. This method can be used as an alternative to the Almon method in certain cases and as a convenient check against misspecification problems.     

Generalised residuals and heterogeneous duration models: With applications to the Weilbull model

This paper deals with models for the duration of an event that are misspecified by the neglect of random multiplicative heterogeneity in the hazard function. This type of misspecification has been widely discussed in the literature [e.g., Heckman and Singer (1982), Lancaster and Nickell (1980)], but no study of its effect on maximum likelihood estimators has been given. This paper aims to provide such a study with particular reference to the Weibull regression model which is by far the most frequently used parametric model [e.g., Heckman and Borjas (1980), Lancaster (1979)]. In this paper we define generalised errors and residuals in the sense of Cox and Snell (1968, 1971) and show how their use materially simplifies the analysis of both true and misspecified duration models. We show that multiplicative heterogeneity in the hazard of the Weibull model has two errors in variables interpretations. We give the exact asymptotic inconsistency of M.L. estimation in the Weibull model and give a general expression for the inconsistency of M.L. estimators due to neglected heterogeneity for any duration model to O(σ²), where σ² is the variance of the error term. We also discuss the information matrix test for neglected heterogeneity in duration models and consider its behaviour when σ²>0.     

A bootstrap-based non-parametric forecast density

Interest in density forecasts (as opposed to solely modeling the conditional mean) arises from the possibility of dynamics in higher moments of a time series, as well as in forecasting the probability of future events in some applications. By combining the idea of Markov bootstrapping with that of kernel density estimation, this paper presents a simple non-parametric method for estimating out-of-sample multi-step density forecasts. The paper also considers a host of evaluation tests for examining the dynamic misspecification of estimated density forecasts by targeting autocorrelation, heteroskedasticity and neglected non-linearity. These tests are useful, as a rejection of the tests gives insight into ways to improve a particular forecasting model. In an extensive Monte Carlo analysis involving a range of commonly used linear and non-linear time series processes, the non-parametric method is shown to work reasonably well across the simulated models for a suitable choice of the bandwidth (smoothing parameter). Furthermore, an application of the method to the U.S. Industrial Production series provides multi-step density forecasts that show no sign of dynamic misspecification.     

The small sample bias of Durbin's tests for serial correlation: When one of the regressors is the lagged dependent variable and the null hypothesis is true

Durbin (1970) has recently proposed two asymptotically equivalent statistics which can be used to test for the presence of serial correlation when some of the regressors are lagged dependent variables. This study reports on simulation experiments designed to compare the two statistics, in use with small samples, in terms of their tendencies to detect serial correlation when none exists. Of the two test statistics, it is found that the one based on estimated residuals detects the absence of serial correlation in the expected proportion of trials; the other statistic (Durbin's h), which involves the application of a correction factor to the Durbin-Watson statistic, gives evidence of serious small sample bias which varies with both the sample size and the assumed size of the coefficient attaching to the lagged dependent variable.     

SPECIFICATION TESTS FOR THE COMPETING RISKS DURATION MODEL: AN APPLICATION TO UNEMPLOYMENT DURATION AND SECTORAL MOVEMENT

ABSTRACTS This study develops three specification tests for the competing risks duration model. They include a general test for misspecification and specific tests for heterogeneity and defective risk distributions. The last two tests involves null hypotheses located on the boundary of the parameter space, and we consider alternative formulations of the score test to take account of this. The tests are applied to models of unemployment duration in which displaced job seekers may become re-employed in the pre-unemployment industry or switch industries.     

Order-invariant tests for proper calibration of multivariate density forecasts

Established tests for proper calibration of multivariate density forecasts based on Rosenblatt probability integral transforms can be manipulated by changing the order of variables in the forecasting model. We derive order-invariant tests. The new tests are applicable to densities of arbitrary dimensions and can deal with parameter estimation uncertainty and dynamic misspecification. Monte Carlo simulations show that they often have superior power relative to established approaches. We use the tests to evaluate generalized autoregressive conditional heteroskedasticity-based multivariate density forecasts for a vector of stock market returns and macroeconomic forecasts from a Bayesian vector autoregression with time-varying parameters.     

Random Effects Misspecification Can Have Severe Consequences for Random Effects Inference in Linear Mixed Models

There has been considerable and controversial research over the past two decades into how successfully random effects misspecification in mixed models (i.e. assuming normality for the random effects when the true distribution is non‐normal) can be diagnosed and what its impacts are on estimation and inference. However, much of this research has focused on fixed effects inference in generalised linear mixed models. In this article, motivated by the increasing number of applications of mixed models where interest is on the variance components, we study the effects of random effects misspecification on random effects inference in linear mixed models, for which there is considerably less literature. Our findings are surprising and contrary to general belief: for point estimation, maximum likelihood estimation of the variance components under misspecification is consistent, although in finite samples, both the bias and mean squared error can be substantial. For inference, we show through theory and simulation that under misspecification, standard likelihood ratio tests of truly non‐zero variance components can suffer from severely inflated type I errors, and confidence intervals for the variance components can exhibit considerable under coverage. Furthermore, neither of these problems vanish asymptotically with increasing the number of clusters or cluster size. These results have major implications for random effects inference, especially if the true random effects distribution is heavier tailed than the normal. Fortunately, simple graphical and goodness‐of‐fit measures of the random effects predictions appear to have reasonable power at detecting misspecification. We apply linear mixed models to a survey of more than 4 000 high school students within 100 schools and analyse how mathematics achievement scores vary with student attributes and across different schools. The application demonstrates the sensitivity of mixed model inference to the true but unknown random effects distribution.     

On economic uncertainty,stock market predictability and nonlinear spillover effects

This paper uses a k-th order nonparametric Granger causality test to analyze whether firm-level, economic policy and macroeconomic uncertainty indicators predict movements in real stock returns and their volatility. Linear Granger causality tests show that whilst economic policy and macroeconomic uncertainty indices can predict stock returns, firm-level uncertainty measures possess no predictability. However, given the existence of structural breaks and inherent nonlinearities in the series, we employ a nonparametric causality methodology, as linear modeling leads to misspecifications thus the results cannot be considered reliable. The nonparametric test reveals that in fact no predictability can be observed for the various measures of uncertainty i.e., firm-level, macroeconomic and economic policy uncertainty, vis-à-vis real stock returns. In turn, a profound causal predictability is demonstrated for the volatility series, with the exception of firm-level uncertainty. Overall our results not only emphasize the role of economic and firm-level uncertainty measures in predicting the volatility of stock returns, but also presage against using linear models which are likely to suffer from misspecification in the presence of parameter instability and nonlinear spillover effects.     

An alternative quasi likelihood approach,Bayesian analysis and data-based inference for model specification

This paper studies an alternative quasi likelihood approach under possible model misspecification. We derive a filtered likelihood from a given quasi likelihood (QL), called a limited information quasi likelihood (LI-QL), that contains relevant but limited information on the data generation process. Our LI-QL approach, in one hand, extends robustness of the QL approach to inference problems for which the existing approach does not apply. Our study in this paper, on the other hand, builds a bridge between the classical and Bayesian approaches for statistical inference under possible model misspecification. We can establish a large sample correspondence between the classical QL approach and our LI-QL based Bayesian approach. An interesting finding is that the asymptotic distribution of an LI-QL based posterior and that of the corresponding quasi maximum likelihood estimator share the same “sandwich”-type second moment. Based on the LI-QL we can develop inference methods that are useful for practical applications under possible model misspecification. In particular, we can develop the Bayesian counterparts of classical QL methods that carry all the nice features of the latter studied in  White (1982). In addition, we can develop a Bayesian method for analyzing model specification based on an LI-QL.     

Tests for changing mean with monotonic power

Several widely used tests for a changing mean exhibit nonmonotonic power in finite samples, due to “incorrect” estimation of nuisance parameters under the alternative. In this paper, we study the issue of nonmonotonic power in testing for changing mean. We investigate the asymptotic power properties of the tests, using a new framework where alternatives are characterized as having “large” changes. The asymptotic analysis provides a theoretical explanation to the power problem. Modified tests that have monotonic power against a wide range of alternatives of structural change are proposed. Instead of estimating the nuisance parameters based on ordinary least squares residuals, the proposed tests use modified estimators, based on nonparametric regression residuals. It is shown that tests based on the modified long-run variance estimator provide an improved rate of divergence of the tests under the alternative of a change in mean. Tests for structural breaks based on such an estimator are able to remain consistent, while still retaining the same asymptotic distribution under the null hypothesis of constant mean.     

Estimation of linear dynamic panel data models with time‐invariant regressors

We present a sequential approach to estimating a dynamic Hausman–Taylor model. We first estimate the coefficients of the time‐varying regressors and subsequently regress the first‐stage residuals on the time‐invariant regressors. In comparison to estimating all coefficients simultaneously, this two‐stage procedure is more robust against model misspecification, allows for a flexible choice of the first‐stage estimator, and enables simple testing of the overidentifying restrictions. For correct inference, we derive analytical standard error adjustments. We evaluate the finite‐sample properties with Monte Carlo simulations and apply the approach to a dynamic gravity equation for US outward foreign direct investment.     

Robustness issues in structural equation modeling: a review of recent developments

In structural equation modeling the statistician needs assumptions inorder (1) to guarantee that the estimates are consistent for the parameters of interest, and (2) to evaluate precision of the estimates and significance level of test statistics. With respect to purpose (1), the typical type of analyses (ML and WLS) are robust against violation of distributional assumptions; i.e., estimates remain consistent or any type of WLS analysis and distribution of z. (It should be noted, however, that (1) is sensitive to structural misspecification.) A typical assumption used for purpose (2), is the assumption that the vector z of observable follows a multivariate normal distribution.In relation to purpose (2), distributional misspecification may have consequences for efficiency, as well as power of test statistics (see Satorra, 1989a); that is, some estimation methods may bemore precise than others for a given specific distribution of z. For instance, ADF-WLS is asymptotically optimal under a variety of distributions of z, while the asymptotic optimality of NT-WLS may be lost when the data is non-normal