Some identification and estimation results for regression models with stochastically varying coefficients

Although various theoretical and applied papers have appeared in recent years concerned with the estimation and use of regression models with stochastically varying coefficients, little is available in the literature on the properties of the proposed estimators or the identifiability of the parameters of such models. The present paper derives sufficient conditions under which the maximum likelihood estimator is consistent and asymptotically normal and also provides sufficient conditions for the estimation of regression models with stationary stochastically varying coefficients. In many instances these requirements are found to have simple, intuitively appealing interpretations. Consistency and asymptotic normality is also proven for a two-step estimator and a method suggested by Rosenberg for generating initial estimates.     

Asymptotic results and tests for the choice of approximative models in nonlinear two-phases regression models, heteroscedatic case

This paper is devoted to the study of the least squares estimator of f for the classical, fixed design, nonlinear model X (t _i)=f(t _i)+ε(t _i), i=1,2,…,n, where the (ε(t _i))_i=1,…,n are independent second order r.v.. The estimation of f is based upon a given parametric form. In Brodeau (1993) this subject has been studied in the homoscedastic case. This time we assume that the ε(t _i) have non constant and unknown variances σ²(t _i). Our main goal is to develop two statistical tests, one for testing that f belongs to a given class of functions possibly discontinuous in their first derivative, and another for comparing two such classes. The fundamental tool is an approximation of the elements of these classes by more regular functions, which leads to asymptotic properties of estimators based on the least squares estimator of the unknown parameters. We point out that Neubauer and Zwanzig (1995) have obtained interesting results for connected subjects by using the same technique of approximation. Received: February 1996     

Multivariate regression models for panel data

The paper examines the relationship between heterogeneity bias and strict exogeneity in a distributed lag regression of y on x. The relationship is very strong when x is continuous, weaker when x is discrete, and non-existent as the order of the distributed lag becomes infinite. The individual specific random variables introduce nonlinearity and heteroskedasticity; so the paper provides an appropriate framework for the estimation of multivariate linear predictors. Restrictions are imposed using a minimum distance estimator. It is generally more efficient than the conventional estimators such as quasi-maximum likelihood. There are computationally simple generalizations of two- and three-stage least squares that achieve this efficiency gain. Some of these ideas are illustrated using the sample of Young Men in the National Longitudinal Survey. The paper reports regressions on the leads and lags of variables measuring union coverage, SMSA, and region. The results indicate that the leads and lags could have been generated just by a random intercept. This gives some support for analysis of covariance type estimates; these estimates indicate a substantial heterogeneity bias in the union, SMSA, and region coefficients.     

Empirical likelihood for high-dimensional linear regression models

High-dimensional data are becoming prevalent, and many new methodologies and accompanying theories for high-dimensional data analysis have emerged in response. Empirical likelihood, as a classical nonparametric method of statistical inference, has proved to possess many good features. In this paper, our focus is to investigate the asymptotic behavior of empirical likelihood for regression coefficients in high-dimensional linear models. We give regularity conditions under which the standard normal calibration of empirical likelihood is valid in high dimensions. Both random and fixed designs are considered. Simulation studies are conducted to check the finite sample performance.     

Finite sample inference for quantile regression models

Under minimal assumptions, finite sample confidence bands for quantile regression models can be constructed. These confidence bands are based on the “conditional pivotal property” of estimating equations that quantile regression methods solve and provide valid finite sample inference for linear and nonlinear quantile models with endogenous or exogenous covariates. The confidence regions can be computed using Markov Chain Monte Carlo (MCMC) methods. We illustrate the finite sample procedure through two empirical examples: estimating a heterogeneous demand elasticity and estimating heterogeneous returns to schooling. We find pronounced differences between asymptotic and finite sample confidence regions in cases where the usual asymptotics are suspect.     

A consistent estimator for nonlinear regression models

In this paper an estimator for the general (nonlinear) regression model with random regressors is studied which is based on the Fourier transform of a certain weight function. Consistency and asymptotic normality of the estimator are established and simulation results are presented to illustrate the theoretical ones.Supported by the Hungarian National Science Foundation OTKA under Grants No. F 032060/2000 and F 046061/2004 and by the Bolyai Grant of the Hungarian Academy of Sciences.Received October 2003     

Conditional empirical likelihood for quantile regression models

In this paper, we propose a new Bayesian quantile regression estimator using conditional empirical likelihood as the working likelihood function. We show that the proposed estimator is asymptotically efficient and the confidence interval constructed is asymptotically valid. Our estimator has low computation cost since the posterior distribution function has explicit form. The finite sample performance of the proposed estimator is evaluated through Monte Carlo studies.     

The generalized ridge estimator and improved adjustments for regression parameters

Summary The generalized ridge estimator, which considers generalizations of mean square error, is presented, and a mathematical rule of determining the optimalk-value is discussed. The generalized ridge estimator is examined in comparison with the least squares, the pseudoinverse, theJames-Stein-type shrinkage, and the principal component estimators, especially focusing their attention on improved adjustments for regression coefficients. An alternative estimation approach that better integrates a priori information is noted. Finally, combining the generalized ridge and robust regression methods is suggested.     

Exact permutation tests for non-nested non-linear regression models

This paper proposes exact distribution-free permutation tests for the specification of a non-linear regression model against one or more possibly non-nested alternatives. The new tests may be validly applied to a wide class of models, including models with endogenous regressors and lag structures. These tests build on the well-known J test developed by Davidson and MacKinnon [1981. Several tests for model specification in the presence of alternative hypotheses. Econometrica 49, 781–793] and their exactness holds under broader assumptions than those underlying the conventional J test. The J-type test statistics are used with a randomization or Monte Carlo resampling technique which yields an exact and computationally inexpensive inference procedure. A simulation experiment confirms the theoretical results and also shows the performance of the new procedure under violations of the maintained assumptions. The test procedure developed is illustrated by an application to inflation dynamics.     

Quantile regression methods for recursive structural equation models

Two classes of quantile regression estimation methods for the recursive structural equation models of Chesher [2003. Identification in nonseparable models. Econometrica 71, 1405–1441.] are investigated. A class of weighted average derivative estimators based directly on the identification strategy of Chesher is contrasted with a new control variate estimation method. The latter imposes stronger restrictions achieving an asymptotic efficiency bound with respect to the former class. An application of the methods to the study of the effect of class size on the performance of Dutch primary school students shows that (i) reductions in class size are beneficial for good students in language and for weaker students in mathematics, (ii) larger classes appear beneficial for weaker language students, and (iii) the impact of class size on both mean and median performance is negligible.     

Specification testing for regression models with dependent data

We examine a consistent test for the correct specification of a regression function with dependent data. The test is based on the supremum of the difference between the parametric and nonparametric estimates of the regression model. Rather surprisingly, the behaviour of the test depends on whether the regressors are deterministic or stochastic. In the former situation, the normalization constants necessary to obtain the limiting Gumbel distribution are data dependent and difficult to estimate, so it may be difficult to obtain valid critical values, whereas, in the latter, the asymptotic distribution may not be even known. Because of that, under very mild regularity conditions, we describe a bootstrap analogue for the test, showing its asymptotic validity and finite sample behaviour in a small Monte-Carlo experiment.     

On the backfitting algorithm for additive regression models

We analyse additive regression model fitting via the backfitting algorithm. We show that in the case of a large class of curve estimators, which includes regressograms, simple step-by-step formulae can be given for the back-fitting algorithm. The result of each cycle of the algorithm may be represented succinctly in terms of a sequence of d projections in n-dimensional space, where d is the number of design coordinates and n is sample size. It follows from our formulae that the limit of the algorithm is simply the projection of the data onto that vector space which is orthogonal to the space of all n-vectors fixed by each of the projections. The formulae also provide the convergence rate of the algorithm, the variance of the backfitting estimator, consistency of the estimator, and the relationship of the estimator to that obtained by directly minimizing mean squared distance.     

Optimal and robust designs for trigonometric regression models

This article presents discussions on the optimal and robust designs for trigonometric regression models under different optimality criteria. First, we investigate the classical Q-optimal designs for estimating the response function in a full trigonometric regression model with a given order. The equivalencies of Q-, A-, and G-optimal designs for trigonometric regression in general are also articulated. Second, we study minimax designs and their implementation in the case of trigonometric approximation under Q-, A-, and D-optimality. Then, We indicate the existence of the symmetric designs that are D-optimal minimax designs for general trigonometric regression models, and prove the existence of the symmetric designs that are Q- or A-optimal minimax designs for two particular trigonometric regression models under certain conditions.     

Estimation under linear regression models

Summary Royall and Herson considered balanced samples for ensuring robustness of standard ratio estimator under polynomial superpopulation models. Here we formulate a post-sample estimator of Royall type which remains robust (in respect of bias) under a wide class of polynomial regression models.     

Multimodality in GARCH regression models

It is shown empirically that mixed autoregressive moving average regression models with generalized autoregressive conditional heteroskedasticity (Reg-ARMA-GARCH models) can have multimodality in the likelihood that is caused by a dummy variable in the conditional mean. Maximum likelihood estimates at the local and global modes are investigated and turn out to be qualitatively different, leading to different model-based forecast intervals. In the simpler GARCH(p,q) regression model, we derive analytical conditions for bimodality of the corresponding likelihood. In that case, the likelihood is symmetrical around a local minimum. We propose a solution to avoid this bimodality.