The analysis of unbalanced linear models with variance components

Statistical inference for fixed effects, random effects and components of variance in an unbalanced linear model with variance components will be discussed. Variance components will be estimated by Restricted Maximum Likelihood. Iterative procedures for computing the estimates, such as Fisher scoring and the EM-algorithm, are described.     

Linear programming-based estimators in simple linear regression

In this paper we introduce a linear programming estimator (LPE) for the slope parameter in a constrained linear regression model with a single regressor. The LPE is interesting because it can be superconsistent in the presence of an endogenous regressor and, hence, preferable to the ordinary least squares estimator (LSE). Two different cases are considered as we investigate the statistical properties of the LPE. In the first case, the regressor is assumed to be fixed in repeated samples. In the second, the regressor is stochastic and potentially endogenous. For both cases the strong consistency and exact finite-sample distribution of the LPE is established. Conditions under which the LPE is consistent in the presence of serially correlated, heteroskedastic errors are also given. Finally, we describe how the LPE can be extended to the case with multiple regressors and conjecture that the extended estimator is consistent under conditions analogous to the ones given herein. Finite-sample properties of the LPE and extended LPE in comparison to the LSE and instrumental variable estimator (IVE) are investigated in a simulation study. One advantage of the LPE is that it does not require an instrument.     

Empirical likelihood for high-dimensional linear regression models

High-dimensional data are becoming prevalent, and many new methodologies and accompanying theories for high-dimensional data analysis have emerged in response. Empirical likelihood, as a classical nonparametric method of statistical inference, has proved to possess many good features. In this paper, our focus is to investigate the asymptotic behavior of empirical likelihood for regression coefficients in high-dimensional linear models. We give regularity conditions under which the standard normal calibration of empirical likelihood is valid in high dimensions. Both random and fixed designs are considered. Simulation studies are conducted to check the finite sample performance.     

Asymptotic behavior for S-estimators in random design linear model with long-range-dependent errors

The asymptotic behavior of S-estimators in a random design linear model with long-range-dependent Gaussian errors is considered. It turns out that the S-estimators of regression parameter and error variance are strongly consistent under mild conditions. Furthermore, the asymptotic distribution of the S-estimator of regression parameter is normal if the design vectors are i.i.d. and is non-normal if the design vectors are long-range dependent Gaussian vectors. We also show that the asymptotic distribution of S-estimator of the error variance is non-normal since the errors are long-range dependent. Supported by National Natural Science Foundation of China (Grant No. 10571159) and Specialized Research Fund for the Doctor Program of Higher Education (Grant No. 2002335090).     

A simple approach for the analysis of generalizea linear mixed models

A broad class of generalized linear mixed models, e.g. variance components models for binary data, percentages or count data, will be introduced by incorporating additional random effects into the linear predictor of a generalized linear model structure. Parameters are estimated by a combination of quasi-likelihood and iterated MINQUE (minimum norm quadratic unbiased estimation), the latter being numerically equivalent to REML (restricted, or residual, maximum likelihood). First, conditional upon the additional random effects, observations on a working variable and weights are derived by quasi-likelihood, using iteratively re-weighted least squares. Second, a linear mixed model is fitted to the working variable, employing the weights for the residual error terms, by iterated MINQUE. The latter may be regarded as a least squares procedure applied to squared and product terms of error contrasts derived from the working variable. No full distributional assumptions are needed for estimation. The model may be fitted with standardly available software for weighted regression and REML.     

The impact of purchasing power parity on auto foreign trade

In this study, the validity of the assumption saying that the import and export are a function of prices as in the classical, neo-classical approaches is studied within the framework of the import and export of automobile vehicles between 1997 and 2003 in Turkey and the EU countries which are automobile manufacturers. The price here is considered as the purchasing power parity. The effect of the purchasing power parity on the automobile import and export is determined by using classical models with constant coefficients, and fixed and random effects models with constant slope coefficients and a constant term differing according to units and/or time. The models comprise balanced linear panel data models. The likelihood ratio test and F-test are used in the selection of fixed effects and classical models; and the Lagrange multiplier test is used in the selection of random effects and classical models. As for the selection of fixed and random effects models, the Hausman test is used. As a result of these tests, the fixed effects models covering both individual and time effects are selected as the most appropriate import and export models.     

Testing a linear dynamic panel data model against nonlinear alternatives

The most popular econometric models in the panel data literature are the class of linear panel data models with unobserved individual- and/or time-specific effects. The consistency of parameter estimators and the validity of their economic interpretations as marginal effects depend crucially on the correct functional form specification of the linear panel data model. In this paper, a new class of residual-based tests is proposed for checking the validity of dynamic panel data models with both large cross-sectional units and time series dimensions. The individual and time effects can be fixed or random, and panel data can be balanced or unbalanced. The tests can detect a wide range of model misspecifications in the conditional mean of a dynamic panel data model, including functional form and lag misspecification. They check a large number of lags so that they can capture misspecification at any lag order asymptotically. No common alternative is assumed, thus allowing for heterogeneity in the degrees and directions of functional form misspecification across individuals. Thanks to the use of panel data with large $N$ and $T$, the proposed nonparametric tests have an asymptotic normal distribution under the null hypothesis without requiring the smoothing parameters to grow with the sample sizes. This suggests better nonparametric asymptotic approximation for the panel data than for time series or cross sectional data. This is confirmed in a simulation study. We apply the new tests to test linear specification of cross-country growth equations and found significant nonlinearities in mean for OECD countries’ growth equation for annual and quintannual panel data.     

Panel estimators and the identification of firm-specific efficiency levels in parametric,semiparametric and nonparametric settings

The paper analyzes a number of competing approaches to modeling efficiency in panel studies. The specifications considered include the fixed effects stochastic frontier, the random effects stochastic frontier, the Hausman–Taylor random effects stochastic frontier, and the random and fixed effects stochastic frontier with an AR(1) error. I have summarized the foundations and properties of estimators that have appeared elsewhere and have described the model assumptions under which each of the estimators have been developed. I discuss parametric and nonparametric treatments of time varying efficiency including the Battese–Coelli estimator and linear programming approaches to efficiency measurement. Monte Carlo simulation is used to compare the various estimators and to assess their relative performances under a variety of misspecified settings. A brief illustration of the estimators is conducted using U.S. banking data.     

The analysis of proportions in agricultural experiments by a generalized linear mixed model

This paper is concerned with the statistical analysis of proportions involving extra-binomial variation. Extra-binomial variation is inherent to experimental situations where experimental units are subject to some source of variation, e.g. biological or environmental variation. A generalized linear model for proportions does not account for random variation between experimental units. In this paper an extended version of the generalized linear model is discussed with special reference to experiments in agricultural research. In this model it is assumed that both treatment effects and random contributions of plots are part of the linear predictor. The methods are applied to results from two agricultural experiments.     

Quasi-likelihood inference in a generalized linear mixed model for balanced data

For modelling the effect of crossed, fixed factors on the response variable in balanced designs with nested stratifications, a generalized linear mixed model is proposed. This model is based on a set of quasi-likelihood assumptions which imply quadratic variance functions. From these variance functions, deviances are obtained to quantify the variation per stratification. The effects of the fixed factors will be tested, an dispersion components will be estimated. The practical use of the model is illustrated by reanalysing a soldering failures problem.     

Randomized response: Estimating mean square errors of linear estimators and finding optimal unbiased strategies

Summary General procedures are described to generate quantitative randomized response (RR) required to estimate the finite population total of a sensitive variable. Permitting sample selection with arbitrary probabilities a formula for the mean square error (MSE) of a linear estimator of total based on RR is noted indicating the simple modification over one that might be based on direct response (DR) if the latter were available. A general formula for an unbiased estimator of the MSE is presented. A simple approximation is proposed in case the RR ratio estimator is employed based on a simple random sample (SRS) taken without replacement (WOR). Among sampling strategies employing unbiased but not necessarily linear estimators based on RR, certain optimal ones are identified under two alternative models analogously to well-known counterparts based on DR, if available. Unlike Warner’s (1965) treatment of categorical RR we consider quantitative RR here.     

Canonical forms and tests of hypotheses Part II: Multivariate mixed linear models

Abstract  In the literature on multivariate analysis of variance, exact test procedures are restricted to linear models with fixed effects only. In this paper tests are presented for multivarite linear hypotheses with respect to mixed models, which constitude a generalization of (univariate) regular models described by R oebruck (1982). Furthermore it is shown, that the matrices, which are used to compute the test statistics, can be derived from the univariate "sums of squares" in the same manner as in the case of fixed models. The applicability of this theory is demonstrated by two examples.     

Random Effects Misspecification Can Have Severe Consequences for Random Effects Inference in Linear Mixed Models

There has been considerable and controversial research over the past two decades into how successfully random effects misspecification in mixed models (i.e. assuming normality for the random effects when the true distribution is non‐normal) can be diagnosed and what its impacts are on estimation and inference. However, much of this research has focused on fixed effects inference in generalised linear mixed models. In this article, motivated by the increasing number of applications of mixed models where interest is on the variance components, we study the effects of random effects misspecification on random effects inference in linear mixed models, for which there is considerably less literature. Our findings are surprising and contrary to general belief: for point estimation, maximum likelihood estimation of the variance components under misspecification is consistent, although in finite samples, both the bias and mean squared error can be substantial. For inference, we show through theory and simulation that under misspecification, standard likelihood ratio tests of truly non‐zero variance components can suffer from severely inflated type I errors, and confidence intervals for the variance components can exhibit considerable under coverage. Furthermore, neither of these problems vanish asymptotically with increasing the number of clusters or cluster size. These results have major implications for random effects inference, especially if the true random effects distribution is heavier tailed than the normal. Fortunately, simple graphical and goodness‐of‐fit measures of the random effects predictions appear to have reasonable power at detecting misspecification. We apply linear mixed models to a survey of more than 4 000 high school students within 100 schools and analyse how mathematics achievement scores vary with student attributes and across different schools. The application demonstrates the sensitivity of mixed model inference to the true but unknown random effects distribution.     

Simultaneous optimal estimation in linear mixed models

Simultaneous optimal estimation in linear mixed models is considered. A necessary and sufficient condition is presented for the least squares estimator of the fixed effects and the analysis of variance estimator of the variance components to be of uniformly minimum variance simultaneously in a general variance components model. That is, the matrix obtained by orthogonally projecting the covariance matrix onto the orthogonal complement space of the column space of the design matrix is symmetric, each eigenvalue of the matrix is a linear combinations of the variance components and the number of all distinct eigenvalues of the matrix is equal to the the number of the variance components. Under this condition, uniformly optimal unbiased tests and uniformly most accurate unbiased confidence intervals are constructed for the parameters of interest. A necessary and sufficient condition is also given for the equivalence of several common estimators of variance components. Two examples of their application are given.     

Asymptotic distribution for products of sums under dependence

The product of partial sums of linear positive (negative) quadrant dependent, positive random variables is asymptotically lognormal. This extends the earlier work on independent, positive random variables [see Rempala and Wegolowski Elect Comm Probab 7:47–54, 2002]. Research supported by National Natural Science Foundation of China (No. 10471126); Research supported by Science Foundation of Zhejiang Provincial Education (No. 20060122).     

Empirically-transformed linear opinion pools

The linear opinion pool (LOP) produces potentially non-Gaussian combination forecast densities. In this paper, we propose a computationally convenient transformation for the LOP to mirror the non-Gaussianity exhibited by the target variable. Our methodology involves a Smirnov transform to reshape the LOP combination forecasts using the empirical cumulative distribution function. We illustrate our empirically transformed opinion pool (EtLOP) approach with an application examining quarterly real-time forecasts for U.S. inflation evaluated on a sample from 1990:1 to 2020:2. EtLOP improves performance by approximately 10% to 30% in terms of the continuous ranked probability score across forecasting horizons.     

Efficiency of iterated WLS in the linear model with completely unknown heteroskedasticity

Iterated weighted least squares (IWLS) is investigated for estimating the regression coefficients in a linear model with symmetrically distributed errors. The variances of the errors are not specified; it is not assumed that they are unknown functions of the explanatory variables nor that they are given in some parametric way.
IWLS is carried out in a random number of steps, of which the first one is OLS. In each step the error variance at time t is estimated with a weighted sum of m squared residuals in the neighbourhood of t and the coefficients are estimated using WLS. Furthermore an estimate of the co-variance matrix is obtained. If this estimate is minimal in some way the iteration process is stopped.
Asymptotic properties of IWLS are derived for increasing sample size n . Some particular cases show that the asymptotic efficiency can be increased by allowing more than two steps. Even asymptotic efficiency with respect to WLS with the true error variances can be obtained if m is not fixed but tends to infinity with n and if the heteroskedasticity is smooth.     

On random fuzzy variables of second order and their application to linear statistical inference with fuzzy data

This paper summarizes some results on random fuzzy variables with existing expectation and variance, called random fuzzy variables of second order. Using the Frechét-principle and – via support functions – the embedding of convex fuzzy sets into a Banach space of functions it especially presents a unified view on expectation and variance of random fuzzy variables. These notions are applied in developing linear statistical inference with fuzzy data. Detailed investigations are presented concerning best linear unbiased estimation in linear regression models with fuzzy observations. Received: November 1999     

Estimating an economic model of crime using panel data from North Carolina

This paper replicates the Cornwell and Trumbull ( 1994 ) estimation of a crime model using panel data on 90 counties in North Carolina over the period 1981–1987. While the Between and Within estimates are replicated, the fixed effects 2SLS as well as the 2SLS estimates are not. In fact, the fixed effects 2SLS estimates turn out to be insignificant for all important deterrent variables as well as legal opportunity variables. We argue that the usual Hausman test, based on the difference between fixed effects and random effects, may lead to misleading inference when endogenous variables of the conventional simultaneous equation type are among the regressors. We estimate the model using random effects 2SLS and perform a Hausman test based on the difference between fixed effects 2SLS and random effects 2SLS. We cannot reject the consistency of the random effects 2SLS estimator and this estimator yields plausible and significant estimates of the crime model. This result should be tempered by the legitimacy of the chosen instruments. Copyright © 2006 John Wiley & Sons, Ltd.     

Efficient estimation and inference in linear pseudo-panel data models

We consider pseudo-panel data models constructed from repeated cross sections in which the number of individuals per group is large relative to the number of groups and time periods. First, we show that, when time-invariant group fixed effects are neglected, the OLS estimator does not converge in probability to a constant but rather to a random variable. Second, we show that, while the fixed-effects (FE) estimator is consistent, the usual t statistic is not asymptotically normally distributed, and we propose a new robust t statistic whose asymptotic distribution is standard normal. Third, we propose efficient GMM estimators using the orthogonality conditions implied by grouping and we provide t tests that are valid even in the presence of time-invariant group effects. Our Monte Carlo results show that the proposed GMM estimator is more precise than the FE estimator and that our new t test has good size and is powerful.