Weaker MSE criteria and tests for linear restrictions in regression models with non-spherical disturbances

This paper extend, in an asymptotic sense, the strong and the weaker mean square error criteria and corresponding tests to linear models with non-spherical disturbances where the error covariance matrix is unknown but a consistent estimator for it is available. The mean square error tests of Toro-Vizcorrondo and Wallace (1968) and Wallace (1972) test for the superiority of restricted over unrestricted linear estimators in a least squares context. This generalization of these tests makes them available for use with GLS, Zellner's SUR, 2SLS, 3SLS, tests of over identification, and so forth.     

Rank tests for testing randomness of a regression coefficient in a linear regression model

We propose a class of nonparametric tests for testing non-stochasticity of the regression parameterβ in the regression modely _i =βx _i +ɛ _i ,i=1, ...,n. We prove that the test statistics are asymptotically normally distributed both underH ₀ and under contiguous alternatives. The asymptotic relative efficiencies (in the Pitman sense) with respect to the best parametric test have also been computed and they are quite high. Some simulation studies are carried out to illustrate the results. Research was supported by the University Grants Commission, India.     

Exact inference for the linear model with groupwise heteroscedastic spherical disturbances

Exact nonparametric inference on a single coefficient in a linear regression model, as considered by Bekker (Working Paper, Department of Economics, University of Groningen, 1997), is elaborated for the case of spherically distributed heteroscedastic disturbances. Instead of approximate inference based on feasible weighted least squares, exact inference is formulated based on partial rotational invariance of the distribution of the vector of disturbances. Thus, classical exact inference based on t-statistics is generalized to exact inference that remains valid in a groupwise heteroscedastic context. The approach is applied to a basic two-sample problem, and to the random- and fixed-effects models for panel data.     

Testing a linear regression model against nonparametric alternatives

Summary As a test statistic for testing goodness-of-fit of a linear regression model, we propose a ratio of quadratic forms measuring the distance between parametric and nonparametric fits, relative to the estimated error variance. The test statistic is a modification of the statistic suggested by H?rdle and Mammen (1988). The asymptotic distribution under the hypothesis is established. The finite sample behaviour of the test is investigated in a Monte Carlo study, and is illustrated for two applications.     

Estimation and testing for a partially linear single-index spatial regression model

ABSTRACT

Observations recorded on ‘locations’ usually exhibit spatial dependence. In an effort to take into account both the spatial dependence and the possible underlying non-linear relationship, a partially linear single-index spatial regression model is proposed. This paper establishes the estimators of the unknowns. Moreover, it builds a generalized F-test to determine whether or not the data provide evidence on using linear settings in empirical studies. Their asymptotic properties are derived. Monte Carlo simulations indicate that the estimators and test statistic perform well. The analysis of Chinese house price data shows the existence of both spatial dependence and a non-linear relationship.     

A multiple linear regression model for imprecise information

In standard regression analysis the relationship between the (response) variable and a set of (explanatory) variables is investigated. In the classical framework the response is affected by probabilistic uncertainty (randomness) and, thus, treated as a random variable. However, the data can also be subjected to other kinds of uncertainty such as imprecision. A possible way to manage all of these uncertainties is represented by the concept of fuzzy random variable (FRV). The most common class of FRVs is the LR family (LR FRV), which allows us to express every FRV in terms of three random variables, namely, the center, the left spread and the right spread. In this work, limiting our attention to the LR FRV class, we consider the linear regression problem in the presence of one or more imprecise random elements. The procedure for estimating the model parameters and the determination coefficient are discussed and the hypothesis testing problem is addressed following a bootstrap approach. Furthermore, in order to illustrate how the proposed model works in practice, the results of a real-life example are given together with a comparison with those obtained by applying classical regression analysis.     

Small‐sample testing inference in symmetric and log‐symmetric linear regression models

This paper deals with the issue of testing hypotheses in symmetric and log‐symmetric linear regression models in small and moderate‐sized samples. We focus on four tests, namely, the Wald, likelihood ratio, score, and gradient tests. These tests rely on asymptotic results and are unreliable when the sample size is not large enough to guarantee a good agreement between the exact distribution of the test statistic and the corresponding chi‐squared asymptotic distribution. Bartlett and Bartlett‐type corrections typically attenuate the size distortion of the tests. These corrections are available in the literature for the likelihood ratio and score tests in symmetric linear regression models. Here, we derive a Bartlett‐type correction for the gradient test. We show that the corrections are also valid for the log‐symmetric linear regression models. We numerically compare the various tests and bootstrapped tests, through simulations. Our results suggest that the corrected and bootstrapped tests exhibit type I probability error closer to the chosen nominal level with virtually no power loss. The analytically corrected tests as well as the bootstrapped tests, including the Bartlett‐corrected gradient test derived in this paper, perform with the advantage of not requiring computationally intensive calculations. We present a real data application to illustrate the usefulness of the modified tests.     

Properties of shrinkage estimators in linear regression when disturbances are not normal

This paper considers a class of recently developed biased estimators of regression coefficients and studies its sampling properties when the disturbances are not normally distributed. It has been found that the conditions of dominance of these estimators over the least squares estimator, under non-normality, are quite different than their well-known dominance conditions under normality. Some implications of the results are also discussed.     

Functional partially linear quantile regression model

This paper considers estimation of a functional partially quantile regression model whose parameters include the infinite dimensional function as well as the slope parameters. We show asymptotical normality of the estimator of the finite dimensional parameter, and derive the rate of convergence of the estimator of the infinite dimensional slope function. In addition, we show the rate of the mean squared prediction error for the proposed estimator. A simulation study is provided to illustrate the numerical performance of the resulting estimators.     

Variance estimation in the change analysis of a linear regression model

We study a “direct test” of Chu and White (1992) proposed for detecting changes in the trend of a linear regression model. The power of this test strongly depends on a suitable estimation of the variance of the error variables involved. We discuss various types of variance estimators and derive their asymptotic properties under the null-hypothesis of “no change” as well as under the alternative of “a change in linear trend”. A small simulation study illustrates the estimators' finite sample behaviour.     

Estimation of linear models with nequal restrictions

Inequality constrained regression involves the notion of a truncated parameter space, which was studied extensively by Moors (1985). His general results are extended here and applied to linear models. Using the invariance principle, for every observation x a set V_x is defined with the property that estimators taking values in V_x (with positive probability) are inadmissible. One of the main conclusions is that the usual estimators in inequality constrained regression are inadmissible; a method to obtain better estimators is indicated.     

Efficiency of iterative estimators in the regression model with AR(1) disturbances

The mean square error approximation method of Nagar is applied to the iterated Prais-Winsten and (iterated) maximum likelihood estimators of regression coefficients in the model with AR(1) disturbances. Their mean square errors are found to equal that of the two-stage Prais-Winsten estimator at the second-order level of approximation.     

Generalized Bayes minimax estimators of location vectors for spherically symmetric distributions with residual vector

We consider estimation of the mean vector, $\theta $ , of a spherically symmetric distribution with known scale parameter under quadratic loss and when a residual vector is available. We show minimaxity of generalized Bayes estimators corresponding to superharmonic priors with a non decreasing Laplacian of the form $\pi (\Vert \theta \Vert ^{2})$ , under certain conditions on the generating function $f(\cdot )$ of the sampling distributions. The class of sampling distributions includes certain variance mixtures of normals.     

Testing for autoregressive against moving average errors in the linear regression model

This paper presents a new approach to hypotheses testing problems which are non-nested in the classical sense and which concern the covariance matrix of the disturbance vector of the linear regression model. In particular, the application of the approach to testing for AR(1) disturbances against MA(1) disturbances is explored in some detail. Practical difficulties are discussed and selected upper bounds for the test's five percent significance points are tabulated. The small sample power of four versions of the new test are compared empirically and a clear conclusion is made in regard to the best overall test.     

Identification of linear stochastic models with covariance restrictions

The purpose of this paper is to provide a systematic treatment of the problem of identification in systems of linear structural equations where some of the disturbances are uncorrelated.     

Natural estimation of variances in a general finite discrete spectrum linear regression model

The method of “natural” estimation of variances in a general (orthogonal or nonorthogonal) finite discrete spectrum linear regression model of time series is suggested. Using geometrical language of the theory of projectors a form and properties of the estimators are investigated. Obtained results show that in describing the first and second moment properties of the new estimators the central role plays a matrix known in linear algebra as the Schur complement. Illustrative examples with particular regressors demonstrate direct applications of the results.     

Exact inference in the inequality constrained normal linear regression model

Inference in the inequality constrained normal linear regression model is approached as a problem in Bayesian inference, using a prior that is the product of a conventional uninformative distribution and an indicator function representing the inequality constraints. The posterior distribution is calculated using Monte Carlo numerical integration, which leads directly to the evaluation of expected values of functions of interest. This approach is compared with others that have been proposed. Three empirical examples illustrate the utility of the proposed methods using an inexpensive 32-bit microcomputer.     

Mean square error tests for restrictions in singular linear models

Weak and strong mean square error tests of restrictions presented in Wallace (1972) are generalized to apply to singular linear models. The singularity necessitates a slight change in the strong m.s.e. criterion and the requirement that the restrictions be estimable, but otherwise the tests are applied in a fashion analogous to the non-singular case. Use of those tests implies that the solution for the linear model parameter vector is contingent on a test result. The risk behavior of these contingent solutions is discussed.