R-estimation of the parameters of a multiple regression model with measurement errors

We consider the theory of R-estimation of the regression parameters of a multiple regression models with measurement errors. Using the standard linear rank statistics, R-estimators are defined and their asymptotic properties are studied as robust alternatives to the least squares estimator. This paper fills the gap of the rank theory for the estimation of regression parameters with measurement error models. Some simulation results are presented to show the effectiveness of the R-estimators.     

Bootstrapping rank statistics

The bootstrap, which provides powerful approximations for many classes of statistics, is studied for simple linear rank statistics employing bounded and smooth score functions. To verify consistency we view a rank statistic as a statistic induced by a statistical functional ψ which is evaluated at a pair of dependent signed measures. Thus, we can apply the von Mises method to verify asymptotic results for the bootstrap. The strong consistency of the bootstrap distribution estimator is derived for the bootstrap based on resampling from the original data. Further, the residual bootstrap is studied. The accuracy of the bootstrap approximations for small sample sizes is studied by simulations. The simulations indicate that the bootstrap provides better results than a normal approximation.     

Significance levels of linear rank tests using Edgeworth expansions

We study one aspect of applying Edgeworth expansions to linear rank statistics. Since the use of such expansions is often recommended already for moderate sample sizes we investigate for this case the gain of accuracy for the level of significance of some linear rank tests when their critical values are derived from an Edgeworth expansion instead of from a normal approximation. We verify Does' conditions (1983) for the validity of the expansions for four rank statistics of general interest and show by a numerical study that an Edge-worth expansion does not outperform the normal approximation in all situations. A considerable improvement shows up however for the Klotz test at the 5% level.     

Nonparametric methods for paired samples

The small sample and asymptotic properties of nonparametric tests for paired sampled are examined. Linear rank statistics are compared with the paired t-test and the Wilcoxon-signed-rank test in simulation studies. From a minimax point of view the linear rank statistics turn out to be the best. Moreover, it is illustrated that the Wilcoxon-signed-rank test should not be used if it is not clear that the differences of the pairs have a symmetric distribution.     

Using orthogonal trend contrasts for testing ranked data with ordered alternatives

In the analysis of variance (Anova ) the use of orthogonal contrasts is quite common and is a traditional topic in many basic Anova courses. Similar ideas apply to rank tests. In this paper we present a simple and general method that allows an orthogonal contrast decomposition of rank test statistics such as the Kruskal‐Wallis, Friedman and Durbin statistics. The components of the test statistics are informative, particularly when ordered alternatives are of interest. The method can handle ties, and null distributions are readily available. Most of the methods are not new, but the way we present them is. Moreover, our formulation makes it easier to better understand and interpret the tests when the traditional location‐shift assumption does not hold. The methods are illustrated using several data sets.     

A survey of two-sample location-scale problem, asymptotic relative efficiencies of some rank tests

Here the parametric as well as the non parametric approach to the two-sample location-scale problem are reviewed. Special attention is paid to the quadratic form of the linear rank statistics for the location and the scale suggested by Lepage for testing this problem. Several such quadratic forms are compared through ARE computations.     

Local asymptotic normality for randomly censored models with applications to rank tests

For randomly right censored models we study the asymptotic behaviour of linear (rank) statistics under local alternatives. The results can be used to evaluate the asymptotic power of the corresponding tests. For instance we treat the question how to choose the best scores in order to derive asymptotically optimal (rank) tests under certain alternatives.     

Een algemene methode tot leemtevulling

An exposition of the missing plot technique often applied in analysis of variance is given in very general terms.
Non-orthogonality mostly implies heavy computations. If the scheme of observations is almost orthogonal this technique, however, supplies in a simple way unbiassed and efficient estimates of the expectation values which occur in a linear hypothesis underlying an analysis of variance. Moreover the correct residual sum of squares required for a test or a confidence interval estimation is obtained without difficulty.
A correct test of an effect or an interaction will be provided by two estimates, the first under the null-hypothesis, the second under the alternative hypothesis. In the case of non-orthogonality this may imply two separate applications of the discussed technique. The difference between the two residual sums of squares will be used for the numerator of a valid F-criterion.
The technique is illustrated by an example.     

RANK TESTS IN 2X2 DESIGNS

Abstract. In literature numerous attempts can be found for the evaluation of two factor designs with fixed effects by means of rank tests. The aim of the present article is to show the limits of these methods and to give some new procedures for 2X2 designs. First, functionals of distribution functions shall be defined whose relations to the usual parameters of the linear model are analysed. These functionals are free of nuissance parameters under the respective hypothesis; they are estimated by special ranks of the data. The asymptotic distribution of these statistics is derived by a generalization of the Chemoff–Savage theorem for correlated random variables. The asymptotic variance depends on the parent distribution function but it can be estimated by using special rank methods. Thus, one obtains asymptotically distribution–free tests for two–factor designs with fixed effects. Some counter examples show why it is not possible to construct suitable rank tests for greater designs than the 2X2 design. The paper closes with a discussion of the drawbacks of the well known rank transform.     

Variance estimation in the change analysis of a linear regression model

We study a “direct test” of Chu and White (1992) proposed for detecting changes in the trend of a linear regression model. The power of this test strongly depends on a suitable estimation of the variance of the error variables involved. We discuss various types of variance estimators and derive their asymptotic properties under the null-hypothesis of “no change” as well as under the alternative of “a change in linear trend”. A small simulation study illustrates the estimators' finite sample behaviour.     

The weighted empirical process of row independent random variables with arbitrary distribution functions

Abstract  The relative compactness and weak convergence of reduced empirical, quantile and weighted empirical processes are demonstrated under mild conditions. For example, the reduced empirical proces of arbitrary independent iv'S is always relatively compact in any ‖ /q ‖ metric with q square integrable; and weak convergence takes place if and only if the covariance function converges. V an Z uijlen's representation of the general empirical process is a fundamental tool. This paper both unifies and extends the previous treatment of these processes - processes that have application to rank statistics and linear combinations of order statistics. Most proofs are contained in Section 3. A brief introduction to weak convergence is presented in the appendix for readers lacking this background. Applications are indicated in Section 4.     

On residuals and their autocorrelations in fitted time series models

Summary When discrete autoregressive-moving average time series are fitted by least squares, both the residuals and their autocorrelations are for large n representable as singular linear transformations of the true errors (or white noise) and their autocomlations, respectively, and the matrices of these transformations arc both of the form I-X(X'X) ^-1X, where the rank of X is the number of parameters estimated. However, the large-sample properties of these two sets of statistics are fundamentally different, a phenomenon which is of considerable importance for the use of the residual autocorrelations in performing tests of fit of these models.     

Generalized reduced rank tests using the singular value decomposition

We propose a novel statistic to test the rank of a matrix. The rank statistic overcomes deficiencies of existing rank statistics, like: a Kronecker covariance matrix for the canonical correlation rank statistic of Anderson [Annals of Mathematical Statistics (1951), 22, 327–351] sensitivity to the ordering of the variables for the LDU rank statistic of Cragg and Donald [Journal of the American Statistical Association (1996), 91, 1301–1309] and Gill and Lewbel [Journal of the American Statistical Association (1992), 87, 766–776] a limiting distribution that is not a standard chi-squared distribution for the rank statistic of Robin and Smith [Econometric Theory (2000), 16, 151–175] usage of numerical optimization for the objective function statistic of Cragg and Donald [Journal of Econometrics (1997), 76, 223–250] and ignoring the non-negativity restriction on the singular values in Ratsimalahelo [2002, Rank test based on matrix perturbation theory. Unpublished working paper, U.F.R. Science Economique, University de Franche-Comté]. In the non-stationary cointegration case, the limiting distribution of the new rank statistic is identical to that of the Johansen trace statistic.     

Three Corrected Score Tests for Generalized Linear Models with Dispersion Covariates

We develop three corrected score tests for generalized linear models with dispersion covariates, thus generalizing the results of Cordeiro , Ferrari and Paula (1993) and Cribari-Neto and Ferrari (1995) . We present, in matrix notation, general formulae for the coefficients which define the corrected statistics. The formulae only require simple operations on matrices and can be used to obtain analytically closed-form corrections for score test statistics in a variety of special generalized linear models with dispersion covariates. They also have advantages for numerical purposes since our formulae are readily computable using a language supporting numerical linear algebra. Two examples, namely, iid sampling without covariates on the mean or dispersion parameter oand one-way classification models, are given. We also present some simulations where the three corrected tests perform better than the usual score test, the likelihood ratio test and its Bartlett corrected version. Finally, we present a numerical example for a data set discussed by Simonoff and Tsai (1994) .     

Optimal weighted average power similar tests for the covariance structure in the linear regression model

This paper suggests a procedure for the construction of optimal weighted average power similar tests for the error covariance matrix of a Gaussian linear regression model when the alternative model belongs to the exponential family. The paper uses a saddlepoint approximation to construct simple test statistics for a large class of problems and overcomes the computational burden of evaluating the complicated integrals arising in the derivation of optimal weighted average power tests. Extensions to panel data models are considered. Applications are given to tests for error autocorrelation in the linear regression model and in a panel data framework.     

Identification in statistical inference

The paper deals with the concept of identification in inferential statistics. At first a general concept of identification is defined and developed. Thereafter, the general theory is applied to univariate linear regression and simultaneous equation systems. Finally, attention is paid to models with lagged variables and some new related problems are suggested.     

Forecasting educational enrolments: Comparison of a Markov chain and circuitless flow network model

Entrants into large complex educational systems typically follow one of many different paths to a successful graduation, transfer-out or drop-out. In contrast to the usual simple Markov chain simulation model employing ‘stock data’, the educational system is presented as a circuitless flow network model employing sub-population student attributes and ‘flow data’. A simple linear model readily projects flow patterns into future grade enrolments. The statistics of a secondary school cohort are used to illustrate the methodologies and contrast the results of the Markov and circuitless flow models.     

KMT-type inequalities and goodness-of-fit tests

The implications of the probability inequality of Komløs, Major and Tusnády (1975) for the theory of goodness-of-fit tests, especially tests based on stochastic integrals with respect to the basic martingale in the random censoring model, are discussed. Choices of the integrand of the stochastic integral which yield highly efficient generalized rank and supremum type tests are given for the simple as well as the composite null hypothesis.     

Competitive On-line Statistics

A radically new approach to statistical modelling, which combines mathematical techniques of Bayesian statistics with the philosophy of the theory of competitive on-line algorithms, has arisen over the last decade in computer science (to a large degree, under the influence of Dawid's prequential statistics). In this approach, which we call "competitive on-line statistics", it is not assumed that data are generated by some stochastic mechanism; the bounds derived for the performance of competitive on-line statistical procedures are guaranteed to hold (and not just hold with high probability or on the average). This paper reviews some results in this area; the new material in it includes the proofs for the performance of the Aggregating Algorithm in the problem of linear regression with square loss.     

Orthogonality Tests in Linear Models

This paper considers several tests of orthogonality conditions in linear models where stochastic errors may be heteroskedastic or autocorrelated. It is shown that these tests can be performed with Wald statistics obtained from simple auxiliary regressions.