Significance levels of linear rank tests using Edgeworth expansions

We study one aspect of applying Edgeworth expansions to linear rank statistics. Since the use of such expansions is often recommended already for moderate sample sizes we investigate for this case the gain of accuracy for the level of significance of some linear rank tests when their critical values are derived from an Edgeworth expansion instead of from a normal approximation. We verify Does' conditions (1983) for the validity of the expansions for four rank statistics of general interest and show by a numerical study that an Edge-worth expansion does not outperform the normal approximation in all situations. A considerable improvement shows up however for the Klotz test at the 5% level.     

On Tests for a Normal Mean with Known Coefficient of Variation

Hinkley (1977) derived two tests for testing the mean of a normal distribution with known coefficient of variation (c.v.) for right alternatives. They are the locally most powerful (LMP) and the conditional tests based on the ancillary statistic for μ. In this paper, the likelihood ratio (LR) and Wald tests are derived for the one‐ and two‐sided alternatives, as well as the two‐sided version of the LMP test. The performances of these tests are compared with those of the classical t, sign and Wilcoxon signed rank tests. The latter three tests do not use the information on c.v. Normal approximation is used to approximate the null distribution of the test statistics except for the t test. Simulation results indicate that all the tests maintain the type‐I error rates, that is, the attained level is close to the nominal level of significance of the tests. The power functions of the tests are estimated through simulation. The power comparison indicates that for one‐sided alternatives the LMP test is the best test whereas for the two‐sided alternatives the LR or the Wald test is the best test. The t, sign and Wilcoxon signed rank tests have lower power than the LMP, LR and Wald tests at various alternative values of μ. The power difference is quite large in several simulation configurations. Further, it is observed that the t, sign and Wilcoxon signed rank tests have considerably lower power even for the alternatives which are far away from the null hypothesis when the c.v. is large. To study the sensitivity of the tests for the violation of the normality assumption, the type I error rates are estimated on the observations of lognormal, gamma and uniform distributions. The newly derived tests maintain the type I error rates for moderate values of c.v.     

Stratified studies about risk ratios in 2 × 2 tables with structural zero

Incomplete correlated 2 × 2 tables are common in some infectious disease studies and two‐step treatment studies in which one of the comparative measures of interest is the risk ratio (RR). This paper investigates the two‐stage tests of whether K RRs are homogeneous and whether the common RR equals a freewill constant. On the assumption that K RRs are equal, this paper proposes four asymptotic test statistics: the Wald‐type, the logarithmic‐transformation‐based, the score‐type and the likelihood ratio statistics to test whether the common RR equals a prespecified value. Sample size formulae based on hypothesis testing method and confidence interval method are proposed in the second stage of test. Simulation results show that sample sizes based on the score‐type test and the logarithmic‐transformation‐based test are more accurate to achieve the predesigned power than those based on the Wald‐type test. The score‐type test performs best of the four tests in terms of type I error rate. A real example is used to illustrate the proposed methods.     

Rank tests and random blocking of classified data

From the literature on nonparametric rank tests, limiting distributions of Wilcoxon's test tor symmetry and ot Friedman's test for treatment effect are known for observations that are classified in blocks. It is assumed that there is no interaction between blocks and treatments. In the case of fixed blocks this assumption is quite reasonable, in the case of random blocks it is not, as the presence of a random interaction does not make testing for treatment effect superfluous. For classified, categorical data in random blocks the limiting distribution will be derived in this paper of Wilcoxon's rank test in a model which includes a random interaction between blocks and treatments.
An illustration is given by some data from a judgement comparison experiment for the image quality of Video Long Play discs.     

Nonparametric methods for paired samples

The small sample and asymptotic properties of nonparametric tests for paired sampled are examined. Linear rank statistics are compared with the paired t-test and the Wilcoxon-signed-rank test in simulation studies. From a minimax point of view the linear rank statistics turn out to be the best. Moreover, it is illustrated that the Wilcoxon-signed-rank test should not be used if it is not clear that the differences of the pairs have a symmetric distribution.     

Exact linear rank tests for two‐sample equivalence problems with continuous data

The present paper introduces a methodology for the semiparametric or non‐parametric two‐sample equivalence problem when the effects are specified by statistical functionals. The mean relative risk functional of two populations is given by the average of the time‐dependent risk. This functional is a meaningful non‐parametric quantity, which is invariant under strictly monotone transformations of the data. In the case of proportional hazard models, the functional determines just the proportional hazard risk factor. It is shown that an equivalence test of the type of the two‐sample Savage rank test is appropriate for this functional. Under proportional hazards, this test can be carried out as an exact level α test. It also works quite well under other semiparametric models. Similar results are presented for a Wilcoxon rank‐sum test for equivalence based on the Mann–Whitney functional given by the relative treatment effect.     

Type I error and test power of different tests for testing interaction effects in factorial experiments

A simulation study was conducted to investigate the effect of non normality and unequal variances on Type I error rates and test power of the classical factorial anova F‐test and different alternatives, namely rank transformation procedure (FR), winsorized mean (FW), modified mean (FM) and permutation test (FP) for testing interaction effects. Simulation results showed that as long as no significant deviation from normality and homogeneity of the variances exists, generally all of the tests displayed similar results. However, if there is significant deviation from the assumptions, the other tests are observed to be affected at considerably high levels except FR and FP tests. As a result, when the assumptions of factorial anova F‐test are not met or, in the case those assumptions are not tested whether met, it can be concluded that using FR and FP tests is more suitable than the classical factorial anova F‐test.     

RANK TESTS IN 2X2 DESIGNS

Abstract. In literature numerous attempts can be found for the evaluation of two factor designs with fixed effects by means of rank tests. The aim of the present article is to show the limits of these methods and to give some new procedures for 2X2 designs. First, functionals of distribution functions shall be defined whose relations to the usual parameters of the linear model are analysed. These functionals are free of nuissance parameters under the respective hypothesis; they are estimated by special ranks of the data. The asymptotic distribution of these statistics is derived by a generalization of the Chemoff–Savage theorem for correlated random variables. The asymptotic variance depends on the parent distribution function but it can be estimated by using special rank methods. Thus, one obtains asymptotically distribution–free tests for two–factor designs with fixed effects. Some counter examples show why it is not possible to construct suitable rank tests for greater designs than the 2X2 design. The paper closes with a discussion of the drawbacks of the well known rank transform.     

A generalization of Friedman's rank statistic

Abstract  In this paper a very natural generalization of the two-way analysis of variance rank statistic of F riedman is given. The general distribution-free test procedure based on this statistic for the effect of J treatments in a random block design can be applied in general two-way layouts without interactions and with different numbers of the continuous observations per cell provided the design scheme is connected. The asymptotic distribution under the null hypothesis of the test statistic is derived. A comparison with the method of m rankings of B enard and van E lteren is made. The disadvantage of B enard and van E lteren's test procedure is that the number of observations per block does influence the statistic twice, namely firstly by the number itself, as it should, and see ondly by the level of the ranks which will be different in different blocks if the numbers of observations per block are different. The proposed test statistic is not sensitive to differences in the levels of the ranks caused by the different numbers of observations per block. The test is derived from considerhg the K ruskal -W allis statistics per block.
Finally, the results of simulation experiments are given. The simulation is carried out for three designs and a number of normal location alternatives and gives some information about the power of the suggested test procedure. A comparison is made with B enard and van E lteren's test and with the classical analysis of variance technique. For some simple orthogonal designs the exact null distributions of B enard and van E lteren's test and the proposed test are compared.     

Testing forecast accuracy of expectiles and quantiles with the extremal consistent loss functions

Forecast evaluations aim to choose an accurate forecast for making decisions by using loss functions. However, different loss functions often generate different ranking results for forecasts, which complicates the task of comparisons. In this paper, we develop statistical tests for comparing performances of forecasting expectiles and quantiles of a random variable under consistent loss functions. The test statistics are constructed with the extremal consistent loss functions of Ehm et al. (2016). The null hypothesis of the tests is that a benchmark forecast at least performs equally well as a competing one under all extremal consistent loss functions. It can be shown that if such a null holds, the benchmark will also perform at least equally well as the competitor under all consistent loss functions. Thus under the null, when different consistent loss functions are used, the result that the competitor does not outperform the benchmark will not be altered. We establish asymptotic properties of the proposed test statistics and propose to use the re-centered bootstrap to construct their empirical distributions. Through simulations, we show that the proposed test statistics perform reasonably well. We then apply the proposed method to evaluations of several different forecast methods.     

A Comparison of Sequential and Information‐based Methods for Determining the Co‐integration Rank in Heteroskedastic VAR Models

In this article, we investigate the behaviour of a number of methods for estimating the co‐integration rank in VAR systems characterized by heteroskedastic innovation processes. In particular, we compare the efficacy of the most widely used information criteria, such as Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) , with the commonly used sequential approach of Johansen [Likelihood‐based Inference in Cointegrated Vector Autoregressive Models (1996)] based around the use of either asymptotic or wild bootstrap‐based likelihood ratio type tests. Complementing recent work done for the latter in Cavaliere, Rahbek and Taylor [Econometric Reviews (2014) forthcoming], we establish the asymptotic properties of the procedures based on information criteria in the presence of heteroskedasticity (conditional or unconditional) of a quite general and unknown form. The relative finite‐sample properties of the different methods are investigated by means of a Monte Carlo simulation study. For the simulation DGPs considered in the analysis, we find that the BIC‐based procedure and the bootstrap sequential test procedure deliver the best overall performance in terms of their frequency of selecting the correct co‐integration rank across different values of the co‐integration rank, sample size, stationary dynamics and models of heteroskedasticity. Of these, the wild bootstrap procedure is perhaps the more reliable overall as it avoids a significant tendency seen in the BIC‐based method to over‐estimate the co‐integration rank in relatively small sample sizes.     

Local asymptotic normality for randomly censored models with applications to rank tests

For randomly right censored models we study the asymptotic behaviour of linear (rank) statistics under local alternatives. The results can be used to evaluate the asymptotic power of the corresponding tests. For instance we treat the question how to choose the best scores in order to derive asymptotically optimal (rank) tests under certain alternatives.     

VARIANCE-RATIO TESTS OF RANDOM WALK: AN OVERVIEW

Abstract.  This paper reviews the recent developments in the field of the variance-ratio (VR) tests of the random walk and martingale hypothesis. In particular, we present the conventional individual and multiple VR tests as well as their improved modifications based on power-transformed statistics, rank and sign tests, subsampling and bootstrap methods, among others. We also re-examine the weak-form efficiency for five emerging equity markets in Latin America.     

A comment on Mendeş and Yiğit (2013), ‘Type I error and test power of different tests for testing interaction effects in factorial experiments’, Statistica Neerlandica, 67:1–26

In their advocacy of the rank‐transformation (RT) technique for analysis of data from factorial designs, Mende? and Yi?it (Statistica Neerlandica, 67, 2013, 1–26) missed important analytical studies identifying the statistical shortcomings of the RT technique, the recommendation that the RT technique not be used, and important advances that have been made for properly analyzing data in a non‐parametric setting. Applied data analysts are at risk of being misled by Mende? and Yi?it, when statistically sound techniques are available for the proper non‐parametric analysis of data from factorial designs. The appropriate methods express hypotheses in terms of normalized distribution functions, and the test statistics account for variance heterogeneity.     

Analysis of Divergence in Loglinear Models When Expected Frequencies are Subject to Linear Constraints

Consider the loglinear model for categorical data under the assumption of multinomial sampling. We are interested in testing between various hypotheses on the parameter space when we have some hypotheses relating to the parameters of the models that can be written in terms of constraints on the frequencies. The usual likelihood ratio test, with maximum likelihood estimator for the unspecified parameters, is generalized to tests based on -divergence statistics, using minimum -divergence estimator. These tests yield the classical likelihood ratio test as a special case. Asymptotic distributions for the new -divergence test statistics are derived under the null hypothesis.     

The Flexible Fourier Form and Local Generalised Least Squares De‐trended Unit Root Tests*

In two recent papers Enders and Lee (2009) and Becker, Enders and Lee (2006) provide Lagrange multiplier and ordinary least squares de‐trended unit root tests, and stationarity tests, respectively, which incorporate a Fourier approximation element in the deterministic component. Such an approach can prove useful in providing robustness against a variety of breaks in the deterministic trend function of unknown form and number. In this article, we generalize the unit root testing procedure based on local generalized least squares (GLS) de‐trending proposed by Elliott, Rothenberg and Stock (1996) to allow for a Fourier approximation to the unknown deterministic component in the same way. We show that the resulting unit root tests possess good finite sample size and power properties and the test statistics have stable non‐standard distributions, despite the curious result that their limiting null distributions exhibit asymptotic rank deficiency.     

Precedence-type tests based on record values

Precedence-type tests based on order statistics are simple and efficient nonparametric tests that are very useful in the context of life-testing, and they have been studied quite extensively in the literature; see Balakrishnan and Ng (Precedence-type tests and applications. Wiley, Hoboken, 2006). In this paper, we consider precedence-type tests based on record values and develop specifically record precedence test, record maximal precedence test and record-rank-sum test. We derive their exact null distributions and tabulate some critical values. Then, under the general Lehmann alternative, we derive the exact power functions of these tests and discuss their power under the location-shift alternative. We also establish that the record precedence test is the uniformly most powerful test for testing against the one-parameter family of Lehmann alternatives. Finally, we discuss the situation when we have insufficient number of records to apply the record precedence test and then make some concluding remarks.     

Testing cointegration relationship in a semiparametric varying coefficient model

In this paper, we develop two cointegration tests for two varying coefficient cointegration regression models, respectively. Our test statistics are residual based. We derive the asymptotic distributions of test statistics under the null hypothesis of cointegration and show that they are consistent against the alternative hypotheses. We also propose a wild bootstrap procedure companioned with the continuous moving block bootstrap method proposed in  Paparoditis and Politis (2001) and  Phillips (2010) to rectify severe distortions found in simulations when the sample size is small. We apply the proposed test statistic to examine the purchasing power parity (PPP) hypothesis between the US and Canada. In contrast to the existing results from linear cointegration tests, our varying coefficient cointegration test does not reject that PPP holds between the US and Canada.     

主成分综合评价法的误区识别及其改进

大部分基于主成分分析的综合评价忽略了该方法排名结果不唯一的问题。本文通过理论证明了用多个主成分加权综合得到的指标进行排序一定是不可取的,进一步给出了用第一主成分进行综合评价的限制条件,指出了该评价法的存在误区的本质原因,使其应用更加规范和合理。在此基础上提出一种基于非线性投影的对数主成分评价法,改进了传统主成分分析的“线性化”约束,并从理论基础、几何意义和适用范围等方面阐述了本算法,还对2012年联合国人类发展指数的各评价方法进行分析和对比,验证了该方法的合理性和有效性。     

Modified CADF and CIPS Panel Unit Root Statistics with Standard Chi‐squared and Normal Limiting Distributions

In an influential paper Pesaran (‘A simple panel unit root test in presence of cross‐section dependence’, Journal of Applied Econometrics, Vol. 22, pp. 265–312, 2007) proposes two unit root tests for panels with a common factor structure. These are the CADF and CIPS test statistics, which are amongst the most popular test statistics in the literature. One feature of these statistics is that their limiting distributions are highly non‐standard, making for relatively complicated implementation. In this paper, we take this feature as our starting point to develop modified CADF and CIPS test statistics that support standard chi‐squared and normal inference.