Generalized entropies in coding theory

Equivalence of the generalized entropyH ^β (P, Φ _t ) defined in this paper andKapur’s entropy of orderα and typeβ, ie.H _α ^β (P), is established. The results given recently byCampbell follow as special cases. International Conference on System Sciences, Honolulu, January 1968.     

On the power function of the exact test for ther×c contingency table

Summary LetN=[n _ij ] (i=1, …,r;j=1, …,c) be the matrix of observed frequencies in anr×c contingency table fromr possibly different multinomial populations with respective probabilitiesp _i =(p _i1, …,p _ic ).Freeman andHalton have proposed an exact conditional test for the hypothesisH ₀ :p _i =(p ₁, …p _c ) of the exact test is derived. Numerical values forβ(p) were previously computed for the special case:r=3,c=2 [Bennett andNakamura, 1964].     

Ein kombiniertes test & klassifikations-problem

Summary A decision process is considered which consists of two steps: First, a nullhypothesis H₀ is to be tested. If H₀ is rejected, a decision is to be made as to which of the alternative hypotheses H₁, H₂, ... H _k is valid. This second step is called "classification". It is assumed, that in case H₀ is not valid, each of the alternative hypotheses H₁, H₂, ... H _k has the same probability. Starting with this assumption, an optimal decision process is developed which has a specified level of significance α (i.e. by which the nullhypothesis H₀ is accepted with probability α, if it is valid), and for which the probability of a correct classification is a maximum in the case where the nullhypothesis is not valid. This decision process rests on a generalisation of the fundamental lemma of Neyman and Pearson, similar to that used in discriminant analysis.     

Largest excess of boundary crossings for martingales

Summary LetX ₁,X ₂, ... form a sequence of martingale differences and denote byZ(a, α) = sup n (S _n −an ^α)⁺ the largest excess forS _n =X ₁ + ... +X _n crossing the boundaryan ^α. We give a sufficient condition for the finiteness ofEZ(a, α)^β which is formulated in terms of bounds forE(X _i ^{+ p} andE(|X _i |γ|X ₁, ...,X _i-1), whereα, β, γ, p are suitably related. This general result is then applied to the case of independent random variables.     

Rank tests for testing randomness of a regression coefficient in a linear regression model

We propose a class of nonparametric tests for testing non-stochasticity of the regression parameterβ in the regression modely _i =βx _i +ɛ _i ,i=1, ...,n. We prove that the test statistics are asymptotically normally distributed both underH ₀ and under contiguous alternatives. The asymptotic relative efficiencies (in the Pitman sense) with respect to the best parametric test have also been computed and they are quite high. Some simulation studies are carried out to illustrate the results. Research was supported by the University Grants Commission, India.     

Testing whetherF is more IFR thanG

A distributionF is said to be “more IFR” than another distributionG ifG ⁻¹ F is convex. WhenF(0) =G(0) = 0, the problem of testingH ₀ :F(x) =G (θx) for someθ > 0 andx ⩾ 0, against the alternativeH _A:F is more IFR thanG, is considered in this paper. Both cases, whenG is completely specified (one-sample case) and when it is not specified but a random sample form it is available (two-sample case) are considered. The proposed tests are based onU-statistics. The asymptotic relative efficiency of the tests are compared with several other tests and the test statistics remain asymptotically normal under certain dependency assumptions. Research supported in part by a grant from the US Air Force Office of Scientific Research.     

Determination of uniformly most powerful tests in discrete sample spaces

Uniformly most powerful (UMP) tests are known to exist in one-parameter exponential families when the hypothesis H ₀ and the alternative hypothesis H ₁ are given by (i) H ₀ : θ≤θ₀, H ₁ : θ>θ₀, and (ii) H ₀ : θ≤θ₁ or θ≥θ₂, H ₁ : θ₁<θ<θ₂, where θ₁<θ₂.  Likewise, uniformly most powerful unbiased (UMPU) tests do exist when the hypotheses H ₀ and H ₁ take the form (iii) H ₀ : θ₁≤θ≤θ₂, H ₁ : θ<θ₁ or θ>θ₂, where θ₁<θ₂, and (iv) H ₀ : θ=θ₀, H ₁:θ≠θ₀.  To determine tests in case (i), only one critical value c and one randomization constant γ have to be computed. In cases (ii) through (iv) tests are determined by two critical values c ₁, c ₂ and two randomization constants γ₁, γ₂. Unlike determination of tests in case (i), computation of critical values and randomization constants in the remaining cases is rather difficult, unless distributions are symmetric. No straightforward method to determine two-sided UMP tests in discrete sample spaces seems to be known. The purpose of this note is to disclose a distribution independent principle for the determination of UMP tests in cases (ii) through (iv). Received: March 1999     

Two-sample rank tests with truncated populations

LetX ₁,…,X _m andY ₁,…,Y _n be two independent samples from continuous distributionsF andG respectively. Using a Hoeffding (1951) type theorem, we obtain the distributions of the vector S=(S ₍₁₎,…,S _(n)), whereS _(j)=# (X _i ’s≤Y _(j)) andY _(j) is thej-th order statistic ofY sample, under three truncation models: (a)G is a left truncation ofF orG is a right truncation ofF, (b)F is a right truncation ofH andG is a left truncation ofH, whereH is some continuous distribution function, (c)G is a two tail truncation ofF. Exploiting the relation between S and the vectorR of the ranks of the order statistics of theY-sample in the pooled sample, we can obtain exact distributions of many rank tests. We use these to compare powers of the Hajek test (Hajek 1967), the Sidak Vondracek test (1957) and the Mann-Whitney-Wilcoxon test. We derive some order relations between the values of the probagility-functions under each model. Hence find that the tests based onS ₍₁₎ andS _(n) are the UMP rank tests for the alternative (a). We also find LMP rank tests under the alternatives (b) and (c).     

Verbesserung des nicht-randomisierten exakten Testes von R.A. Fisher

Summary The so-called Exact Test of R. A. Fisher for comparing two probabilitiesp ₁ andp ₂ in a Fourfold-Table with small cell frequencies is known as a UMPU-Test. But in practice the test is used in a nonrandomized, often tabulated version. Given a certain level of significanceα it is shown: the critical region of this nonrandomized test, referred to as “Fisher 1”, can be enlarged considerably. For instance for all sample-size-sums up to 20 andα=0.01 the total number of points in the critical regions of “Fisher 1” is 552 whereas the analogous number of the new version “Fisher 2” is 788. The size of tables for “Fisher 2” can be reduced considerably because the main parts of the critical regions can be described by the aid of some Chi-square-test versions. In particular Yates’ continuity-correction turns out to be always conservative in the above mentioned region relative to “Fisher 2” whereas this is not strictly true relative to “Fisher 1”.      

Locally minimax test of independence in elliptically symmetrical distributions with additional observations

Summary LetX=(X _ij )=(X ₁, ...,X _n )’,X’ _i =(X _i1, ...,X _ip )’,i=1,2, ...,n be a matrix having a multivariate elliptical distribution depending on a convex functionq with parameters, 0,σ. Let ϱ²=ϱ ₂ ^-2 be the squared multiple correlation coefficient between the first and the remainingp ₂+p ₃=p−1 components of eachX _i . We have considered here the problem of testingH ₀:ϱ²=0 against the alternativesH ₁:ϱ ₁ ^-2 =0, ϱ ₂ ^-2 >0 on the basis ofX andn ₁ additional observationsY ₁ (n ₁×1) on the first component,n ₂ observationsY ₂(n ₂×p ₂) on the followingp ₂ components andn ₃ additional observationsY ₃(n ₃×p ₃) on the lastp ₃ components and we have derived here the locally minimax test ofH ₀ againstH ₁ when ϱ ₂ ^-2 →0 for a givenq. This test, in general, depends on the choice ofq of the familyQ of elliptically symmetrical distributions and it is not optimality robust forQ.     

A consistent test for multivariate normality based on the empirical characteristic function

LetX ₁,X ₂, …,X _n be independent identically distributed random vectors in IR ^d ,d ⩾ 1, with sample mean and sample covariance matrixS _n. We present a practicable and consistent test for the composite hypothesisH _d: the law ofX ₁ is a non-degenerate normal distribution, based on a weighted integral of the squared modulus of the difference between the empirical characteristic function of the residualsS _n ^−1/2 (X _j − ) and its pointwise limit exp (−1/2|t|²) underH _d. The limiting null distribution of the test statistic is obtained, and a table with critical values for various choices ofn andd based on extensive simulations is supplied.     

On kalman filtering,posterior mode estimation and fisher scoring in dynamic exponential family regression

Summary Dynamic exponential family regression provides a framework for nonlinear regression analysis with time dependent parametersβ ₀,β ₁, …,β _t, …, dimβ _t=p. In addition to the familiar conditionally Gaussian model, it covers e.g. models for categorical or counted responses. Parameters can be estimated by extended Kalman filtering and smoothing. In this paper, further algorithms are presented. They are derived from posterior mode estimation of the whole parameter vector (β′₀, …,β′_t) by Gauss-Newton resp. Fisher scoring iterations. Factorizing the information matrix into block-bidiagonal matrices, algorithms can be given in a forward-backward recursive form where only inverses of “small”p×p-matrices occur. Approximate error covariance matrices are obtained by an inversion formula for the information matrix, which is explicit up top×p-matrices. Heinz Leo Kaufmann, my friend and coauthor for many years, died in a tragical rock climbing accident in August 1989. This paper is dedicated to his memory.     

One optional observation inflates α by $${100/\sqrt{n}}$$ per cent

For one-sample level α tests ψ _m based on independent observations X ₁, . . . , X _m , we prove an asymptotic formula for the actual level of the test rejecting if at least one of the tests ψ _n , . . . , ψ _n+k would reject. For k = 1 and usual tests at usual levels α, the result is approximately summarized by the title of this paper. Our method of proof, relying on some second order asymptotic statistics as developed by Pfanzagl and Wefelmeyer, might also be useful for proper sequential analysis. A simple and elementary alternative proof is given for k = 1 in the special case of the Gauss test.     

On characterizing discrete distributions via conditional expectations of weak record values

Let (W _n ,n ≥ 0) denote the sequence of weak records from a distribution with support S = { α₀,α₁,...,α _N }. In this paper, we consider regression functions of the form ψ _n (x) = E(h(W _n ) |W _n+1 = x), where h(·) is some strictly increasing function. We show that a single function ψ _n (·) determines F uniquely up to F(α₀). Then we derive an inversion formula which enables us to obtain F from knowledge of ψ _n (·), ψ _n-1(·), h(·) and F(α₀).     

Minimax estimators andΓ-minimax estimators for a bounded normal mean under the lossl p (θ, d)=|θ-d|p

Summary Let the random variableX be normal distributed with known varianceσ ²>0. It is supposed that the unknown meanθ is an element of a bounded intervalΘ. The problem of estimatingθ under the loss functionl _p (θ, d)=|θ-d| ^p p≥2 is considered. In case the length of the intervalθ is sufficiently small the minimax estimator and theΓ(β, τ)-minimax estimator, whereΓ(β, τ) represents special vague prior information, are given.     

A conventional statistical problem with irregular minimax behavior

Summary The problem of testing the mean vector of the two dimensional circularly symmetrical normal distribution with unit variances, where the data consists of just one sample point inR ², is examined for stability of -maximin criteria. If the null hypothesisH ₀ is the one point set containing the origin and the alternative set equal to the whole ofR ²–H ₀, then the -maximin is not unique. If a zone of indifference _I containingH ₀ is introduced, then the problem of testingH ₀ againstR ² – _I can turn out to have a unique -maximin test. In the present paper we show a class of such _I for which this is the case. We show further that, given any -maximin test for testingH ₀ againstR ²–H ₀, there is a decreasing sequence of _I , with intersection equal toH ₀, for which the corresponding sequence of -maximin tests forH ₀ againstR ² – _I approaches a limit (in the usual weak star topology) which is not equivalent to .     

A curtailed test for the shape parameter of the Weibull distribution

Summary A procedure is proposed in this paper for testing the shape parameter, of the Weibull distribution. The test statistic which is based on the extremal quotient, possesses a monotone property which makes it possible for rejection earlier than the last planned observation of the null hypothesis,H ₀: =₀ when the alternative hypothesis isH _a: <₀ and early acceptance ofH ₀ whenH _a: >₀. The test being scale-free, does not require the scale parameter to be known.     

On maximum likelihood prediction based on Type II doubly censored exponential data

In this paper, the maximum likelihood predictor (MLP) of the kth ordered observation, t _k, in a sample of size n from a two-parameter exponential distribution as well as the predictive maximum likelihood estimators (PMLE's) of the location and scale parameters, θ and β, based on the observed values t _r, …, t _s (1≤r≤s<k≤n), are obtained in closed forms, contrary to the belief they cannot be so expressed. When θ is known, however, the PMLE of β and MLP of t _k do not admit explicit expressions. It is shown here that they exist and are unique; sharp lower and upper bounds are also provided. The derived predictors and estimators are reasonable and also have good asymptotic properties. As applications, the total duration time in a life test and the failure time of a k-out-of-n system may be predicted. Finally, an illustrative example is included. Received: August 1999     

An outlier test for linear processes — II. Large contamination

In Flak/Schmid (1993) an outlier test for linear processes was introduced. The test statistic bases on a comparison of each observation with a one-step predictor. It was assumed that an upper bound for the total number of outlierss _n is known, wheren denotes the sample size. The asymptotic distribution of the test statistic was derived under the assumption thats _n/n → 0 ands _n → ∞ asn → ∞. This note deals with the asymptotic behaviour of this quantity, ifs _n/n →p ₀ ∈ (0, 1).