Two-sample rank tests with truncated populations

LetX ₁,…,X _m andY ₁,…,Y _n be two independent samples from continuous distributionsF andG respectively. Using a Hoeffding (1951) type theorem, we obtain the distributions of the vector S=(S ₍₁₎,…,S _(n)), whereS _(j)=# (X _i ’s≤Y _(j)) andY _(j) is thej-th order statistic ofY sample, under three truncation models: (a)G is a left truncation ofF orG is a right truncation ofF, (b)F is a right truncation ofH andG is a left truncation ofH, whereH is some continuous distribution function, (c)G is a two tail truncation ofF. Exploiting the relation between S and the vectorR of the ranks of the order statistics of theY-sample in the pooled sample, we can obtain exact distributions of many rank tests. We use these to compare powers of the Hajek test (Hajek 1967), the Sidak Vondracek test (1957) and the Mann-Whitney-Wilcoxon test. We derive some order relations between the values of the probagility-functions under each model. Hence find that the tests based onS ₍₁₎ andS _(n) are the UMP rank tests for the alternative (a). We also find LMP rank tests under the alternatives (b) and (c).     

Moment consistency of estimators in partially linear models under NA samples

Consider the heteroscedastic regression model Y ^(j)(x _in , t _in ) = t _in β + g(x _in ) + σ _in e ^(j)(x _in ), 1 ≤ j ≤ m, 1 ≤ i ≤ n, where s_in²=f(u_in){\sigma_{in}^{2}=f(u_{in})}, (x _in , t _in , u _in ) are fixed design points, β is an unknown parameter, g(·) and f(·) are unknown functions, and the errors {e ^(j)(x _in )} are mean zero NA random variables. The moment consistency for least-squares estimators and weighted least-squares estimators of β is studied. In addition, the moment consistency for estimators of g(·) and f(·) is investigated.     

On maximum likelihood prediction based on Type II doubly censored exponential data

In this paper, the maximum likelihood predictor (MLP) of the kth ordered observation, t _k, in a sample of size n from a two-parameter exponential distribution as well as the predictive maximum likelihood estimators (PMLE's) of the location and scale parameters, θ and β, based on the observed values t _r, …, t _s (1≤r≤s<k≤n), are obtained in closed forms, contrary to the belief they cannot be so expressed. When θ is known, however, the PMLE of β and MLP of t _k do not admit explicit expressions. It is shown here that they exist and are unique; sharp lower and upper bounds are also provided. The derived predictors and estimators are reasonable and also have good asymptotic properties. As applications, the total duration time in a life test and the failure time of a k-out-of-n system may be predicted. Finally, an illustrative example is included. Received: August 1999     

A note on reliability properties of k-record statistics

LetY _k,n denote the nth (upper) k-record value of an infinite sequence of independent, identically distributed random variables with common continuous distribution function F. We show that if the nth k-record valueY _k,n has an increasing failure rate (IFR), thenY _l,n (l<k) andY _k+1,n+1(n≤k+1) also have IFR distributions. On the other hand, ifY _k,n has a decreasing failure rate (DFR), thenY _l,n (1>k) has also a DFR distribution. We also present some results concerning log convexity and log concavity ofY _k,n .     

Distributions determined by conditioning on a pair of order statistics

LetX ₁,X ₂, ...,X _n (n≥3) be a random sample on a random variableX with distribution functionF having a unique continuous inverseF ⁻¹ over (a,b), −∞≤a<b≤∞ the support ofF. LetX _1:n <X _2:n <...<X _n:n be the corresponding order statistics. Letg be a nonconstant continuous function over (a,b). Then for some functionG over (a, b) and for some positive integersr ands, 1<r+1<s≤n

Strong consistency of the MLE under random censoring

LetX ₁, ...,X _n be an i.i.d. sample from some parametric family {_θ :θ (Θ} of densities. In the random censorship model one observesZ _i =min (X _i ,Y _i ) andδ _i =1_{ x _i ≤Y _i}, whereY _i is a censoring variable being independent ofX _i . In this paper we investigate the strong consistency ofθ _n maximizing the modified likelihood function based on (Z _i ,δ _i , 1≤i≤n. The main result constitutes an extension of Wald’s theorem for complete data to censored data. Work partially supported by the “Deutsche Forschungsgemeinschaft”.     

Multivariate likelihood ratio orderings between spacings of heterogeneous exponential random variables

Let X ₁, X ₂, ..., X _n be independent exponential random variables such that X _i has failure rate λ for i = 1, ..., p and X _j has failure rate λ^* for j = p + 1, ..., n, where p ≥ 1 and q = n − p ≥ 1. Denote by D _i:n (p,q) = X _i:n −X _i-1:n the ith spacing of the order statistics X _1:n ≤ X _2:n ≤ ... ≤ X _n:n , i = 1, ..., n, where X _0:n ≡ 0. The purpose of this paper is to investigate multivariate likelihood ratio orderings between spacings D _i:n (p,q), generalizing univariate comparison results in Wen et al.(J Multivariate Anal 98:743–756, 2007). We also point out that such multivariate likelihood ratio orderings do not hold for order statistics instead of spacings. Supported by National Natural Science Foundation of China, the Program for New Century Excellent Talents in University (No.: NCET-04-0569), and by the Knowledge Innovation Program of the Chinese Academy of Sciences (No.: KJCX3-SYW-S02).     

On the power function of the exact test for ther×c contingency table

Summary LetN=[n _ij ] (i=1, …,r;j=1, …,c) be the matrix of observed frequencies in anr×c contingency table fromr possibly different multinomial populations with respective probabilitiesp _i =(p _i1, …,p _ic ).Freeman andHalton have proposed an exact conditional test for the hypothesisH ₀ :p _i =(p ₁, …p _c ) of the exact test is derived. Numerical values forβ(p) were previously computed for the special case:r=3,c=2 [Bennett andNakamura, 1964].     

Testing conditional symmetry against one-sided alternatives in square contingency tables

For a (k×k) square contingency table with ordered categories, letX(Y) denote the row (column) number. The conditional symmetry model is given byP(X=i, Y=j|X<Y)=P(X=j, Y=i |X>Y), ∀i<j. In this paper, we study the likelihood ratio tests of conditional symmetry in a square contingency table against two particular classes of one-sided alternatives. We obtain the maximum likelihood estimators under each alternative. The asymptotic null distributions of the likelihood ratio statistics are shown to have chi-bar square type distributions. A simulation study is performed by comparing the powers of different tests. The theory developed is illustrated by using the famous eye vision data from Stuart (1953).     

Linearity of regression for non-adjacent order statistics

Let X ₁,X ₂,…,X _n be a random sample from a continuous distribution with the corresponding order statistics X _1:n≤X _2:n≤…≤X _n:n. All the distributions for which E(X _{k+r: n}|X _k:n)=a X _k:n+b are identified, which solves the problem stated in Ferguson (1967). Received February 1998     

A characterization of the exponential distribution by higher order gap

Summary SupposeX is a non-negative random variable with an absolutely continuous (with respect to Lebesgue measure) distribution functionF (x) and the corresponding probability density functionf(x). LetX ₁,X ₂,...,X _n be a random sample of sizen fromF andX _i,n is thei-th smallest order statistics. We define thej-th order gapg _i,j(n) asg _i,j(n)=X _i+j,n–X_i,n 1i<n, 1nn–i. In this paper a characterization of the exponential distribution is given by considering a distribution property ofg _i,j(n).     

On characterizing discrete distributions via conditional expectations of weak record values

Let (W _n ,n ≥ 0) denote the sequence of weak records from a distribution with support S = { α₀,α₁,...,α _N }. In this paper, we consider regression functions of the form ψ _n (x) = E(h(W _n ) |W _n+1 = x), where h(·) is some strictly increasing function. We show that a single function ψ _n (·) determines F uniquely up to F(α₀). Then we derive an inversion formula which enables us to obtain F from knowledge of ψ _n (·), ψ _n-1(·), h(·) and F(α₀).     

Nonparametric regression function estimation using interaction least squares splines and comlexity regularization

Let (X, Y) be a pair of random variables withsupp(X)⊆[0,1] ^l andEY ²<∞. Letm ^* be the best approximation of the regression function of (X, Y) by sums of functions of at mostd variables (1≤d≤l). Estimation ofm ^* from i.i.d. data is considered. For the estimation interaction least squares splines, which are defined as sums of polynomial tensor product splines of at mostd variables, are used. The knot sequences of the tensor product splines are chosen equidistant. Complexity regularization is used to choose the number of the knots and the degree of the splines automatically using only the given data. Without any additional condition on the distribution of (X, Y) the weak and strongL ₂-consistency of the estimate is shown. Furthermore, for everyp≥1 and every distribution of (X, Y) withsupp(X)⊆[0,1] ^l ,y bounded andm ^* p-smooth, the integrated squared error of the estimate achieves up to a logarithmic factor the (optimal) rate      

Multivariate multistage methodologies for simultaneous all pairwise comparisons

We consider the problem of constructing simultaneous fixed-width confidence intervals for all pairwise treatment differences μ₁−μ _J , in the presence ofk(≥2) independent populationsN _p (μ₁,Σ), 1≤i≠j≤k. Appropriate purely sequential, accelerated sequential and three-stage sampling strategies have been developed and variousfirst-order asymptotic properties are then derived when Σ _pxp is completely unknown, but positive definite (p.d.). In the two special cases when the largest component variance in Σ is a known multiple of one of the variances or Σ=σ² H where σ(>0) is unknown, butH _pxp is known and p.d., the original multistage sampling strategies are specialized. Under such special circumstances, associatedsecond-order characteristics are then developed. It is to be noted that our present formulation and the methodologies fill important voids in the context of multivariate multiple comparisons which is a challenging area that has not yet been fully explored. Moderate sample performances of the proposed techniques were very encouraging and detailed remarks on these were included in Mukhopadhyay and Aoshima (1997).     

Locally minimax test of independence in elliptically symmetrical distributions with additional observations

Summary LetX=(X _ij )=(X ₁, ...,X _n )’,X’ _i =(X _i1, ...,X _ip )’,i=1,2, ...,n be a matrix having a multivariate elliptical distribution depending on a convex functionq with parameters, 0,σ. Let ϱ²=ϱ ₂ ^-2 be the squared multiple correlation coefficient between the first and the remainingp ₂+p ₃=p−1 components of eachX _i . We have considered here the problem of testingH ₀:ϱ²=0 against the alternativesH ₁:ϱ ₁ ^-2 =0, ϱ ₂ ^-2 >0 on the basis ofX andn ₁ additional observationsY ₁ (n ₁×1) on the first component,n ₂ observationsY ₂(n ₂×p ₂) on the followingp ₂ components andn ₃ additional observationsY ₃(n ₃×p ₃) on the lastp ₃ components and we have derived here the locally minimax test ofH ₀ againstH ₁ when ϱ ₂ ^-2 →0 for a givenq. This test, in general, depends on the choice ofq of the familyQ of elliptically symmetrical distributions and it is not optimality robust forQ.     

Asymptotic normality of M-estimators in a semiparametric model with longitudinal data

Suppose that the longitudinal observations (Y _ij , X _ij , t _ij ) for i = 1, . . . ,n; j = 1, . . . ,m _i are modeled by the semiparamtric model where β ₀ is a k × 1 vector of unknown parameters, g(·) is an unknown estimated function and e _ij are unobserved disturbances. This article consider M-type regressions which include mean, median and quantile regressions. The M-estimator of the slope parameter β ₀ is obtained through piecewise local polynomial approximation of the nonparametric component. The local M-estimator of g(·) is also obtained by replacing β ₀ in model with its M-estimator and using local linear approximation. The asymptotic distribution of the estimator of β ₀ is derived. The asymptotic distributions of the local M-estimators of g(·) at both interior and boundary points are also established. Various applications of our main results are given. The research is supported in part by National Natural Science Foundation of China (Grant No. 10671089).     

A note on generalized wald’s method

Let {v _n(θ)} be a sequence of statistics such that whenθ =θ ₀,v _n(θ ₀) N _p(0,Σ), whereΣ is of rankp andθ εR ^d. Suppose that underθ =θ ₀, {Σ _n} is a sequence of consistent estimators ofΣ. Wald (1943) shows thatv _n ^T (θ ₀)Σ _n ⁻¹ v _n(θ ₀) x ²(p). It often happens thatv _n(θ ₀) N _p(0,Σ) holds butΣ is singular. Moore (1977) states that under certain assumptionsv _n ^T (θ ₀)Σ _n ⁻ v _n(θ ₀) x ²(k), wherek = rank (Σ) andΣ _n ⁻ is a generalized inverse ofΣ _n. However, Moore’s result as stated is incorrect. It needs the additional assumption that rank (Σ _n) =k forn sufficiently large. In this article, we show that Moore’s result (as corrected) holds under somewhat different, but easier to verify, assumptions. Research partly supported by the U.S. Army Research Office through the Mathematical Sciences Institute at Cornell University.     

Strong uniform convergence of the recursive regression estimator under φ-mixing conditions

Suppose the observations (X_i, Y_i) taking values in R^d×R, are -mixing. Compared with the i.i.d. case, some known strong uniform convergence results for the estimators of the regression function r(x)=E(Y_i|X_i=x) need strong moment conditions under -mixing setting. We consider the following improved kernel estimators of r(x) suggested by Cheng (1983): Qian and Mammitzsch (2000) investigated the strong uniform convergence and convergence rate for to r(x) under weaker moment conditions than those of the others in the literature, and the optimal convergence rate can be attained under almost the same conditions as stated in Theorem 3.3.2 of Györfi et al. (1989). In this paper, under the similar conditions of Qian and Mammitzsch (2000), we study the strong uniform convergence and convergence rates for (j=2,3) to r(x), which have not been discussed by Qian and Mammitzsch (2000). In contrast to , our estimators and are recursive, which is highly desirable for practical computation.     

A bound on the expected overshoot for some concave boundaries

LetX ₁,X ₂,… be i.i.d. with finite meanμ>0,S _n =X ₁+…+X _n . Forf(n)=n ^β ,c>0 we consider the stopping timesT _c =inf{n:S _n >c+f(n)} with overshootR _c =S _{T c} −(c+f(T _c )). For 0<β<1 we give a bound for sup _c≥0 ER _c in the spirit of Lorden’s well-known inequality forf=0.     

A note on strategies for bandit problems with infinitely many arms

A bandit problem consisting of a sequence of n choices (n) from a number of infinitely many Bernoulli arms is considered. The parameters of Bernoulli arms are independent and identically distributed random variables from a common distribution F on the interval [0,1] and F is continuous with F(0)=0 and F(1)=1. The goal is to investigate the asymptotic expected failure rates of k-failure strategies, and obtain a lower bound for the expected failure proportion over all strategies presented in Berry et al. (1997). We show that the asymptotic expected failure rates of k-failure strategies when 0<b1 and a lower bound can be evaluated if the limit of the ratio F(1)–F(t) versus (1–t)^b exists as t1^– for some b>0.