Strong uniform convergence for the estimator of the regression function under ϕ-mixing conditions

Suppose the observations (X _i,Y _i), i=1,…, n, are ϕ-mixing. The strong uniform convergence and convergence rate for the estimator of the regression function was studied by serveral authors, e.g. G. Collomb (1984), L. Gy?rfi et al. (1989). But the optimal convergence rates are not reached unless the Y _i are bounded or the E exp (a|Y _i|) are bounded for some a>0. Compared with the i.i.d. case the convergence of the Nadaraya-Watson estimator under ϕ-mixing variables needs strong moment conditions. In this paper we study the strong uniform convergence and convergence rate for the improved kernel estimator of the regression function which has been suggested by Cheng P. (1983). Compared with Theorem A in Y. P. Mack and B. Silverman (1982) or Theorem 3.3.1 in L. Gy?rfi et al. (1989), we prove the convergence for this kind of estimators under weaker moment conditions. The optimal convergence rate for the improved kernel estimator is attained under almost the same conditions of Theorem 3.3.2 in L. Gy?rfi et al. (1989). Received: September 1999     

Iterative Density Estimation from Contaminated Observations

We introduce an iterative procedure for estimating the unknown density of a random variable X from n independent copies of Y=X+ɛ, where ɛ is normally distributed measurement error independent of X. Mean integrated squared error convergence rates are studied over function classes arising from Fourier conditions. Minimax rates are derived for these classes. It is found that the sequence of estimators defined by the iterative procedure attains the optimal rates. In addition, it is shown that the sequence of estimators converges exponentially fast to an estimator within the class of deconvoluting kernel density estimators. The iterative scheme shows how, in practice, density estimation from indirect observations may be performed by simply correcting an appropriate ordinary density estimator. This allows to assess the effect that the perturbation due to contamination by ɛ has on the density to be estimated. We also suggest a method to select the smoothing parameter required by the iterative approach and, utilizing this method, perform a simulation study.     

On bootstrapping the mode in the nonparametric regression model with random design

In the nonparametric regression model with random design and based on i.i.d. pairs of observations (X _i, Y _i), where the regression function m is given by m(x)=?(Y _i|X _i=x), estimation of the location θ (mode) of a unique maximum of m by the location of a maximum of the Nadaraya-Watson kernel estimator for the curve m is considered. In order to obtain asymptotic confidence intervals for θ, the suitably normalized distribution of is bootstrapped in two ways: we present a paired bootstrap (PB) where resampling is done from the empirical distribution of the pairs of observations and a smoothed paired bootstrap (SPB) where the bootstrap variables are generated from a smooth bivariate density based on the pairs of observations. While the PB requires only relatively small computational effort when carried out in practice, it is shown to work only in the case of vanishing asymptotic bias, i.e. of “undersmoothing” when compared to optimal smoothing for mode estimation. On the other hand, the SPB, although causing more intricate computations, is able to capture the correct amount of bias if the pilot estimator for m oversmoothes. Received: May 2000     

Strong uniform convergence of the recursive regression estimator under φ-mixing conditions

Suppose the observations (X_i, Y_i) taking values in R^d×R, are -mixing. Compared with the i.i.d. case, some known strong uniform convergence results for the estimators of the regression function r(x)=E(Y_i|X_i=x) need strong moment conditions under -mixing setting. We consider the following improved kernel estimators of r(x) suggested by Cheng (1983): Qian and Mammitzsch (2000) investigated the strong uniform convergence and convergence rate for to r(x) under weaker moment conditions than those of the others in the literature, and the optimal convergence rate can be attained under almost the same conditions as stated in Theorem 3.3.2 of Györfi et al. (1989). In this paper, under the similar conditions of Qian and Mammitzsch (2000), we study the strong uniform convergence and convergence rates for (j=2,3) to r(x), which have not been discussed by Qian and Mammitzsch (2000). In contrast to , our estimators and are recursive, which is highly desirable for practical computation.     

Strong consistency of the MLE under random censoring

LetX ₁, ...,X _n be an i.i.d. sample from some parametric family {_θ :θ (Θ} of densities. In the random censorship model one observesZ _i =min (X _i ,Y _i ) andδ _i =1_{ x _i ≤Y _i}, whereY _i is a censoring variable being independent ofX _i . In this paper we investigate the strong consistency ofθ _n maximizing the modified likelihood function based on (Z _i ,δ _i , 1≤i≤n. The main result constitutes an extension of Wald’s theorem for complete data to censored data. Work partially supported by the “Deutsche Forschungsgemeinschaft”.     

Distribution of run statistics in partially exchangeable processes

Let { X_i} _{i 3 1}{\{ X_{i}\} _{i\geq 1}} be an infinite sequence of recurrent partially exchangeable binary random variables. We study the exact distributions of two run statistics (total number of success runs and the longest success run) in { X_i} _{i 3 1}{\{ X_{i}\} _{i\geq1}} . Since a flexible class of models for binary sequences can be obtained using the concept of partial exchangeability, as a special case of our results one can obtain the distribution of runs in ordinary Markov chains, exchangeable and independent sequences. The results also enable us to study the distribution of runs in particular urn models.     

Minimax estimation of a cumulative distribution function by converting to a parametric problem

Let X = (X ₁,...,X _n ) be a sample from an unknown cumulative distribution function F defined on the real line . The problem of estimating the cumulative distribution function F is considered using a decision theoretic approach. No assumptions are imposed on the unknown function F. A general method of finding a minimax estimator d(t;X) of F under the loss function of a general form is presented. The method of solution is based on converting the nonparametric problem of searching for minimax estimators of a distribution function to the parametric problem of searching for minimax estimators of the probability of success for a binomial distribution. The solution uses also the completeness property of the class of monotone decision procedures in a monotone decision problem. Some special cases of the underlying problem are considered in the situation when the loss function in the nonparametric problem is defined by a weighted squared, LINEX or a weighted absolute error.     

Model‐Assisted Regression Estimators for Longitudinal Data with Nonignorable Dropout

Estimation with longitudinal Y having nonignorable dropout is considered when the joint distribution of Y and covariate X is nonparametric and the dropout propensity conditional on (Y,X) is parametric. We apply the generalised method of moments to estimate the parameters in the nonignorable dropout propensity based on estimating equations constructed using an instrument Z, which is part of X related to Y but unrelated to the dropout propensity conditioned on Y and other covariates. Population means and other parameters in the nonparametric distribution of Y can be estimated based on inverse propensity weighting with estimated propensity. To improve efficiency, we derive a model‐assisted regression estimator making use of information provided by the covariates and previously observed Y‐values in the longitudinal setting. The model‐assisted regression estimator is protected from model misspecification and is asymptotically normal and more efficient when the working models are correct and some other conditions are satisfied. The finite‐sample performance of the estimators is studied through simulation, and an application to the HIV‐CD4 data set is also presented as illustration.     

Beware of averages!

Summary Let X₁,.,., X_m, and Y₁, Y_n, be two independent samples from the same distribution and let X and Y be the means of these samples. What is the maximal value of P(X < Y)?     

Some properties of the minimum and the maximum of random variables with joint logconcave distributions

It is shown that if (X ₁, X ₂, . . . , X _n ) is a random vector with a logconcave (logconvex) joint reliability function, then X _P = min _i∈P X _i has increasing (decreasing) hazard rate. Analogously, it is shown that if (X ₁, X ₂, . . . , X _n ) has a logconcave (logconvex) joint distribution function, then X ^P  = max _i∈P X _i has decreasing (increasing) reversed hazard rate. If the random vector is absolutely continuous with a logconcave density function, then it has a logconcave reliability and distribution functions and hence we obtain a result given by Hu and Li (Metrika 65:325–330, 2007). It is also shown that if (X ₁, X ₂, . . . , X _n ) has an exchangeable logconcave density function then both X _P and X ^P have increasing likelihood ratio.     

Regression analysis and dependence

In this paper we study the relationship between regression analysis and a multivariate dependency measure. If the general regression model Y=f() holds for some function f, where 1i₁< i₂<···i_m k, and X₁,...,X_k is a set of possible explanatory random variables for Y. Then there exists a dependency relation between the random variable Y and the random vector (). Using the dependency statistic defined below, we can detect such dependency even if the function f is not linear. We present several examples with real and simulated data to illustrate this assertion. We also present a way to select the appropriate subset among the random variables X₁,X₂,...,X_k, which better explain Y.     

Identification and estimation of nonlinear dynamic panel data models with unobserved covariates

This paper considers nonparametric identification of nonlinear dynamic models for panel data with unobserved covariates. Including such unobserved covariates may control for both the individual-specific unobserved heterogeneity and the endogeneity of the explanatory variables. Without specifying the distribution of the initial condition with the unobserved variables, we show that the models are nonparametrically identified from two periods of the dependent variable _Yit$Y_{it}$ and three periods of the covariate _Xit$X_{it}$. The main identifying assumptions include high-level injectivity restrictions and require that the evolution of the observed covariates depends on the unobserved covariates but not on the lagged dependent variable. We also propose a sieve maximum likelihood estimator (MLE) and focus on two classes of nonlinear dynamic panel data models, i.e., dynamic discrete choice models and dynamic censored models. We present the asymptotic properties of the sieve MLE and investigate the finite sample properties of these sieve-based estimators through a Monte Carlo study. An intertemporal female labor force participation model is estimated as an empirical illustration using a sample from the Panel Study of Income Dynamics (PSID).     

Locally minimax test of independence in elliptically symmetrical distributions with additional observations

Summary LetX=(X _ij )=(X ₁, ...,X _n )’,X’ _i =(X _i1, ...,X _ip )’,i=1,2, ...,n be a matrix having a multivariate elliptical distribution depending on a convex functionq with parameters, 0,σ. Let ϱ²=ϱ ₂ ^-2 be the squared multiple correlation coefficient between the first and the remainingp ₂+p ₃=p−1 components of eachX _i . We have considered here the problem of testingH ₀:ϱ²=0 against the alternativesH ₁:ϱ ₁ ^-2 =0, ϱ ₂ ^-2 >0 on the basis ofX andn ₁ additional observationsY ₁ (n ₁×1) on the first component,n ₂ observationsY ₂(n ₂×p ₂) on the followingp ₂ components andn ₃ additional observationsY ₃(n ₃×p ₃) on the lastp ₃ components and we have derived here the locally minimax test ofH ₀ againstH ₁ when ϱ ₂ ^-2 →0 for a givenq. This test, in general, depends on the choice ofq of the familyQ of elliptically symmetrical distributions and it is not optimality robust forQ.     

Optimal process parameters under LINEX loss function with general input quality characteristic

In this paper we generalize the quality and cost trade-off problem of Chang and Hung (Qual Quant 41: 291–301, 2007) under the LINEX loss function. We consider the general input characteristic given by the random variable X with moment generating function m _X (t) and output characteristic given by the deterministic transformation Y  =  g(X). The two cases we consider are when g(X) is an affine function of X and X follows (1) the gamma distribution, and (2) the double exponential distribution.     

Correcting for truncation bias caused by a latent truncation variable

We discuss estimation of the model Y_i=X_ib_Y+e_Yi, T_i=X_ib_T+ e_Ti, when data on the continuous dependent variable Y and on the independent variables X are observed iff the ‘truncation variable’ T>0 and when T is latent. This case is distinct from both (i) the‘censored sample’ case, in which Y data are available iff T>0, T is latent and X data are available for all observations, and (ii) the ‘observed truncation variable’ case, in which both Y and X are observed iff T>0 and in which the actual value of T is observed whenever T>0. We derive a maximum-likelihood procedure for estimating this model and discuss identification and estimation.     

Evaluation of P(Xt>Yt ) when both Xt and Yt are residual lifetimes of two systems

Let the random variables X and Y denote the lifetimes of two systems. In reliability theory to compare between the lifetimes of X and Y there are several approaches. Among the most popular methods of comparing the lifetimes are to compare the survival functions, the failure rates and the mean residual lifetime functions of X and Y. Assume that both systems are operating at time t > 0. Then the residual lifetimes of them are X_t=X?t | X>t and Y_t=Y?t | Y>t, respectively. In this paper, we introduce, by taking into account the age of systems, a time‐dependent criterion to compare the residual lifetimes of them. In other words, we concentrate on function R(t ):=P(X_t>Y_t) which enables one to obtain, at time t, the probability that the residual lifetime X_t is greater than the residual lifetime Y_t. It is mentioned, in Brown and Rutemiller (IEEE Transactions on Reliability, 22 , 1973) that the probability of type R(t) is important for designing as long‐lived a product as possible. Several properties of R(t) and its connection with well‐known reliability measures are investigated. The estimation of R(t) based on samples from X and Y is also discussed.     

Semiparametric estimation of a censored regression model with an unknown transformation of the dependent variable

This paper presents a method for estimating the model Λ(Y)=min(β′X+U, C), where Y is a scalar, Λ is an unknown increasing function, X is a vector of explanatory variables, β is a vector of unknown parameters, U has unknown cumulative distribution function F, and C is a censoring threshold. It is not assumed that Λ and F belong to known parametric families; they are estimated nonparametrically. This model includes many widely used models as special cases, including the proportional hazards model with unobserved heterogeneity. The paper develops n^1/2-consistent, asymptotically normal estimators of Λ and F. Estimators of β that are n^1/2-consistent and asymptotically normal already exist. The results of Monte Carlo experiments illustrate the finite-sample behavior of the estimators.     

Bayesian estimation based on ranked set sample from Morgenstern type bivariate exponential distribution when ranking is imperfect

In this paper we consider Bayes estimation based on ranked set sample when ranking is imperfect, in which units are ranked based on measurements made on an easily and exactly measurable auxiliary variable X which is correlated with the study variable Y. Bayes estimators under squared error loss function and LINEX loss function for the mean of the study variate Y, when (X, Y) follows a Morgenstern type bivariate exponential distribution, are obtained based on both usual ranked set sample and extreme ranked set sample. Estimation procedures developed in this paper are illustrated using simulation studies and a real data.     

Shrinkage estimation of <Emphasis Type="Italic">P</Emphasis>(<Emphasis Type="Italic">X</Emphasis><<Emphasis Type="Italic">Y</Emphasis>) in the exponential case with common location parameter

We consider the problem of estimating R=P(X<Y) where X and Y have independent exponential distributions with parameters and respectively and a common location parameter . Assuming that there is a prior guess or estimate R₀, we develop various shrinkage estimators of R that incorporate this prior information. The performance of the new estimators is investigated and compared with the maximum likelihood estimator using Monte Carlo methods. It is found that some of these estimators are very successful in taking advantage of the prior estimate available.Acknowledgments. The authors are grateful to the editor and to the referees for their constructive comments that resulted in a substantial improvement of the paper.