Sequential estimation of shape parameters in multivariate dynamic models

Sequential maximum likelihood and GMM estimators of distributional parameters obtained from the standardised innovations of multivariate conditionally heteroskedastic dynamic regression models evaluated at Gaussian PML estimators preserve the consistency of mean and variance parameters while allowing for realistic distributions. We assess their efficiency, and obtain moment conditions leading to sequential estimators as efficient as their joint ML counterparts. We also obtain standard errors for VaR and CoVaR, and analyse the effects on these measures of distributional misspecification. Finally, we illustrate the small sample performance of these procedures through simulations and apply them to analyse the risk of large eurozone banks.     

Extension of some important identities in shrinkage-pretest strategies

In this paper, we establish three identities which play a crucial role in deriving the asymptotic distributional risk function and the asymptotic distributional bias of a large class of estimators of a matrix parameter. In particular, we generalize the results in Judge and Bock (The statistical implication of pre-test and Stein-rule estimators in econometrics. North Holland, Amsterdam, 1978). The established results are useful in risk analysis of a class of Stein-rule type matrix estimators.     

Assessing the robustness of estimators when fitting Poisson inverse Gaussian models

The generalized linear mixed model (GLMM) extends classical regression analysis to non-normal, correlated response data. Because inference for GLMMs can be computationally difficult, simplifying distributional assumptions are often made. We focus on the robustness of estimators when a main component of the model, the random effects distribution, is misspecified. Results for the maximum likelihood estimators of the Poisson inverse Gaussian model are presented.     

Extracting a common stochastic trend: Theory with some applications

This paper investigates the statistical properties of estimators of the parameters and unobserved series for state space models with integrated time series. In particular, we derive the full asymptotic results for maximum likelihood estimation using the Kalman filter for a prototypical class of such models—those with a single latent common stochastic trend. Indeed, we establish the consistency and asymptotic mixed normality of the maximum likelihood estimator and show that the conventional method of inference is valid for this class of models. The models we explicitly consider comprise a special–yet useful–class of models that may be employed to extract the common stochastic trend from multiple integrated time series. Such models can be very useful to obtain indices that represent fluctuations of various markets or common latent factors that affect a set of economic and financial variables simultaneously. Moreover, our derivation of the asymptotics of this class makes it clear that the asymptotic Gaussianity and the validity of the conventional inference for the maximum likelihood procedure extends to a larger class of more general state space models involving integrated time series. Finally, we demonstrate the utility of this class of models extracting a common stochastic trend from three sets of time series involving short- and long-term interest rates, stock return volatility and trading volume, and Dow Jones stock prices.     

Fixed Effects and Random Effects Estimation of Higher-order Spatial Autoregressive Models with Spatial Autoregressive and Heteroscedastic Disturbances

Abstract

This paper develops a unified framework for fixed effects (FE) and random effects (RE) estimation of higher-order spatial autoregressive panel data models with spatial autoregressive disturbances and heteroscedasticity of unknown form in the idiosyncratic error component. We derive the moment conditions and optimal weighting matrix without distributional assumptions for a generalized moments (GM) estimation procedure of the spatial autoregressive parameters of the disturbance process and define both an RE and an FE spatial generalized two-stage least squares estimator for the regression parameters of the model. We prove consistency of the proposed estimators and derive their joint asymptotic distribution, which is robust to heteroscedasticity of unknown form in the idiosyncratic error component. Finally, we derive a robust Hausman test of the spatial random against the spatial FE model.     

Estimation of a k-monotone density: characterizations, consistency and minimax lower bounds

The classes of monotone or convex (and necessarily monotone) densities on     can be viewed as special cases of the classes of k - monotone densities on     . These classes bridge the gap between the classes of monotone (1-monotone) and convex decreasing (2-monotone) densities for which asymptotic results are known, and the class of completely monotone (∞-monotone) densities on     . In this paper we consider non-parametric maximum likelihood and least squares estimators of a k -monotone density g ₀. We prove existence of the estimators and give characterizations. We also establish consistency properties, and show that the estimators are splines of degree k −1 with simple knots. We further provide asymptotic minimax risk lower bounds for estimating the derivatives     , at a fixed point x ₀ under the assumption that     .     

Estimation of location of discontinuity in a density

Here we propose a few estimators of θ, in addition to those studied in Goria (1978), the point of discontinuity of the probability density $$f(x,\theta ) = \frac{1}{{2\Gamma (\alpha )}}e^{ - |x - \theta |} |x - \theta |^{\alpha - 1} ,$$ for $$0< \alpha< 1, - \infty< x< \infty , - \infty< \theta< \infty .$$ We establish the consistency and the optimality of the Bayes and the maximum probability estimators. Despite their nice properties, these estimators are not easy to compute in this case and their effective computation depends on the knowledge of the exponent α. Hence, we propose another class of estimators, dependent upon the spacings of the observations, computable without actual knowledge of the value of α as long as it is known that α < α₀ < 1: we show that these estimators converge at the best possible rate. We further demonstrate, using a modified version of the maximum probability estimator's technique, that the tails of the density do not substantially effect their efficiency. Finally a bivariate family of densities, having a ridge dependent on the parameter θ, is considered and it is shown that this family exhibits features similar to the univariate case, and thus, the necessary modifications of the arguments of the univariate case are utilized for the estimation of θ in this bivariate example.     

Proofs for large sample properties of generalized method of moments estimators

I present proofs for the consistency of generalized method of moments (GMM) estimators presented in Hansen (1982). Some basic approximation results provide the groundwork for the analysis of a class of such estimators. Using these results, I establish the large sample convergence of GMM estimators under alternative restrictions on the estimation problem.     

Nonparametric maximum likelihood estimation in a non locally compact setting

Maximum likelihood estimation is considered in the context of infinite dimensional parameter spaces. It is shown that in some locally convex parameter spaces sequential compactness of the bounded sets ensures the existence of minimizers of objective functions and the consistency of maximum likelihood estimators in an appropriate topology. The theory is applied to revisit some classical problems of nonparametric maximum likelihood estimation, to study location parameters in Banach spaces, and finally to obtain Varadarajan’s theorem on the convergence of empirical measures in the form of a consistency result for a sequence of maximum likelihood estimators. Several parameter spaces sharing the crucial compactness property are identified. This research was supported by grants from the National Sciences and Engineering Research Council of Canada and the Fonds FCAR de la Province de Québec.     

Nonparametric estimation for a current status right‐censored data model

We consider the Case 1 interval censoring approach for right‐censored survival data. An important feature of the model is that right‐censored event times are not observed exactly, but at some inspection times. The model covers as particular cases right‐censored data, current status data, and life table survival data with a single inspection time. We discuss the nonparametric estimation approach and consider three nonparametric estimators for the survival function of failure time: maximum likelihood, pseudolikelihood, and the naïve estimator. We establish strong consistency of the estimators with the L₁ rate of convergence. Simulation results confirm consistency of the estimators.     

Properties of h-Likelihood Estimators in Clustered Data

We study properties of the maximum h-likelihood estimators for random effects in clustered data. To define optimality in random effects predictions, several foundational concepts of statistics such as likelihood, unbiasedness, consistency, confidence distribution and the Cramer–Rao lower bound are extended. Exact probability statements about interval estimators for random effects can be made asymptotically without a prior assumption. Using the binary-matched pair example, we illustrated that the use of random effects recover information, leading to the boon on estimating treatment effects.     

Jackknife estimators of a relative risk in 2×2 and 2×2×K contingency tables

Several jackknife estimators of a relative risk in a single 2×2 contingency table and of a common relative risk in a 2×2× K contingency table are presented. The estimators are based on the maximum likelihood estimator in a single table and on an estimator proposed by Tarone (1981) for stratified samples, respectively. For the stratified case, a sampling scheme is assumed where the number of observations within each table tends to infinity but the number of tables remains fixed. The asymptotic properties of the above estimators are derived. Especially, we present two general results which under certain regularity conditions yield consistency and asymptotic normality of every jackknife estimator of a bunch of functions of binomial probabilities.     

The ACR Model: A Multivariate Dynamic Mixture Autoregression*

This paper proposes and analyses the autoregressive conditional root (ACR) time‐series model. This multivariate dynamic mixture autoregression allows for non‐stationary epochs. It proves to be an appealing alternative to existing nonlinear models, e.g. the threshold autoregressive or Markov switching class of models, which are commonly used to describe nonlinear dynamics as implied by arbitrage in presence of transaction costs. Simple conditions on the parameters of the ACR process and its innovations are shown to imply geometric ergodicity, stationarity and existence of moments. Furthermore, consistency and asymptotic normality of the maximum likelihood estimators are established. An application to real exchange rate data illustrates the analysis.     

Regression over Timescale Decompositions: A Sampling Analysis of Distributional Properties

In two previous papers, Ramsey and Lampart demonstrated that regression analyses between timescale decompositions provided important insight into the properties of economic relationships. The idea in those papers was that the relationship between any two variables, say consumption and income, was the union of the individual relationships between consumption and income at each timescale and that the regression relationship might, differ across timescales. This paper is dedicated to discovering the approximate distributional properties of the regression estimators and of the residuals in the context of such models. Sampling procedures are used to verify the distributional properties of the regression estimators at each timescale and those of the residuals. This analysis is necessary to provide the appropriate distributional information required to specify tests of hypotheses and confidence intervals.     

Properties and estimation of asymmetric exponential power distribution

The new distribution class, Asymmetric Exponential Power Distribution (AEPD), proposed in this paper generalizes the class of Skewed Exponential Power Distributions (SEPD) in a way that in addition to skewness introduces different decay rates of density in the left and right tails. Our parametrization provides an interpretable role for each parameter. We derive moments and moment-based measures: skewness, kurtosis, expected shortfall. It is demonstrated that a maximum entropy property holds for the AEPD distributions. We establish consistency, asymptotic normality and efficiency of the maximum likelihood estimators over a large part of the parameter space by dealing with the problems created by non-smooth likelihood function and derive explicit analytical expressions of the asymptotic covariance matrix; where the results apply to the SEPD class they enlarge on the current literature. Also we give a convenient stochastic representation of the distribution; our Monte Carlo study illustrates the theoretical results. We also provide some empirical evidence for the usefulness of employing AEPD errors in GARCH type models for predicting downside market risk of financial assets.     

Large-sample estimation strategies for eigenvalues of a Wishart matrix

The problem of simultaneous asymptotic estimation of eigenvalues of covariance matrix of Wishart matrix is considered under a weighted quadratic loss function. James-Stein type of estimators are obtained which dominate the sample eigenvalues. The relative merits of the proposed estimators are compared to the sample eigenvalues using asymptotic quadratic distributional risk under loal alternatives. It is shown that the proposed estimators are asymptotically superior to the sample eigenvalues. Further, it is demonstrated that the James-Stein type estimator is dominated by its truncated part.     

A general asymptotic theory for time-series models

This paper develops a general asymptotic theory for the estimation of strictly stationary and ergodic time–series models. Under simple conditions that are straightforward to check, we establish the strong consistency, the rate of strong convergence and the asymptotic normality of a general class of estimators that includes LSE, MLE and some M-type estimators. As an application, we verify the assumptions for the long-memory fractional ARIMA model. Other examples include the GARCH(1,1) model, random coefficient AR(1) model and the threshold MA(1) model.     

Covariate Measurement Error in Quadratic Regression

We consider quadratic regression models where the explanatory variable is measured with error. The effect of classical measurement error is to flatten the curvature of the estimated function. The effect on the observed turning point depends on the location of the true turning point relative to the population mean of the true predictor. Two methods for adjusting parameter estimates for the measurement error are compared. First, two versions of regression calibration estimation are considered. This approximates the model between the observed variables using the moments of the true explanatory variable given its surrogate measurement. For certain models an expanded regression calibration approximation is exact. The second approach uses moment-based methods which require no assumptions about the distribution of the covariates measured with error. The estimates are compared in a simulation study, and used to examine the sensitivity to measurement error in models relating income inequality to the level of economic development. The simulations indicate that the expanded regression calibration estimator dominates the other estimators when its distributional assumptions are satisfied. When they fail, a small-sample modification of the method-of-moments estimator performs best. Both estimators are sensitive to misspecification of the measurement error model.     

Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

Estimation strategies for the regression coefficient parameter matrix in multivariate multiple regression

We consider improved estimation strategies for the parameter matrix in multivariate multiple regression under a general and natural linear constraint. In the context of two competing models where one model includes all predictors and the other restricts variable coefficients to a candidate linear subspace based on prior information, there is a need of combining two estimation techniques in an optimal way. In this scenario, we suggest some shrinkage estimators for the targeted parameter matrix. Also, we examine the relative performances of the suggested estimators in the direction of the subspace and candidate subspace restricted type estimators. We develop a large sample theory for the estimators including derivation of asymptotic bias and asymptotic distributional risk of the suggested estimators. Furthermore, we conduct Monte Carlo simulation studies to appraise the relative performance of the suggested estimators with the classical estimators. The methods are also applied on a real data set for illustrative purposes.