Indeterminacy of equilibrium in stochastic OLG models

Summary. This paper studies the equilibria of a stochastic OLG exchange economies consisting of identical agents living for two periods, and having the opportunity to trade a single infinitely-lived asset in constant supply. The agents have uncertain endowments and the stochastic process determining the endowments is Markovian. For such economies, the literature has focused on studying strongly stationary equilibria in which quantities and prices are functions of the exogenous states of nature which describe the uncertainty: such equilibria are generalizations of deterministic steady states, and this paper investigates if they have the same special status as asymptotic limits of other equilibrium paths. The difficulty in extending the analysis of equilibria beyond the class of strongly stationary equilibria comes from the presence of indeterminacy: we propose a procedure for overcoming this difficulty which can be decomposed into two steps. First backward induction arguments are used to restrict the domain of possible prices; then if some indeterminacy is left, expectation functions are introduced to make the forward equilibrium equations determinate. The properties of the resulting trajectories, in particular their asymptotic properties, can then be studied. For the class of models that we study this procedure provides a justification for focusing on strongly stationary equilibria. For the model with positive dividends (equity or land) the justification is complete, since we show that the strongly stationary equilibrium is the unique equilibrium. For the model with zero dividends (money) there is a continuum of self-fulfilling expectation functions resulting in a continuum of equilibrium paths starting from any admissible initial condition: under conditions given in the paper, these equilibrium paths converge almost surely to one of the strongly stationary equilibria-either autarchy or the stochastic analogue of the Golden Rule. Received: November 19, 2001; revised version: March 22, 2002 RID="*" ID="*" We are grateful for the stimulating environment and research support provided by the Cowles Foundation at Yale University during the Fall 2000 when this paper was first conceived. We are also grateful to the participants of the SITE Workshop at Stanford University and the Incomplete Markets Workshop at SUNY Stony Brook during the summer 2001 for helpful discussions. Correspondence to: M. Magill     

Stationary equilibria in stochastic games: structure, selection, and computation

This paper introduces an algorithm to compute stationary equilibria in stochastic games that is guaranteed to converge for almost all such games. Since in general the number of stationary equilibria is overwhelming, we pay attention to the issue of equilibrium selection. We do this by extending the linear tracing procedure to the class of stochastic games, called the stochastic tracing procedure. As a by-product of our results, we extend a recent result on the generic finiteness of stationary equilibria in stochastic games to oddness of equilibria.     

Global sunspots in OLG models: Theory and computational analysis

This paper discusses sunspots equilibria in a context that is general in the sense that: (i) the evolution of the system takes place in a general state space (i.e., a space which is not necessarily finite or even countable); and (ii) the orbits of the unperturbed, deterministic component of the system converge to subsets of the state space which can be more complicated than a stationary state or a periodic orbit, i.e., they can be aperiodic or chaotic. This problem is represented mathematically as a system of stochastic difference equations the invariant probability distributions of which correspond to stationary sunspots equilibria. The conditions for stochastic stability are recalled and the theoretical results are applied to a model of overlapping generations with individuals living three periods. A computational analysis of this model is provided, covering the basic different cases suggested by the theory.     

Dynamic legislative policy making

We prove existence of stationary Markov perfect equilibria in an infinite-horizon model of legislative policy making in which the policy outcome in one period determines the status quo for the next. We allow for a multidimensional policy space and arbitrary smooth stage utilities, and we assume preferences and the status quo are subject to arbitrarily small shocks. We prove that equilibrium continuation values are differentiable and that proposal strategies are continuous almost everywhere. We establish upper hemicontinuity of the equilibrium correspondence, and we provide weak conditions under which each equilibrium of our model determines an aperiodic transition probability over policies. We establish a convergence theorem giving conditions under which the invariant distributions generated by stationary equilibria must be close to the core in a canonical spatial model. Finally, we extend the analysis to sequential move stochastic games and to a version of the model in which the proposer and voting rule are determined by play of a finite, perfect information game.     

Stochastic bequest games

In this paper, we prove the existence of a stationary Markov perfect equilibrium for a stochastic version of the bequest game. A novel feature in our approach is the fact that the transition probability need not be non-atomic and therefore, the deterministic production function is not excluded from consideration. Moreover, in addition to the common expected utility we also deal with a utility that takes into account an attitude of the generation towards risk.     

Uniqueness of stationary equilibria in a one-dimensional model of bargaining

We prove uniqueness of stationary equilibria in a one-dimensional model of bargaining with quadratic utilities, for an arbitrary common discount factor. For general concave utilities, we prove existence and uniqueness of a “minimal” stationary equilibrium and of a “maximal” stationary equilibrium. We provide an example of multiple stationary equilibria with concave (nonquadratic) utilities.     

Shock Persistence and Stochastic Trends in Australian Aggregate Output and Consumption*

The distinction between transitory and permanent shocks is at the centre of the debate on which class of models is best suited to represent economic variables: stationary models around a deterministic trend, or stationary models around a stochastic trend The debate u here focused on the Australian case. It is found that both aggregate output and consumption are characterized by stochastic trends, but without a transitory component This corresponds to a measure of shock persistence equal to one for both variables. For the specific case of aggregate output, this result may be interpreted as indicating the absence of business cycles     

Learning and Equilibrium Selection in a Monetary Overlapping Generations Model with Sticky Prices

We study adaptive learning in a monetary overlapping generations model with sticky prices and monopolistic competition for the case where learning agents observe current endogenous variables. Observability of current variables is essential for informational consistency of the learning setup with the model setup but generates multiple temporary equilibria when prices are flexible and prevents a straightforward construction of the learning dynamics. Sticky prices overcome this problem by avoiding simultaneity between prices and price expectations. Adaptive learning then robustly selects the determinate (monetary) steady state independent from the degree of imperfect competition. The indeterminate (non-monetary) steady state and non-stationary equilibria are never stable. Stability in a deterministic version of the model may differ because perfect foresight equilibria can be the limit of restricted perceptions equilibria of the stochastic economy with vanishing noise and thereby inherit different stability properties. This discontinuity at the zero variance of shocks suggests one should analyse learning in stochastic models.     

The Dynamics of Trustworthiness Among the Few

Conventional stochastic models of evolutionary processes with infinitely many agents are deterministic models in disguise. Only finite population models become truly stochastic. Therefore this paper focuses on an indirect evolutionary model of pair wise interaction in a pool of three (corresponding to analysing oligopolies in terms of duopoly markets). The outcomes of the process over the long haul are characterized by the stationary distribution of the underlying Markov process. Our example indicates that intermediate cases cannot be seen as convex combinations of the two polar non-stochastic cases of two or infinitely many individuals.
JEL Classification Numbers: C72, C73.     

Real Indeterminacy of Stationary Monetary Equilibria in Centralized Economies

We show that real indeterminacy of stationary equilibria, by which the set of stationary equilibria is a continuum and the real allocation varies among equilibria, may arise in some general equilibrium models with fiat money. The conditions under which such equilibria arise are: (i) each household optimally saves a constant amount of money; and (ii) at least two households face different budget constraints. We present various models, including a decentralized money search model and a centralized model with a monopoly firm, to explain how these conditions lead to real indeterminacy. Finally, we present a policy that uniquely implements any desirable outcome.     

Real interest rates: nonlinearity and structural breaks

Real interest rate is a crucial variable that determines the consumption, investment and saving behavior of individuals and thereby acts as a key policy tool that the central banks use to control the economy. Although many important theoretical models require the real interest rates to be stationary, the empirical evidence accumulated so far has not been able to provide conclusive evidence on the mean reverting dynamics of this variable. To resolve this puzzle we re-investigate the stochastic nature of the real interest rates by developing unit root tests for nonlinear heterogeneous panels where the alternative hypothesis allows for a smooth transition between deterministic linear trends around which stationary asymmetric adjustment may occur. When the newly developed panel unit root tests are applied to the real interest rates of the 17 OECD countries, we were able to uncover overwhelming empirical support in favor of mean reversion in the short-run and long-run real interest rates. Therefore, these results show that the conclusions drawn from a miss-specified test that ignores the presence of either nonlinearity, structural breaks or cross sectional dependence can give quite misleading results about the stochastic behavior of the real interest rates.     

Markovian equilibrium in a class of stochastic games: existence theorems for discounted and undiscounted models

Summary We study a strategic version of the neoclassical growth model under possible production uncertainty. For a general specification of the problem, we establish (i) the existence of stationary Markov equilibria in pure strategies for the discounted game, and (ii) the convergence, under a boundedness condition, of discounted equilibrium strategies to a pure strategy stationary Markovian equilibrium of the undiscounted game as the discount factor tends to unity. The same techniques can be used to prove that such convergence also obtains in all finitestate, finite-action stochastic games satisfying a certain full communicability condition. These results are of special interest since there are well known examples in the literature in which the limit of discounted equilibria fails to be an equilibrium of the undiscounted game.We are grateful to Marcus Berliant, M. Ali Khan, Mukul Majumdar, and an anonymous referee for helpful suggestions, and to Bonnie Huck for technical assistance. The first author acknowledges research support from the Columbia University Council for the Social Sciences.     

Nonlinear trend stationarity in global and hemispheric temperatures

This study investigates the issue of whether our Earth’s surface temperature exhibits a stochastic trend. Using state-of-the-art econometrics, we analyse the latest available temperature anomaly data. Our results indicate that both global and hemispheric temperatures may appear to have a stochastic trend when in fact they are stationary around a nonlinear deterministic trend and structural breaks are responsible. Furthermore, the nonlinearity found in the temperature trend is more complex than what has been reported in previous studies.     

A consistent route to randomness

Fully rational agents are allowed to optimize over expectations formation technologies in an environment where it is costly to collect and process information. It is shown in a general equilibrium framework that optimization over expectations by rational and forward-oriented agents can lead to endogenous instability. Specifically, we illustrate that resulting equilibria can be both chaotic and self-consistent with the distribution of agents' expected forecasting errors coinciding with the actual errors implied by the endogenous dynamic process. Moreover, we show that the equilibrium dynamics, while being purely deterministic, need not be distinguishable from stochastic dynamics to an outside rational observer.     

Consumption loans under uncertainty

A stationary equilibrium for a sequence of markets under uncertainty is defined as a stationary stochastic process of temporary market equilibria. The purpose of this paper is to apply this equilibrium concept to a consumption-loans model with stochastic resources. Given that agents live for only two periods, that resources are allocated independently and identically, and that traders make “admissible” consumption decisions, it is shown that the sequence of equilibrium trades on forward markets is a Markov chain. When this chain is strictly stationary with a unique invariant distribution, the sequence of markets is in stationary equilibrium. Using Gale's classification scheme, a strictly stationary chain exists for each type of economy (classical, Samuelson, mixed). Questions concerning convergence to the invariant distribution for each type of economy are addressed by determining when the chain satisfies various recurrence conditions.     

A Closed Form Characterization of the Stationary Outcome in Multilateral Bargaining

In this paper we consider infinite horizon multilateral bargaining with alternate offers. We prove that there exists only one stationary subgame perfect equilibrium outcome and it corresponds to the unique invariantmeasure of a column stochastic matrix. We characterize this stationary subgame perfect equilibrium outcome in a closed form, and also extend the approach to the multilateral bargaining with random moves.     

Sunspot cycles

Summary. This paper shows new properties about the equilibria of a stationary OG economy by establishing a connection between its stationary equilibria and those of a finite economy, with and without extrinsic uncertainty. Specifically, it shows the countability and local uniqueness with respect to the sup metric of the so-called sunspot cycles introduced here, that encompass both the deterministic cycles and the usual finite Markovian stationary sunspot equilibria. These sunspot cycles are, moreover, able to generate, at a lower cost in terms of assumptions than other sunspot equilibria, time series with the recurrent but irregular fluctuations typical of economic time series. Received: July 26, 2001; revised version: March 5, 2002 RID="*" ID="*" I want to thank an anonymous referee for comments that have helped greatly to improve this paper, as well as the comments about its contents received from several audiences in different seminars and conferences (the Economic Theory seminar of the University of Pennsylvania, the 2001 Meeting of the Econometric Society held at New Orleans, the 2000 Econometric Society World Congress, the 2000 Society for Economic Design Conference) and from comments to a previous paper, Dávila [10], specially from Jim Peck at the 1997 Workshop on General Equilibrium held at the University of Venice, that eventually lead to this one.     

Stochastic better-reply dynamics in finite games

In this paper, we analyze a model where individuals from finite populations are repeatedly drawn to play a finite game and in every period choose a weakly better reply to a sample distribution from a finite history of past play. For all finite games and sufficiently incomplete information, we prove convergence to minimal sets closed under better replies. This result complements previous findings in a deterministic continuous-time framework and implies convergence to strict Nash equilibria in many well-known classes of games.     

Job market signaling and employer learning

We consider a signaling model where the sender?s continuation value after signaling depends on his type, for instance because the receiver is able to update his posterior belief. As a leading example, we introduce Bayesian learning in a variety of environments ranging from simple two-period to continuous-time models with stochastic production. Signaling equilibria present two major departures from those obtained in models without learning. First, new mixed-strategy equilibria involving multiple pooling are possible. Second, pooling equilibria can survive the Intuitive Criterion when learning is efficient enough.