Purification in the infinitely-repeated prisoners' dilemma

This paper investigates the Harsanyi [Harsanyi, J.C., 1973. Games with randomly disturbed payoffs: A new rationale for mixed-strategy equilibrium points. International Journal of Game Theory 2 (1), 1–23]-purifiability of mixed strategies in the repeated prisoners' dilemma with perfect monitoring. We perturb the game so that in each period, a player receives a private payoff shock which is independently and identically distributed across players and periods. We focus on the purifiability of one-period memory mixed strategy equilibria used by Ely and Välimäki [Ely, J.C., Välimäki, J., 2002. A robust folk theorem for the prisoner's dilemma. Journal of Economic Theory 102 (1), 84–105] in their study of the repeated prisoners' dilemma with private monitoring. We find that any such strategy profile is not the limit of one-period memory equilibrium strategy profiles of the perturbed game, for almost all noise distributions. However, if we allow infinite memory strategies in the perturbed game, then any completely-mixed equilibrium is purifiable.     

A Note on Best Response Dynamics

We investigate the relationship between the continuous time best response dynamic, its perturbed version, and evolutionary dynamics in relation to mixed strategy equilibria. We find that as the level of noise approaches zero, the perturbed best response dynamic has the same qualitative properties as a broad class of evolutionary dynamics. That is, stability properties of equilibria are robust across learning dynamics of quite different origins and motivations. Journal of Economic Literature Classification Numbers: C72, D83.     

Markov Perfect Equilibrium: I. Observable Actions

We define Markov strategy and Markov perfect equilibrium (MPE) for games with observable actions. Informally, a Markov strategy depends only on payoff-relevant past events. More precisely, it is measurable with respect to the coarsest partition of histories for which, if all other players use measurable strategies, each player's decision-problem is also measurable. For many games, this definition is equivalent to a simple affine invariance condition. We also show that an MPE is generically robust: if payoffs of a generic game are perturbed, there exists an almost Markovian equilibrium in the perturbed game near the initial MPE. Journal of Economic Literature Classification Numbers: C72, C73.     

Evolution and Mixed Strategies

Selten (1980, J. Theoret. Biol., 84, 93–101) showed that no mixed equilibria are evolutionarily stable when players can condition their strategies on their roles in a game. Alternatively, Harsanyi's (1973, Int. J. Game Theory, 2, 1–23) purification argument implies that all mixed equilibria are approximations of strict, and hence evolutionarily stable, equilibria of games with slightly perturbed payoffs. This paper reconciles these results: Approximations of mixed equilibria have high invasion barriers, and hence are likely to persist, when payoff perturbations are relatively important and role identification is relatively noisy. When payoff perturbations are unimportant and role identification is precise, approximations of mixed equilibria will have small invasion barriers and are unlikely to persist. Journal of Economic Literature Classification Numbers: C70, C78.     

Voting with abstention

Most voting models in the literature neglect abstention, but is such a simplification justified? I investigate this question in a model with outside pressure on voters. For sequential voting (e.g., roll call votes), with and without an abstention option, there is a unique subgame perfect equilibrium, which implies that true majorities always succeed. Abstention can be an equilibrium strategy for some voters, in particular under complex decision rules (e.g., weighted voting, double majorities). Simultaneous voting often has a unique pure strategy equilibrium but also a plethora of mixed and pure/mixed strategy equilibria. Therefore, only with equilibrium selection, can we evaluate the consequences of neglecting abstention. For equal weight voting, equilibria selected by the procedure of Harsanyi and Selten change completely with an abstention option, even if abstention itself is not or rarely used. With small enough outside pressure, however, the selected equilibrium honors true majorities in both cases.     

Welfare-improving financial innovation with a single good

Summary. We show that at any equilibrium of almost every single-good incomplete markets economy, it is possible to find an asset which when introduced makes every agent better-off. Diamond (1967) has shown, however, that such economies are constrained suboptimal, so it is of course impossible to find a new asset which makes all agents worse-off. This contrasts with the case of multiple consumption goods, for which Cass and Citanna (1995) and Elul (1995) demonstrate that equilibrium utilities may be arbitrarily perturbed via financial innovation. Proving our result requires us to exploit not changes in equilibrium prices, but rather the gains to trading the new asset. In particular, we find an asset which when introduced does not change the existing asset prices even though it is traded by every agent – by a revealed preference argument it must therefore make everyone better-off. Received: May 28, 1997; revised version: July 1, 1997     

Reinterpreting mixed strategy equilibria: a unification of the classical and Bayesian views

We provide a new interpretation of mixed strategy equilibria that incorporates both von Neumann and Morgenstern's classical concealment role of mixing, as well as the more recent Bayesian view originating with Harsanyi. For any two-person game, G, we consider an incomplete information game, in which each player's type is the probability he assigns to the event that his mixed strategy in G is “found out” by his opponent. We show that, generically, any regular equilibrium of G can be approximated by an equilibrium of in which almost every type of each player is strictly optimizing. This leads us to interpret i's equilibrium mixed strategy in G as a combination of deliberate randomization by i together with uncertainty on j's part about which randomization i will employ. We also show that such randomization is not unusual: for example, i's randomization is nondegenerate whenever the support of an equilibrium contains cyclic best replies.     

Games with Imperfectly Observable Commitment

[1]claims that, in models of commitment, “the first-mover advantage is eliminated when there is aslightamount of noise associated with the observation of the first-mover's selection.” We show that the validity of this claim depends crucially on the restriction to pure strategy equilibria. The game analyzed by Bagwell always has a mixed equilibrium that is close to the Stackelberg equilibrium when the noise is small. Furthermore, an equilibrium selection theory that combines elements from the theory of[7]with elements from the theory of [6], actually selects this “noisy Stackelberg equilibrium.”Journal of Economic LiteratureClassification Number: C72.     

CORRELATED EQUILIBRIA,GOOD AND BAD: AN EXPERIMENTAL STUDY*

We report results from an experiment that explores the empirical validity of correlated equilibrium, an important generalization of Nash equilibrium. Specifically, we examine the conditions under which subjects playing the game of Chicken will condition their behavior on private third‐party recommendations drawn from publicly announced distributions. We find that when recommendations are given, behavior differs from both a mixed‐strategy Nash equilibrium and behavior without recommendations. In particular, subjects typically follow recommendations if and only if (1) those recommendations derive from a correlated equilibrium and (2) that correlated equilibrium is payoff‐enhancing relative to the available Nash equilibria.     

Commitment and observability in a contracting environment

This paper examines leader-follower games where a leader must purchase an essential input from a price-setting supplier in order to take an action. We show that equilibrium outcomes when the followers perfectly observe the leaders' actions cannot be approximated by mixed equilibrium outcomes of the game where followers imperfectly observe the leaders' actions, i.e. they are not accessible. Accessibility fails since in a pure strategy equilibrium, a supplier makes positive profits; however in an equilibrium where a leader randomizes, supplier profits must be zero. Our result follows from a generalized indifference principle that mixed strategies must satisfy in economic environments. While supplier profits cannot be approximated, player action profiles are accessible. Our results also apply to games with costly observation.     

Reputation and Perfection in Repeated Common Interest Games

We consider a wide class of repeated common interest games perturbed with one-sided incomplete information: one player (the informed player) might be a commitment type playing the Pareto dominant action. As discounting, which is assumed to be symmetric, and the prior probability of the commitment type go to zero, it is shown that the informed player can be held close to her minmax payoff even when perfection is imposed on the equilibrium.Journal of Economic LiteratureClassification Numbers: C73, D83.     

Existence and Uniqueness of Nash Equilibrium in Electoral Competition Games: The Hybrid Case

This paper analyzes the traditional unidimensional, two‐party electoral competition game when parties have mixed motivations, in the sense that they are interested in winning the election, but also in the policy implemented after the contest. In spite of having discontinuous payoffs, this game, referred to as the hybrid election game, is shown to be payoff secure and reciprocally upper semi‐continuous. Conditional payoffs, however, are not quasi‐concave. Hence, the existence of a pure strategy Nash equilibrium (psne ) is ensured only if parties have homogenous interests in power. In that case, an equilibrium not only exists, but it is also unique. Instead, if parties have heterogeneous motivations, depending upon the relationship between the electoral uncertainty, the aggregate opportunism, and its distribution across parties, a psne may or may not exist. The mixed extension, however, is always better reply secure. Therefore, a mixed strategy Nash equilibrium does indeed exist.     

A note on asymmetric and mixed strategy equilibria in the search-theoretic model of fiat money

Summary. The simple search-theoretic model of fiat money has three symmetric Nash equilibria: all agents accept money with probability 1; all agents accept money with probability 0; and all agents accept money with probability y in (0,1). Here I construct an asymmetric pure strategy equilibrium, payoff-equivalent to the symmetric mixed strategy equilibrium, where a fraction N in (0,1) of agents always accept money and 1-N never accept money. Counter to what has been conjectured previously, I find N > y. I also introduce evolutionary dynamics, and show that the economy converges to monetary exchange iff the initial proportion of agents accepting money exceeds N. Received: September 10, 1997; revised version: April 24, 1998     

Sophisticated play by idiosyncratic agents

Agents are drawn from a large population and matched to play a symmetric coordination game, the payoffs of which are perturbed by agent-specific heterogeneity. Individuals observe a (possibly sampled) history of play, which forms the initial hypothesis for an opponent's behaviour. Using this hypothesis as a starting point, the agents iteratively reason toward a Bayesian Nash equilibrium. When sampling is complete and the noise becomes vanishingly small, a single equilibrium is played almost all the time. A necessary and sufficient condition for selection, shown to be closely related (but not identical) to risk-dominance, is derived. When sampling is sufficiently incomplete, the risk-dominant equilibrium is played irrespective of the history observed.JEL Classification: C72, C73The authors thank Tom Norman, Kevin Roberts, Hyun Shin, Peyton Young, the editor and an anonymous referee for helpful comments. Correspondence to: C. Wallace     

An Evolutionary Interpretation of Mixed-Strategy Equilibria

A convincing interpretation of mixed-strategy equilibria describes them as steady states in a large population in which players use pure strategies but the population as a whole mimics a mixed strategy. I study the conditions under which an evolutionary, stochastic learning process converges to the appropriate distribution over pure strategies in the population. I find that not all mixed equilibria can be justified as the result of an evolutionary process even if the equilibrium is unique. For symmetric 2 × 2 and 3 × 3 games I give necessary and sufficient conditions for convergence, which are related to the concept of an ESS, and forn × ngames I give a sufficient condition.Journal of Economic LiteratureClassification Numbers: C73, D83.     

A game theoretical approach to the international debt overhang

We consider an international financial problem called debt overhang, by which we mean a situation where a sovereign country has borrowed money from foreign banks and has been unable to fulfill the scheduled repayments for some period. The problem is formulated as a noncooperative game withn lender banks as players where each decides either to sell its loan exposure to the debtor country at the present price of debt on the secondary market, or to wait and keep its exposure. This game has many pure and mixed strategy Nash equilibria. We show, however, that in any Nash equilibrium, the resulting secondary market price remains almost the same as the present price for a large number of banks. We also obtain the comparative statics result that in a mixed strategy equilibrium, a bank with a smaller loan exposure has a greater tendency to sell than one with a larger loan exposure. We discuss the implications of these results for the functioning of the secondary market and the resolution of debt overhang.We thank J. Crémer, H. Haller, S. Mendes, and the referees of this Journal for helpful comments on earlier drafts.     

Stochastic strategy adjustment in coordination games

Summary. The paper explores a model of equilibrium selection in coordination games, where agents from an infinite population stochastically adjust their strategies to changes in their local environment. Instead of playing perturbed best-response, it is assumed that agents follow a rule of ‘switching to better strategies with higher probability’. This behavioral rule is related to bounded-rationality models of Rosenthal (1989) and Schlag (1998). Moreover, agents stay with their strategy in case they successfully coordinate with their local neighbors. Our main results show that both strict Nash equilibria of the coordination game correspond to invariant distributions of the process, hence evolution of play is not ergodic but instead depends on initial conditions. However, coordination on the risk-dominant equilibrium occurs with probability one whenever the initial fraction contains infinitely many agents, independent of the spatial distribution of these agents. Received: March 14, 2000; revised version: June 21, 2001     

Evolution of Walrasian equilibrium in an exchange economy

We study the stochastic stability of a dynamic trading process in an exchange economy. We use a simplified version of a trading model à la Shapley and Shubik (J Polit Econ 85:937–968, 1977). Two types of agents equipped with Leontief preferences trade goods in markets by offering endowments, and actual trades occur at market clearing prices. Better behavior tends to spread through the same type of agents by imitation, and agents also make mistakes occasionally. We provide a sufficient condition for the perturbed dynamic process to have a unique stochastically stable state that is a Walrasian equilibrium allocation. In this sense, we give a rationale for Walrasian behavior.     

Sequential Equilibrium and Competition in a Diamond–Dybvig Banking Model

Within the framework of a Diamond–Dybvig model [J. Polit. Econ.91(1983), 401–419], but with explicitly modelling the autarky choice during the planning period, we demonstrate that a mixed strategy bank run equilibrium that does not rely on sunspots may coexist with the sunspot run equilibrium previously studied in the literature. In a version of the model with multiple banks, there exist sequential equilibria that imply positive profits. However, the zero-profit contract in which runs never occur can be supported as the unique equilibrium outcome if the agents play pure strategies only and their beliefs are restricted to be consistennt with a forward induction argument.Journal of Economic LiteratureClassification Numbers: C72, G21     

Noncooperative foundations of the nucleolus in majority games

This paper studies coalition formation, payoff division and expected payoffs in a “divide the dollar by majority rule” game with random proposers. A power index is called self-confirming if it can be obtained as an equilibrium of the game using the index itself as probability vector. Unlike the Shapley value and other commonly used power indices, the nucleolus has this property. The proof uses a weak version of Kohlberg's [SIAM J. Appl. Math. 20 (1971) 62] balancedness result reinterpreting the balancing weights as probabilities in a mixed strategy equilibrium.