Adaptation and complexity in repeated games

The paper presents a learning model for two-player infinitely repeated games. In an inference step players construct minimally complex inferences of strategies based on observed play, and in an adaptation step players choose minimally complex best responses to an inference. When players randomly select an inference from a probability distribution with full support the set of steady states is a subset of the set of Nash equilibria in which only stage game Nash equilibria are played. When players make ‘cautious’ inferences the set of steady states is the subset of self-confirming equilibria with Nash outcome paths. When players use different inference rules, the set of steady states can lie between the previous two cases.     

Strategic market games with a finite horizon and incomplete markets

Summary. We study a strategic market game associated to an intertemporal economy with a finite horizon and incomplete markets. We demonstrate that generically, for any finite number of players, every sequentially strictly individually rational and default-free stream of allocations can be approximated by a full subgame-perfect equilibrium. As a consequence, imperfect competition may Pareto-dominate perfect competition when markets are incomplete. Moreover - and this contrasts with the main message conveyed by the market games literature - there exists a large open set of initial endowments for which full subgame-perfect equilibria do not converge to -efficient allocations when the number of players tends to infinity. Finally, strategic speculative bubbles may survive at full subgame-perfect equilibria.Received: 24 January 2002, Revised: 21 February 2003, JEL Classification Numbers: C72, D43, D52. Correspondence to: Gaël GiraudWe thank Tim Van Zandt for his comments.     

Competitive environments and protective behavior

The class of two-person competition games is introduced and analyzed. For any game in this class the set of Nash equilibria is convex and all Nash equilibria lead to the same payoff vector. Competition games are compared to other competitive environments such as unilaterally competitive games and rivalry games. Moreover, protective behavior within competitive environments is analyzed. For matrix games it is known that protective strategies profiles exactly correspond to proper equilibria. It is shown that this result can be extended to the class of unilaterally competitive games.     

On ‘Informationally Robust Equilibria’ for Bimatrix Games

Informationally robust equilibria (IRE) are introduced in Robson (Games Econ Behav 7: 233–245, 1994) as a refinement of Nash equilibria for strategic games. Such equilibria are limits of a sequence of (subgame perfect) Nash equilibria in perturbed games where with small probability information about the strategic behavior is revealed to other players (information leakage). Focusing on bimatrix games, we consider a type of informationally robust equilibria and derive a number of properties they form a non-empty and closed subset of the Nash equilibria. Moreover, IRE is a strict concept in the sense that the IRE are independent of the exact sequence of probabilities with which information is leaked. The set of IRE, like the set of Nash equilibria, is the finite union of polytopes. In potential games, there is an IRE in pure strategies. In zero-sum games, the set of IRE has a product structure and its elements can be computed efficiently by using linear programming. We also discuss extensions to games with infinite strategy spaces and more than two players. The authors would like to thank Marieke Quant for her helpful comments.     

Iterated strict dominance in general games

We offer a definition of iterated elimination of strictly dominated strategies (IESDS^*) for games with (in)finite players, (non)compact strategy sets, and (dis)continuous payoff functions. IESDS^* is always a well-defined order independent procedure that can be used to solve Nash equilibrium in dominance-solvable games. We characterize IESDS^* by means of a “stability” criterion, and offer a sufficient and necessary epistemic condition for IESDS^*. We show by an example that IESDS^* may generate spurious Nash equilibria in the class of Reny's better-reply secure games. We provide sufficient/necessary conditions under which IESDS^* preserves the set of Nash equilibria.     

Endogenous transfers in the Prisoner's Dilemma game: An experimental test of cooperation and coordination

We test a two-stage compensation mechanism for promoting cooperation in Prisoner's Dilemma games. Players first simultaneously choose binding non-negative amounts to pay their counterparts for cooperating, and then play the induced game knowing these amounts. In our games, all payment pairs consistent with mutual cooperation in subgame-perfect equilibrium transform these games into coordination games, with both mutual cooperation and mutual defection as Nash equilibria in the second stage. When endogenous transfer payments are not permitted, cooperation is much less likely. Mutual cooperation is most likely when the (sufficient) payments are identical, and it is also substantially more likely with payment pairs that bring the mutual-cooperation payoffs closer together. Both the Fehr–Schmidt and Charness–Rabin models predict that transfers that make final payoffs closer are preferred; however, they do not explain why equal transfers are particularly effective. Transfers are also effective in sustaining cooperation even when they are imposed and not chosen.     

Asymptotic expected number of Nash equilibria of two-player normal form games

The formula given by McLennan [The mean number of real roots of a multihomogeneous system of polynomial equations, Amer. J. Math. 124 (2002) 49–73] is applied to the mean number of Nash equilibria of random two-player normal form games in which the two players have M and N pure strategies respectively. Holding M fixed while N→∞, the expected number of Nash equilibria is approximately . Letting M=N→∞, the expected number of Nash equilibria is , where is a constant, and almost all equilibria have each player assigning positive probability to approximately 31.5915 percent of her pure strategies.     

Better-reply dynamics and global convergence to Nash equilibrium in aggregative games

We consider n-person games with quasi-concave payoffs that depend on a player's own action and the sum of all players' actions. We show that a discrete-time, stochastic process in which players move towards better replies—the better-reply dynamics—converges globally to a Nash equilibrium if actions are either strategic substitutes or strategic complements for all players around each Nash equilibrium that is asymptotically stable under a deterministic, adjusted best-reply dynamics. We present an example of a 2-person game with a unique equilibrium where the derivatives of the best-reply functions have different signs and the better-reply dynamics does not converge.     

Brown–von Neumann–Nash dynamics: The continuous strategy case

Brown and von Neumann introduced a dynamical system that converges to saddle points of zero sum games with finitely many strategies. Nash used the mapping underlying these dynamics to prove existence of equilibria in general games. The resulting Brown–von Neumann–Nash dynamics are a benchmark example for myopic adjustment dynamics that, in contrast to replicator dynamics, allow for innovation, but require less rationality than the best response dynamics. This paper studies the BNN dynamics for games with infinitely many strategies. We establish Nash stationarity for continuous payoff functions. For negative semidefinite games (that include zero sum games), we generalize the results of Brown and von Neumann. In addition, we show that evolutionarily robust Nash equilibria are asymptotically stable. A complete stability analysis for doubly symmetric games is also obtained.     

Finding all equilibria in games of strategic complements

I present a simple and fast algorithm that finds all the pure-strategy Nash equilibria in games with strategic complementarities. This is the first non-trivial algorithm for finding all pure-strategy Nash equilibria.     

Preparation

A product set of pure strategies is a prep set (‘prep’ is short for ‘preparation’) if it contains at least one best reply to any consistent belief that a player may have about the strategic behavior of his opponents. Minimal prep sets are shown to exist in a class of strategic games satisfying minor topological conditions. The concept of minimal prep sets is compared with (pure and mixed) Nash equilibria, rationalizability, minimal curb sets, and persistent retracts.     

Two more classes of games with the continuous-time fictitious play property

Fictitious Play is the oldest and most studied learning process for games. Since the already classical result for zero-sum games, convergence of beliefs to the set of Nash equilibria has been established for several classes of games, including weighted potential games, supermodular games with diminishing returns, and 3×3 supermodular games. Extending these results, we establish convergence of Continuous-time Fictitious Play for ordinal potential games and quasi-supermodular games with diminishing returns. As a by-product we obtain convergence for 3×m and 4×4 quasi-supermodular games.     

Cournot–Nash equilibria in continuum games with non-ordered preferences

In the usual framework of continuum games with externalities, we substantially generalize Cournot–Nash existence results [Balder, A unifying approach to existence of Nash equilibria, Int. J.Game Theory 24 (1995) 79–94; On the existence of Cournot–Nash equilibria in continuum games, J. Math. Econ. 32 (1999) 207–223; A unifying pair of Cournot–Nash equilibrium existence results, J. Econ. Theory 102 (2002) 437–470] to games with possibly non-ordered preferences, providing a continuum analogue of the seminal existence results by Mas-Colell [An equilibrium existence theorem without complete or transitive preferences, J. Math. Econ. 1 (1974) 237–246], Gale and Mas-Colell [An equilibrium existence theorem for a general model without ordered preferences, J. Math. Econ. 2 (1975) 9–15], Shafer and Sonnenschein [Equilibrium in abstract economies without ordered preferences, J. Math. Econ. 2 (1975) 345–348], Borglin and Keiding [Existence of equilibrium actions and of equilibrium: a note on the “new” existence theorems, J. Math. Econ. 3 (1976) 313–316] and Yannelis and Prabhakar [Existence of maximal elements and equilibria in linear topological spaces, J. Math. Econ. 12 (1983) 233–245].     

A general structure theorem for the Nash equilibrium correspondence

I consider n-person normal form games where the strategy set of each player is a non-empty compact convex subset of an Euclidean space, and the payoff function of player i is continuous in joint strategies and continuously differentiable and concave in the player i's strategy. No further restrictions (such as multilinearity of the payoff functions or the requirement that the strategy sets be polyhedral) are imposed. I demonstrate that the graph of the Nash equilibrium correspondence on this domain is homeomorphic to the space of games. This result generalizes a well-known structure theorem in [Kohlberg, E., Mertens, J.-F., 1986. On the strategic stability of equilibria. Econometrica 54, 1003–1037]. It is supplemented by an extension analogous to the unknottedness theorems in [Demichelis S., Germano, F., 2000. Some consequences of the unknottedness of the Walras correspondence. J. Math. Econ. 34, 537–545; Demichelis S., Germano, F., 2002. On (un)knots and dynamics in games. Games Econ. Behav. 41, 46–60]: the graph of the Nash equilibrium correspondence is ambient isotopic to a trivial copy of the space of games.     

Non-Additive Beliefs and Strategic Equilibria

This paper studies n-player games where players' beliefs about their opponents' behaviour are modelled as non-additive probabilities. The concept of an “equilibrium under uncertainty” which is introduced in this paper extends the equilibrium notion of Dow and Werlang (1994, J. Econom. Theory64, 305–324) to n-player games in strategic form. Existence of such an equilibrium is demonstrated under usual conditions. For low degrees of ambiguity, equilibria under uncertainty approximate Nash equilibria. At the other extreme, with a low degree of confidence, maximin equilibria appear. Finally, robustness against a lack of confidence may be viewed as a refinement for Nash equilibria. Journal of Economic Literature Classification Numbers: C72, D81.     

Repeated signaling games

I analyze a class of repeated signaling games in which the informed player's type is persistent and the history of actions is perfectly observable. In this context, a large class of possibly complex sequences of signals can be supported as the separating equilibrium actions of the “strong type” of the informed player. I characterize the set of such sequences. I also characterize the sequences of signals in least cost separating equilibria (LCSE) of these games. In doing this, I introduce a state variable that can be interpreted as a measure of reputation. This gives the optimization problem characterizing the LCSE a recursive structure. I show that, in general, the equilibrium path sequences of signals have a simple structure. The shapes of the optimal sequences depend critically on the relative concavities of the payoff functions of different types, which measure the relative preferences towards payoff smoothing.     

Robustness to strategic uncertainty

We introduce a criterion for robustness to strategic uncertainty in games with continuum strategy sets. We model a player's uncertainty about another player's strategy as an atomless probability distribution over that player's strategy set. We call a strategy profile robust to strategic uncertainty if it is the limit, as uncertainty vanishes, of some sequence of strategy profiles in which every player's strategy is optimal under his or her uncertainty about the others. When payoff functions are continuous we show that our criterion is a refinement of Nash equilibrium and we also give sufficient conditions for existence of a robust strategy profile. In addition, we apply the criterion to Bertrand games with convex costs, a class of games with discontinuous payoff functions and a continuum of Nash equilibria. We show that it then selects a unique Nash equilibrium, in agreement with some recent experimental findings.     

Congestion games with malicious players

We study the equilibria of non-atomic congestion games in which there are two types of players: rational players, who seek to minimize their own delay, and malicious players, who seek to maximize the average delay experienced by the rational players. We study the existence of pure and mixed Nash equilibria for these games, and we seek to quantify the impact of the malicious players on the equilibrium. One counterintuitive phenomenon which we demonstrate is the “windfall of malice”: paradoxically, when a myopically malicious player gains control of a fraction of the flow, the new equilibrium may be more favorable for the remaining rational players than the previous equilibrium.     

Interconnected games and international environmental problems

The purpose of this paper is to introduce the concept of interconnected games and to show its relevance for modeling international environmental problems. It is argued that an interconnected game approach to international environmental problems may enhance cooperation and provide an alternative to the use of financial side payments to induce countries to cooperate. Two types of interconnected games are distinguished in this paper, i.e. direct sum games and tensor games. In the former all the constituting isolated games are games in strategic form and in the latter they are repeated games. In both cases the interconnected game can be interpreted as a multiple objective game, but only the setting where a trade-off is made for the vector-payoffs is considered. In addition to the formal definition of these types of interconnected games, some elementary results concerning Nash equilibria of such games are derived.Folmer and v. Mouche: Landbouwuniversiteit Wageningen, Postbus 8130, 6700 EW Wageningen, The Netherlands; Ragland: University of Colorado at Boulder, Boulder, Colorado 80309-0256, U.S.A. An earlier version of this paper was presented at the EAERE conference in Stockholm, June 1991. The authors appreciate comments made by conference participants and journal referees.     

Cycling in a stochastic learning algorithm for normal form games

In this paper we study a stochastic learning model for 2×2 normal form games that are played repeatedly. The main emphasis is put on the emergence of cycles. We assume that the players have neither information about the payoff matrix of their opponent nor about their own. At every round each player can only observe his or her action and the payoff he or she receives. We prove that the learning algorithm, which is modeled by an urn scheme proposed by Arthur (1993), leads with positive probability to a cycling of strategy profiles if the game has a mixed Nash equilibrium. In case there are strict Nash equilibria, the learning process converges a.s. to the set of Nash equilibria.