Adaptation and complexity in repeated games

The paper presents a learning model for two-player infinitely repeated games. In an inference step players construct minimally complex inferences of strategies based on observed play, and in an adaptation step players choose minimally complex best responses to an inference. When players randomly select an inference from a probability distribution with full support the set of steady states is a subset of the set of Nash equilibria in which only stage game Nash equilibria are played. When players make ‘cautious’ inferences the set of steady states is the subset of self-confirming equilibria with Nash outcome paths. When players use different inference rules, the set of steady states can lie between the previous two cases.     

Learning to Learn, Pattern Recognition, and Nash Equilibrium

The paper studies a large class of bounded-rationality, probabilistic learning models on strategic-form games. The main assumption is that players “recognize” cyclic patterns in the observed history of play. The main result is convergence with probability one to a fixed pattern of pure strategy Nash equilibria, in a large class of “simple games” in which the pure equilibria are nicely spread along the lattice of the game. We also prove that a necessary condition for convergence of behavior to a mixed strategy Nash equilibrium is that the players consider arbitrarily long histories when forming their predictions.Journal of Economic LiteratureClassification Numbers: C72, D83.     

Evolutionary stability and lexicographic preferences

We explore the interaction between evolutionary stability and lexicographic preferences. To do so, we define a limit Nash equilibrium for a lexicographic game as the limit of Nash equilibria of nearby games with continuous preferences. Nash equilibria of lexicographic games are limit Nash equilibria, but not conversely. Modified evolutionarily stable strategies (Binmore and Samuelson, 1992. J. Econ. Theory 57, 278–305) are limit Nash equilibria. Modified evolutionary stability differs from “lexicographic evolutionarily stability” (defined by extending the common characterization of evolutionary stability to lexicographic preferences) in the order in which limits in the payoff space and the space of invasion barriers are taken.     

A Note on the Probability of k Pure Nash Equilibria in Matrix Games

A formula is derived for the probability that a "randomly selected" n-person matrix game has exactly k pure strategy equilibria. It is shown that for all n ≥ 2, this probability converges to e⁻¹/k! as the sizes of the strategy sets of at least two players increase without bound. Thus the number of pure strategy equilibria in large random n-person matrix games is approximately Poisson distributed with mean one. The latter is a known result obtained by a new proof in this note. Journal of Economic Literature Classification Number: C72.     

Strategic approximations of discontinuous games

An infinite game is approximated by restricting the players to finite subsets of their pure strategy spaces. A strategic approximationof an infinite game is a countable subset of pure strategies with the property that limits of all equilibria of all sequences of approximating games whose finite strategy sets eventually include each member of the countable set must be equilibria of the infinite game. We provide conditions under which infinite games admit strategic approximations.     

Better-reply dynamics and global convergence to Nash equilibrium in aggregative games

We consider n-person games with quasi-concave payoffs that depend on a player's own action and the sum of all players' actions. We show that a discrete-time, stochastic process in which players move towards better replies—the better-reply dynamics—converges globally to a Nash equilibrium if actions are either strategic substitutes or strategic complements for all players around each Nash equilibrium that is asymptotically stable under a deterministic, adjusted best-reply dynamics. We present an example of a 2-person game with a unique equilibrium where the derivatives of the best-reply functions have different signs and the better-reply dynamics does not converge.     

An Evolutionary Interpretation of Mixed-Strategy Equilibria

A convincing interpretation of mixed-strategy equilibria describes them as steady states in a large population in which players use pure strategies but the population as a whole mimics a mixed strategy. I study the conditions under which an evolutionary, stochastic learning process converges to the appropriate distribution over pure strategies in the population. I find that not all mixed equilibria can be justified as the result of an evolutionary process even if the equilibrium is unique. For symmetric 2 × 2 and 3 × 3 games I give necessary and sufficient conditions for convergence, which are related to the concept of an ESS, and forn × ngames I give a sufficient condition.Journal of Economic LiteratureClassification Numbers: C73, D83.     

Adaptive play with spatial sampling

We consider a 2×2 coordination game where each agent interacts with his neighbors on a ring. Ellison (1993, Econometrica 61, 1047–1071) shows that the discrete dynamical system generated by the myopic best-reply rule converges to a Nash equilibrium or to a two-period limit cycle. Following Young (1993, Econometrica 61, 57–84), we consider a best-reply process with a sampling procedure. Particularly, we introduce a spatial sampling procedure: each agent observes a sample of information in his neighborhood and plays a best reply to it. We show that if the size of the sample of information is not too large, the best-reply process converges almost surely to a Nash equilibrium. If in addition agents experiment with small probabilities, we show that, in most cases, the risk-dominant equilibrium prevails in the long run. Furthermore, it turns out that the convergence is faster than in Ellison.     

Revisiting games of incomplete information with analogy-based expectations

This paper studies the effects of analogy-based expectations in static two-player games of incomplete information. Players are assumed to be boundedly rational in the way they forecast their opponent's state-contingent strategy: they bundle states into analogy classes and play best-responses to their opponent's average strategy in those analogy classes. We provide general properties of analogy-based expectation equilibria and apply the model to a variety of well known games. We characterize conditions on the analogy partitions for successful coordination in coordination games under incomplete information [Rubinstein, A., 1989. The electronic mail game: Strategic behavior under ‘almost common knowledge’. Amer. Econ. Rev. 79, 385–391], we show how analogy grouping of the receiver may facilitate information transmission in Crawford and Sobel's cheap talk games [Crawford, V.P., Sobel, J., 1982. Strategic information transmission. Econometrica 50, 1431–1451], and we show how analogy grouping may give rise to betting in zero-sum betting games such as those studied to illustrate the no trade theorem.     

Essential equilibria of large generalized games

We characterize the essential stability of games with a continuum of players, where strategy profiles may affect objective functions and admissible strategies. Taking into account the perturbations defined by a continuous mapping from a complete metric space of parameters to the space of continuous games, we prove that essential stability is a generic property and every game has a stable subset of equilibria. These results are extended to discontinuous large generalized games assuming that only payoff functions are subject to perturbations. We apply our results in an electoral game with a continuum of Cournot-Nash equilibria, where the unique essential equilibrium is that only politically engaged players participate in the electoral process. In addition, employing our results for discontinuous games, we determine the stability properties of competitive prices in large economies.     

Nearly compact and continuous normal form games: characterizations and equilibrium existence

Normal form games are nearly compact and continuous (NCC) if they can be understood as games played on strategy spaces that are dense subsets of the strategy spaces of larger compact games with jointly continuous payoffs. There are intrinsic algebraic, measure theoretic, functional analysis, and finite approximability characterizations of NCC games. NCC games have finitely additive equilibria, and all their finitely additive equilibria are equivalent to countably additive equilibria on metric compactifications. The equilibrium set of an NCC game depends upper hemicontinuously on the specification of the game and contains only the limits of approximate equilibria of approximate games.     

Existence of equilibrium in common agency games with adverse selection

We establish the existence of subgame perfect equilibria in general menu games, known to be sufficient to analyze common agency problems. Our main result states that every menu game satisfying enough continuity properties has a subgame perfect equilibrium. Despite the continuity assumptions that we make, discontinuities naturally arise due to the absence, in general, of continuous optimal choices for the agent. Our approach, then, is based on (and generalizes) the existence theorem of [Simon, L., Zame, W., 1990. Discontinuous games and endogenous sharing rules. Econometrica 58 (4), 861–872] designed for discontinuous games.     

The Explanatory Power of Game Theory in International Politics: Syrian–Israeli Crisis Interactions, 1951–87

The present paper assesses the usefulness of game theory in explaining crisis interactions between Israel and Syria. We begin with the simplest game-theoretic tool for analyzing strategic situations: the one-shot 2×2 game. By analyzing the various episodes of the protracted Syrian--Israeli conflict as one-shot 2×2 games, we avoid the multiplicity of equilibria of the infinitely repeated game and the difficulty of specifying an endpoint of a finitely repeated game. The pure strategy Nash equilibria of these one-shot games are treated as theoretical predictions and are compared with the observed outcomes.     

Trees and extensive forms

This paper addresses the question of what it takes to obtain a well-defined extensive form game. Without relying on simplifying finiteness or discreteness assumptions, we characterize the class of game trees for which all pure strategy combinations induce unique outcomes. The generality of the set-up covers “exotic” cases, like stochastic games or decision problems in continuous time (differential games). We find that the latter class, though a well-defined problem, fails this test.     

Robustness to strategic uncertainty

We introduce a criterion for robustness to strategic uncertainty in games with continuum strategy sets. We model a player's uncertainty about another player's strategy as an atomless probability distribution over that player's strategy set. We call a strategy profile robust to strategic uncertainty if it is the limit, as uncertainty vanishes, of some sequence of strategy profiles in which every player's strategy is optimal under his or her uncertainty about the others. When payoff functions are continuous we show that our criterion is a refinement of Nash equilibrium and we also give sufficient conditions for existence of a robust strategy profile. In addition, we apply the criterion to Bertrand games with convex costs, a class of games with discontinuous payoff functions and a continuum of Nash equilibria. We show that it then selects a unique Nash equilibrium, in agreement with some recent experimental findings.     

The pre-marital investment game

Two sides of a finite marriage market engage in costly investment and are then matched assortatively. The purpose of the investment is solely to improve the quality of the match that the trader can attain in the second stage. The paper studies the limits of equilibrium of these finite matching games as the number of traders gets large. It is shown that mixed Nash equilibria in the finite games converge to degenerate pure strategy equilibria in the limit in which both sides of the market invest too much.     

An experimental study of costly coordination

This paper reports data for coordination game experiments with random matching. The experimental design is based on changes in an effort-cost parameter, which do not alter the set of Nash equilibria nor do they alter the predictions of adjustment theories based on imitation or best response dynamics. As expected, however, increasing the effort cost lowers effort levels. Maximization of a stochastic potential function, a concept that generalizes risk dominance to continuous games, predicts this reduction in efforts. An error parameter estimated from initial two-person, minimum-effort games is used to predict behavior in other three-person coordination games.     

Aggregative games and best-reply potentials

This paper introduces quasi-aggregative games and establishes conditions under which such games admit a best-reply potential. This implies existence of a pure strategy Nash equilibrium without any convexity or quasi-concavity assumptions. It also implies convergence of best-reply dynamics under some additional assumptions. Most of the existing literature’s aggregation concepts are special cases of quasi-aggregative games, and many new situations are allowed for. An example is payoff functions that depend on own strategies as well as a linear combination of the mean and the variance of players’ strategies.     

Dynamics in near-potential games

We consider discrete-time learning dynamics in finite strategic form games, and show that games that are close to a potential game inherit many of the dynamical properties of potential games. We first study the evolution of the sequence of pure strategy profiles under better/best response dynamics. We show that this sequence converges to a (pure) approximate equilibrium set whose size is a function of the “distance” to a given nearby potential game. We then focus on logit response dynamics, and provide a characterization of the limiting outcome in terms of the distance of the game to a given potential game and the corresponding potential function. Finally, we turn attention to fictitious play, and establish that in near-potential games the sequence of empirical frequencies of player actions converges to a neighborhood of (mixed) equilibria, where the size of the neighborhood increases according to the distance to the set of potential games.     

Evolutionary dynamics on infinite strategy spaces

Summary. The study of evolutionary dynamics was so far mainly restricted to finite strategy spaces. In this paper we show that this unsatisfying restriction is unnecessary. We specify a simple condition under which the continuous time replicator dynamics are well defined for the case of infinite strategy spaces. Furthermore, we provide new conditions for the stability of rest points and show that even strict equilibria may be unstable. Finally, we apply this general theory to a number of applications like the Nash demand game, the War of Attrition, linear-quadratic games, the harvest preemption game, and games with mixed strategies. Received: June 25, 1999; revised version: January 31, 2000