Reputation and Perfection in Repeated Common Interest Games

We consider a wide class of repeated common interest games perturbed with one-sided incomplete information: one player (the informed player) might be a commitment type playing the Pareto dominant action. As discounting, which is assumed to be symmetric, and the prior probability of the commitment type go to zero, it is shown that the informed player can be held close to her minmax payoff even when perfection is imposed on the equilibrium.Journal of Economic LiteratureClassification Numbers: C73, D83.     

On the folk theorem with one-dimensional payoffs and different discount factors

Proving the folk theorem in a game with three or more players usually requires imposing restrictions on the dimensionality of the stage-game payoffs. Fudenberg and Maskin (1986) assume full dimensionality of payoffs, while Abreu et al. (1994) assume the weaker NEU condition (“nonequivalent utilities”). In this note, we consider a class of n-player games where each player receives the same stage-game payoff, either zero or one. The stage-game payoffs therefore constitute a one-dimensional set, violating NEU. We show that if all players have different discount factors, then for discount factors sufficiently close to one, any strictly individually rational payoff profile can be obtained as the outcome of a subgame-perfect equilibrium with public correlation.     

Sustainable reputations with rating systems

In a product choice game played between a long lived seller and an infinite sequence of buyers, we assume that buyers cannot observe past signals. To facilitate the analysis of applications such as online auctions (e.g. eBay), online shopping search engines (e.g. BizRate.com) and consumer reports, we assume that a central mechanism observes all past signals, and makes public announcements every period. The set of announcements and the mapping from observed signals to the set of announcements is called a rating system. We show that, absent reputation effects, information censoring cannot improve attainable payoffs. However, if there is an initial probability that the seller is a commitment type that plays a particular strategy every period, then there exists a finite rating system and an equilibrium of the resulting game such that, the expected present discounted payoff of the seller is almost his Stackelberg payoff after every history. This is in contrast to Cripps, Mailath and Samuelson (2004) [5], where it is shown that reputation effects do not last forever in such games if buyers can observe all past signals. We also construct finite rating systems that increase payoffs of almost all buyers, while decreasing the seller?s payoff.     

Cycling in a stochastic learning algorithm for normal form games

In this paper we study a stochastic learning model for 2×2 normal form games that are played repeatedly. The main emphasis is put on the emergence of cycles. We assume that the players have neither information about the payoff matrix of their opponent nor about their own. At every round each player can only observe his or her action and the payoff he or she receives. We prove that the learning algorithm, which is modeled by an urn scheme proposed by Arthur (1993), leads with positive probability to a cycling of strategy profiles if the game has a mixed Nash equilibrium. In case there are strict Nash equilibria, the learning process converges a.s. to the set of Nash equilibria.     

When is reputation bad?

In traditional reputation models, the ability to build a reputation is good for the long-run player. In [Ely, J., Valimaki, J., 2003. Bad reputation. NAJ Econ. 4, 2; http://www.najecon.org/v4.htm. Quart. J. Econ. 118 (2003) 785–814], Ely and Valimaki give an example in which reputation is unambiguously bad. This paper characterizes a class of games in which that insight holds. The key to bad reputation is that participation is optional for the short-run players, and that every action of the long-run player that makes the short-run players want to participate has a chance of being interpreted as a signal that the long-run player is “bad.” We allow a broad set of commitment types, allowing many types, including the “Stackelberg type” used to prove positive results on reputation. Although reputation need not be bad if the probability of the Stackelberg type is too high, the relative probability of the Stackelberg type can be high when all commitment types are unlikely.     

Uniqueness of Stationary Equilibrium Payoffs in the Baron-Ferejohn Model

We consider a multilateral sequential bargaining model in which the players may differ in their probability of being selected as the proposer and the rate at which they discount future payoffs. For games in which agreement requires less than unanimous consent, we characterize the set of stationary subgame perfect equilibrium payoffs. With this characterization, we establish the uniqueness of the equilibrium payoffs. For the case where the players have the same discount factor, we show that the payoff to a player is nondecreasing in his probability of being selected as the proposer. For the case where the players have the same probability of being selected as the proposer, we show that the payoff to a player is nondecreasing in his discount factor. Journal of Economic Literature Classification numbers: C72, C78, D70.     

Impermanent types and permanent reputations

We study the impact of unobservable stochastic replacements for the long-run player in the classical reputation model with a long-run player and a series of short-run players. We provide explicit lower bounds on the Nash equilibrium payoffs of a long-run player, both ex-ante and following any positive probability history. Under general conditions on the convergence rates of the discount factor to one and of the rate of replacement to zero, both bounds converge to the Stackelberg payoff if the type space is sufficiently rich. These limiting conditions hold in particular if the game is played very frequently.     

Global dynamics in repeated games with additively separable payoffs

This paper studies the global dynamics of a class of infinitely repeated two-player games in which the action space of each player is an interval, and the one-shot payoff of each player is additively separable in actions. We define an immediately reactive equilibrium (IRE) as a pure-strategy subgame perfect equilibrium such that each player's action is a stationary function of the opponent's last action. We completely characterize IREs and their dynamics in terms of certain indifference curves. Our results are used to show that in a prisoners' dilemma game with mixed strategies, gradual cooperation occurs when the players are sufficiently patient, and that in a certain duopoly game, kinked demand curves emerge naturally.     

Learning to play games in extensive form by valuation

Game theoretic models of learning which are based on the strategic form of the game cannot explain learning in games with large extensive form. We study learning in such games by using valuation of moves. A valuation for a player is a numeric assessment of her moves that purports to reflect their desirability. We consider a myopic player, who chooses moves with the highest valuation. Each time the game is played, the player revises her valuation by assigning the payoff obtained in the play to each of the moves she has made. We show for a repeated win-lose game that if the player has a winning strategy in the stage game, there is almost surely a time after which she always wins. When a player has more than two payoffs, a more elaborate learning procedure is required. We consider one that associates with each move the average payoff in the rounds in which this move was made. When all players adopt this learning procedure, with some perturbations, then, with probability 1 there is a time after which strategies that are close to subgame perfect equilibrium are played. A single player who adopts this procedure can guarantee only her individually rational payoff.     

Markov perfect equilibria in industries with complementarities

Summary.   This paper considers the existence and computation of Markov perfect equilibria in games with a “monotone” structure. Specifically, it provides a constructive proof of the existence of Markov perfect equilibria for a class of games in which a) there is a continuum of players, b) each player has the same per period payoff function and c) these per period payoff functions are supermodular in the player's current and past action and have increasing differences in the player's current action and the entire distribution of actions chosen by other players. The Markov perfect equilibria that are analyzed are symmetric, not in the sense that each player adopts the same action in any period, but rather in the sense that each player uses the same policy function. Since agents are typically distributed across many states they will typically take different actions. The formal environment considered has particular application to models of industries (or economies) in which firms face costs of price adjustment. It is in this context that the results are developed. Received: November 9, 1999; revised version: February 10, 2000     

Aggregate comparative statics

In aggregative games, each playerʼs payoff depends on her own actions and an aggregate of the actions of all the players. Many common games in industrial organization, political economy, public economics, and macroeconomics can be cast as aggregative games. This paper provides a general and tractable framework for comparative static results in aggregative games. We focus on two classes of games: (1) aggregative games with strategic substitutes and (2) nice aggregative games, where payoff functions are continuous and concave in own strategies. We provide simple sufficient conditions under which positive shocks to individual players increase their own actions and have monotone effects on the aggregate. The results are illustrated with applications to public good provision, contests, Cournot competition and technology choices in oligopoly.     

Repeated signaling games

I analyze a class of repeated signaling games in which the informed player's type is persistent and the history of actions is perfectly observable. In this context, a large class of possibly complex sequences of signals can be supported as the separating equilibrium actions of the “strong type” of the informed player. I characterize the set of such sequences. I also characterize the sequences of signals in least cost separating equilibria (LCSE) of these games. In doing this, I introduce a state variable that can be interpreted as a measure of reputation. This gives the optimization problem characterizing the LCSE a recursive structure. I show that, in general, the equilibrium path sequences of signals have a simple structure. The shapes of the optimal sequences depend critically on the relative concavities of the payoff functions of different types, which measure the relative preferences towards payoff smoothing.     

Bargaining with Imperfect Commitment

We study the effect of imperfect commitment in noncooperative two-person bargaining games. By establishing the reputation for being stubborn, a player sometimes commits to her initial demand, becoming unable to change her demands or to accept an inferior offer from her opponent. When the probability of being stubborn is small, the set of equilibria is shown to be small and agreement may be reached immediately despite the possibility of stubbornness. A player has greater bargaining power when she is more patient and/or is more likely to be stubborn. Journal of Economic Literature Classification Number: C78.     

A folk theorem for repeated games played on a network

I consider repeated games on a network where players interact and communicate with their neighbors. At each stage, players choose actions and exchange private messages with their neighbors. The payoff of a player depends only on his own action and on the actions of his neighbors. At the end of each stage, a player is only informed of his payoff and of the messages he received from his neighbors. Payoffs are assumed to be sensitive to unilateral deviations. The main result is to establish a necessary and sufficient condition on the network for a Nash folk theorem to hold, for any such payoff function.     

Stochastic games with information lag

Two-player zero-sum stochastic games with finite state and action spaces are known to have undiscounted values. We study such games under the assumption that one or both players observe the actions of their opponent after some time-dependent delay. We develop criteria for the rate of growth of the delay such that a player subject to such an information lag can still guarantee himself in the undiscounted game as much as he could have with perfect monitoring. We also demonstrate that the player in the Big Match with the absorbing action subject to information lags that grows too rapidly will not be able to guarantee as much as he could have in the game with perfect monitoring.     

Type correlated equilibria for games with payoff uncertainty

Summary Aumann's notion of correlated equilibrium is extended to games with payoff uncertainty. A type correlated equilibrium is a correlated equilibrium for Harsanyi's game in player-types. An equivalent definition is a probability distribution over types and actions which is consistent with the prior distribution over types, such that when each player observes its type and action, the observed action is optimal and no further information about other players' types is obtained. Any such equilibrium can be implemented by a type-independent correlation device when players' observations may be type-dependent. The type correlated equilibrium correspondence is shown to be upperhemicontinuous with respect to player information.Support from NSF grant IRI-8609208 is gratefully acknowledged. I am grateful to Maxwell Stinchcombe for comments on an earlier draft of this paper. Any remaining errors are my own.     

Repeated games with present-biased preferences

We study infinitely repeated games with perfect monitoring, where players have β-δ preferences. We compute the continuation payoff set using recursive techniques and then characterize equilibrium payoffs. We then explore the cost of the present-time bias, producing comparative statics. Unless the minimax outcome is a Nash equilibrium of the stage game, the equilibrium payoff set is not monotonic in β or δ. Finally, we show how the equilibrium payoff set is contained in that of a repeated game with smaller discount factor.     

GLOBAL GAMES WITH STRATEGIC SUBSTITUTES

We study global games with strategic substitutes. Specifically, for a class of binary‐action, ‐player games with strategic substitutes, we prove that under payoff asymmetry, as incomplete information vanishes, the global games approach selects a unique equilibrium. We characterize this equilibrium profile ; players employ switching strategies at different cutoff signals, the order of which is directly determined by payoff asymmetry. We provide examples that illustrate our result and its connection with dominance solvability. We extend the global game literature, which has thus far been developed for games with strategic complementarities, to new applications in industrial organization, collective action problems, finance, etc .     

The single deviation property in games with discontinuous payoffs

We study equilibrium existence in normal form games in which it is possible to associate with each nonequilibrium point an open neighborhood, a set of players, and a collection of deviation strategies, such that at any nonequilibrium point of the neighborhood, a player from the set can increase her payoff by switching to the deviation strategy designated for her. An equilibrium existence theorem for compact, quasiconcave games with two players is established as an application of a general equilibrium existence result for qualitative games. A new form of the better-reply security condition, called the strong single deviation property, is proposed.     

Characterizing belief-free review-strategy equilibrium payoffs under conditional independence

This paper proposes and studies a tractable subset of Nash equilibria, belief-free review-strategy equilibria, in repeated games with private monitoring. The payoff set of this class of equilibria is characterized in the limit as the discount factor converges to one for games where players observe statistically independent signals. As an application, we develop a simple sufficient condition for the existence of asymptotically efficient equilibria, and establish a folk theorem for N-player prisoner?s dilemma. All these results are robust to a perturbation of the signal distribution, and hence remain true even under almost-independent monitoring.