Communication in repeated games with costly monitoring

We study repeated games with discounting where perfect monitoring is possible, but costly. It is shown that if players can make public announcements, then every payoff vector which is an interior point in the set of feasible and individually rational payoffs can be implemented in a sequential equilibrium of the repeated game when the discount factor is high enough. Thus, efficiency can be approximated even when the cost of monitoring is high, provided that the discount factor is high enough.     

A folk theorem for stochastic games with private almost-perfect monitoring

We prove a folk theorem for stochastic games with private, almost-perfect monitoring and observable states when the limit set of feasible and individually rational payoffs is independent of the state. This asymptotic state independence holds, for example, for irreducible stochastic games. Our result establishes that the sophisticated construction of Hörner and Olszewski (2006) for repeated games can be adapted to stochastic games, reinforcing our conviction that much knowledge and intuition about repeated games carries over to the analysis of irreducible stochastic games.     

Infinitely repeated games with public monitoring and monetary transfers

This paper studies infinitely repeated games with imperfect public monitoring and the possibility of monetary transfers. It is shown that all public perfect equilibrium payoffs can be implemented with a simple class of stationary equilibria that use stick-and-carrot punishments. A fast algorithm is developed that exactly computes the set of pure strategies equilibrium payoffs for all discount factors.     

Restricted feedback in long term relationships

This paper studies long term relationships, modeled as repeated games, with restricted feedback. Players condition current play on summary statistics of past play rather than the entire history, as may be the case in online markets. Our state strategy equilibrium framework allows for arbitrary restrictions on strategies. We derive a recursive characterization for the set of equilibrium payoffs similar to that of Abreu, Pearce, and Stacchetti (1986, 1990) [2], [3] for perfect public equilibria and show that the set of equilibrium payoffs is the largest fixed point of a monotone operator. We use our characterization to derive necessary and sufficient conditions for efficient trade in a repeated product choice game where costumers condition their purchase decisions only on the last performance signal.     

A limit characterization of belief-free equilibrium payoffs in repeated games

The present paper studies repeated games with private monitoring, and characterizes the set of belief-free equilibrium payoffs in the limit as the discount factor approaches one and the noise on private information vanishes. Contrary to the conjecture by Ely et al. [J.C. Ely, J. Hörner, W. Olszewski, Belief-free equilibria in repeated games, Econometrica 73 (2005) 377-415], the equilibrium payoff set is computed by the same formula, no matter how many players there are. As an application of this result, a version of the folk theorem is established for N-player prisoner's dilemma games.     

Approachability with bounded memory

We study Blackwell's approachability in repeated games with vector payoffs when the approaching player is restricted to use strategies with bounded memory: either strategies with bounded recall, or strategies that can be implemented by finite automata. Our main finding is that the following three statements are equivalent for closed sets. (i) The set is approachable with bounded recall strategies. (ii) The set is approachable with strategies that can be implemented with finite automata. (iii) The set contains a convex approachable set. Using our results we show that (i) there are almost-regret-free strategies with bounded memory, (ii) there is a strategy with bounded memory to choose the best among several experts, and (iii) Hart and Mas-Colell's adaptive learning procedure can be achieved using strategies with bounded memory.     

Strategic Buyers and Privately Observed Prices

A model of finitely repeated price competition between two sellers with differentiated goods and a large buyer is analyzed. The set of pure strategy sequential equilibria is investigated under public and private monitoring. With private monitoring, i.e., when prices are not observable to the competing sellers, all sales are made by the better seller and the set of repeated game equilibrium payoffs coincides with the stage game subgame perfect equilibrium payoffs. This is in sharp contrast to the game with perfect monitoring where the folk theorem obtains. Journal of Economic Literature Classification Numbers: C72, D43.     

Repeated games with one-memory

We study the extent to which equilibrium payoffs of discounted repeated games can be obtained by 1-memory strategies. We establish the following in games with perfect (rich) action spaces: First, when the players are sufficiently patient, the subgame perfect Folk Theorem holds with 1-memory. Second, for arbitrary level of discounting, all strictly enforceable subgame perfect equilibrium payoffs can be approximately supported with 1-memory if the number of players exceeds two. Furthermore, in this case all subgame perfect equilibrium payoffs can be approximately supported by an ε-equilibrium with 1-memory. In two-player games, the same set of results hold if an additional restriction is assumed: Players must have common punishments. Finally, to illustrate the role of our assumptions, we present robust examples of games in which there is a subgame perfect equilibrium payoff profile that cannot be obtained with 1-memory. Thus, our results are the best that can be hoped for.     

Perfect communication equilibria in repeated games with imperfect monitoring

This paper introduces an equilibrium concept called perfect communication equilibrium for repeated games with imperfect private monitoring. This concept is a refinement of Myerson's [Myerson, R.B., 1982. Optimal coordination mechanisms in generalized principal agent problems, J. Math. Econ. 10, 67–81] communication equilibrium. A communication equilibrium is perfect if it induces a communication equilibrium of the continuation game, after every history of messages of the mediator. We provide a characterization of the set of corresponding equilibrium payoffs and derive a Folk Theorem for discounted repeated games with imperfect private monitoring.     

Learning from private information in noisy repeated games

We study the perfect type-contingently public ex-post equilibrium (PTXE) of repeated games where players observe imperfect public signals of the actions played, and both the payoff functions and the map from actions to signal distributions depend on an unknown state. The PTXE payoffs when players are patient are determined by the solutions to a family of linear programming problems. Using this characterization, we develop conditions under which play can be as if the players have learned the state. We provide a sufficient condition for the folk theorem, and a characterization of the PTXE payoffs in games with a known monitoring structure.     

Monotone Games with Positive Spillovers

A monotone game comprises the infinitely repeated play of an n-person stage game, subject to the constraint that players' actions be monotonically nondecreasing over time. These games represent a variety of strategic situations in which players are able to make (partial) commitments. If the stage games have positive spillovers and satisfy certain other conditions, then the limit points of the subgame perfect equilibria are precisely the approachable action profiles. This characterization is applied to voluntary contribution games, market games, and coordination games. Journal of Economic Literature Classification Number: C7.     

Communication in Repeated Games with Private Monitoring

The paper considers repeated games where each player can be observed by only a subset of the other players, and where players can make public announcements about the behavior of the players they observed. We address the following question: What is the minimal level of observability that is required to obtain efficient outcomes? The main result is that the limit set of sequential equilibrium payoffs, when the discount factor tends to one, contains the set of individual rational payoffs whenever each player is observed by at leasttwoother players.Journal of Economic LiteratureClassification Number: C73.     

Renegotiation-proof relational contracts

We study infinitely repeated two-player games with perfect monitoring and assume that each period consists of two stages: one in which the players simultaneously choose an action and one in which they can transfer money to each other. In the first part of the paper, we derive simple conditions that allow a constructive characterization of all Pareto-optimal subgame perfect payoffs for all discount factors. In the second part, we examine different concepts of renegotiation-proofness and extend the characterization to renegotiation-proof payoffs.     

Collusion as public monitoring becomes noisy: Experimental evidence

This paper uses laboratory experiments to test the implications of the theory of repeated games on equilibrium payoffs and estimate strategies in an infinitely repeated prisoners' dilemma game with imperfect public monitoring. We find that subjects' payoffs (i) decrease as noise increases, and (ii) are lower than the theoretical maximum for low noise, but exceed it for high noise. Under the assumption that the subjects' strategy uses thresholds on the public signal for transition between cooperation and punishment states, we find that the best fitting strategy simply compares the most recent public signal against a single threshold.     

Moral Hazard and Private Monitoring

We clarify the role of mixed strategies and public randomization (sunspots) in sustaining near-efficient outcomes in repeated games with private monitoring. We study a finitely repeated game, where the stage game has multiple equilibria and show that mixed strategies can support partial cooperation, but cannot approximate full cooperation even if monitoring is “almost perfect.” Efficiency requires extensive form correlation, where strategies can condition upon a sunspot at the end of each period. For any finite number of repetitions, we approximate the best equilibrium payoff under perfect monitoring, assuming that monitoring is sufficiently accurate and sunspots are available. Journal of Economic Literature Classification Numbers: C73, D82.     

A multinomial probit model of stochastic evolution

A strategy revision process in symmetric normal form games is proposed. Following Kandori et al. (Econometrica 61 (1993) 29), members of a population periodically revise their strategy choice, and choose a myopic best response to currently observed play. Their payoffs are perturbed by normally distributed Harsanyian trembles, so that strategies are chosen according to multinomial probit probabilities. As the variance of payoffs is allowed to vanish, the graph theoretic methods of the earlier literature continue to apply. The distributional assumption enables a convenient closed form characterisation for the weights of the rooted trees. An illustration of the approach is offered, via a consideration of the role of dominated strategies in equilibrium selection.     

A Property of Nash Equilibria in Repeated Games with Incomplete Information

We consider two-person non-zero-sum infinitely repeated games with lack of information on one side. The characterization of Nash equilibrium payoffs obtained by Hart allows for complex strategies, which are actually required by some equilibrium payoffs in some games. We show that appropriate one-shot public communication mechanisms make Nash equilibrium payoffs achievable by means of simple strategies. Furthermore, these mechanisms satisfy a notion of self-fulfillment.Journal of Economic LiteratureClassification Numbers: D82, C72.     

Communication equilibrium payoffs in repeated games with imperfect monitoring

We characterize the set of communication equilibrium payoffs of any undiscounted repeated matrix-game with imperfect monitoring and complete information. For two-player games, a characterization is provided by Mertens, Sorin, and Zamir (Repeated games, Part A (1994) CORE DP 9420), mainly using Lehrer's (Math. Operations Res. (1992) 175) result for correlated equilibria. The main result of this paper is to extend this characterization to the n-player case. The proof of the characterization relies on an analogy with an auxiliary 2-player repeated game with incomplete information and imperfect monitoring. We use Kohlberg's (Int. J. Game Theory (1975) 7) result to construct explicitly a canonical communication device for each communication equilibrium payoff.     

Majority Rule in a Stochastic Model of Bargaining

In this paper we consider multilateral stochastic bargaining models with general agreement rules. For n-player games where in each period a player is randomly selected to allocate a stochastic level of surplus and q?n players have to agree on a proposal to induce its acceptance, we characterize the set of stationary subgame perfect equilibrium payoffs and establish their existence. We show that for agreement rules other than the unanimity rule, the equilibrium payoffs need not be unique. Furthermore, even when the equilibrium is unique, it need not be efficient. Journal of Economic Literature Classification Numbers: C73, C78, D70.     

The optimal degree of cooperation in the repeated Prisoners' Dilemma with side payments

In the infinitely repeated Prisoners' Dilemma with side payments, we characterize the Pareto frontier of the set of subgame perfect equilibrium payoffs for all possible combinations of discount factors. Play paths implementing Pareto dominant equilibrium payoffs are uniquely determined in all but the first period. Full cooperation does not necessarily implement these payoffs even when it maximizes total stage game payoffs. Rather, when the difference in players' discount factors is sufficiently large, Pareto dominant equilibrium payoffs are implemented by partial cooperation supported by repeated payments from the impatient to the patient player. When both players are sufficiently patient, such payoffs, while implemented via full cooperation, are supported by repeated payments from the impatient to the patient player. We characterize conditions under which public randomization has no impact on the Pareto dominant equilibrium payoffs and conditions under which such payoffs are robust to renegotiation.