Perfect communication equilibria in repeated games with imperfect monitoring

This paper introduces an equilibrium concept called perfect communication equilibrium for repeated games with imperfect private monitoring. This concept is a refinement of Myerson's [Myerson, R.B., 1982. Optimal coordination mechanisms in generalized principal agent problems, J. Math. Econ. 10, 67–81] communication equilibrium. A communication equilibrium is perfect if it induces a communication equilibrium of the continuation game, after every history of messages of the mediator. We provide a characterization of the set of corresponding equilibrium payoffs and derive a Folk Theorem for discounted repeated games with imperfect private monitoring.     

Introduction to Repeated Games with Private Monitoring

We present a brief overview of recent developments in discounted repeated games with (imperfect) private monitoring. The literature explores the possibility of cooperation in a long-term relationship, where each agent receives imperfect private information about the opponents' actions. Although this class of games admits a wide range of applications such as collusion under secret price-cutting, exchange of goods with uncertain quality, and observation errors, it has fairly complex mathematical structure due to the lack of common information shared by players. This is in sharp contrast to the well-explored case of repeated games under public information (with the celebrated Folk Theorems), and until recently little had been known about the private monitoring case. However, rapid developments in the past few years have revealed the possibility of cooperation under private monitoring for some class of games. Journal of Economic Literature Classification Numbers: C72, C73, D43, D82, L13, L41.     

A limit characterization of belief-free equilibrium payoffs in repeated games

The present paper studies repeated games with private monitoring, and characterizes the set of belief-free equilibrium payoffs in the limit as the discount factor approaches one and the noise on private information vanishes. Contrary to the conjecture by Ely et al. [J.C. Ely, J. Hörner, W. Olszewski, Belief-free equilibria in repeated games, Econometrica 73 (2005) 377-415], the equilibrium payoff set is computed by the same formula, no matter how many players there are. As an application of this result, a version of the folk theorem is established for N-player prisoner's dilemma games.     

Disappearing private reputations in long-run relationships

For games of public reputation with uncertainty over types and imperfect public monitoring, Cripps et al. [Imperfect monitoring and impermanent reputations, Econometrica 72 (2004) 407-432] showed that an informed player facing short-lived uninformed opponents cannot maintain a permanent reputation for playing a strategy that is not part of an equilibrium of the game without uncertainty over types. This paper extends that result to games in which the uninformed player is long-lived and has private beliefs, so that the informed player's reputation is private. The rate at which reputations disappear is uniform across equilibria and reputations also disappear in sufficiently long discounted finitely repeated games.     

Moral Hazard and Private Monitoring

We clarify the role of mixed strategies and public randomization (sunspots) in sustaining near-efficient outcomes in repeated games with private monitoring. We study a finitely repeated game, where the stage game has multiple equilibria and show that mixed strategies can support partial cooperation, but cannot approximate full cooperation even if monitoring is “almost perfect.” Efficiency requires extensive form correlation, where strategies can condition upon a sunspot at the end of each period. For any finite number of repetitions, we approximate the best equilibrium payoff under perfect monitoring, assuming that monitoring is sufficiently accurate and sunspots are available. Journal of Economic Literature Classification Numbers: C73, D82.     

Efficiency results in N player games with imperfect private monitoring

We demonstrate that efficiency is achievable in a certain class of N player repeated games with private, almost perfect monitoring. Our equilibrium requires only one period memory and can be implemented by two state automata. Furthermore, we show that this efficiency result holds with any degree of accuracy of monitoring if private signals are hemiindependent. Whereas most existing research focuses on two player cases or only a special example of N player games, our results are applicable to a wide range of N player games of economic relevance, such as trading goods games and price-setting oligopolies.     

Perfect communication equilibria in repeated games with imperfect monitoring

This paper introduces an equilibrium concept called perfect communication equilibrium for repeated games with imperfect private monitoring. This concept is a refinement of Myerson's [Myerson, R.B., 1982. Optimal coordination mechanisms in generalized principal agent problems, J. Math. Econ. 10, 67–81] communication equilibrium. A communication equilibrium is perfect if it induces a communication equilibrium of the continuation game, after every history of messages of the mediator. We provide a characterization of the set of corresponding equilibrium payoffs and derive a Folk Theorem for discounted repeated games with imperfect private monitoring.     

Batch queues with choice of arrivals: Equilibrium analysis and experimental study

We study the decisions agents make in two queueing games with endogenously determined arrivals and batch service. In both games, agents are asked to independently decide when to join a queue, or they may simply choose not to join it at all. The symmetric mixed-strategy equilibrium of two games in discrete time where balking is prohibited and where it is allowed are tested experimentally in a study that varies the game type (balking vs. no balking) and information structure (private vs. public information). With repeated iterations of the stage game, all four experimental conditions result in aggregate, but not individual, behavior approaching mixed-strategy equilibrium play. Individual behavior can be accounted for by relatively simple heuristics.     

Belief-Based Equilibria in the Repeated Prisoners' Dilemma with Private Monitoring

We analyze repeated prisoners' dilemma games with imperfect private monitoring and construct mixed trigger strategy equilibria. Such strategies have a simple representation, where a player's action only depends upon her belief that her opponent(s) are continuing to cooperate. When monitoring is almost perfect, the symmetric efficient outcome can be approximated in any prisoners' dilemma game, while every individually rational feasible payoff can be approximated in a class of such games. The efficiency result extends when there are more than two players. It requires that monitoring be sufficiently accurate but does not require very low discounting when a public randomization device is available. Journal of Economic Literature Classification Numbers: C73, D82.     

Strategic Buyers and Privately Observed Prices

A model of finitely repeated price competition between two sellers with differentiated goods and a large buyer is analyzed. The set of pure strategy sequential equilibria is investigated under public and private monitoring. With private monitoring, i.e., when prices are not observable to the competing sellers, all sales are made by the better seller and the set of repeated game equilibrium payoffs coincides with the stage game subgame perfect equilibrium payoffs. This is in sharp contrast to the game with perfect monitoring where the folk theorem obtains. Journal of Economic Literature Classification Numbers: C72, D43.     

Finitely repeated games with monitoring options

We study finitely repeated games where players can decide whether to monitor the other players? actions or not every period. Monitoring is assumed to be costless and private. We compare our model with the standard one where the players automatically monitor each other. Since monitoring other players never hurts, any equilibrium payoff vector of a standard finitely repeated game is an equilibrium payoff vector of the same game with monitoring options. We show that some finitely repeated games with monitoring options have sequential equilibrium outcomes which cannot be sustained under the standard model, even if the stage game has a unique Nash equilibrium. We also present sufficient conditions for a folk theorem, when the players have a long horizon.     

Public Information, Private Information, and the Multiplicity of Equilibria in Coordination Games

I study coordination games with incomplete public and private information and relate equilibrium convergence to convergence of higher-order beliefs. As the players' signals become more and more precise, the equilibrium manifold converges to the correspondence of common knowledge equilibria, whenever the variance of the public signal converges to 0 at a rate faster than one half the rate of convergence of the variance of private signals. The same condition also determines the convergence of common p-belief to common knowledge, which leads to a simple intuition for its origin and an immediate generalization of the former results about equilibrium convergence. Journal of Economic Literature Classification Numbers: C72, D82.     

On Sustaining Cooperation without Public Observations

This paper examines a dynamic game in which each player only observes a private and imperfect signal on the actions played. Our main result is that in a repeated prisoner's dilemma where defections are irreversible (at least for a long enough period of time), patient enough players may achieve almost efficient outcomes. Dealing with models of imperfect private monitoring is difficult because (i) continuation games are games of incomplete information, hence they do not have the same structure as the original game. In particular, continuation equilibria are correlated equilibria. (ii) Players are typically uncertain about their opponents' past observations and actions, and they use their entire own private history to learn about these actions. As a result equilibrium strategies are in general nontrivial and increasingly complex functions of past observations. We bypass these difficulties by looking at correlated equilibria of the original game and find correlated equilibria in which the decision problem faced by each player remains the same over time. Journal of Economic Literature Classification Numbers: C72.     

Existence of nontrivial equilibria in repeated games with imperfect private monitoring

We consider finitely repeated games with imperfect private monitoring, and provide several sufficient conditions for such a game to have an equilibrium whose outcome is different from repetition of Nash equilibria of the stage game. Surprisingly, the conditions are consistent with uniqueness of the stage game equilibrium. A class of repeated chicken is shown to satisfy the condition.     

Information can wreck cooperation: A counterpoint to Kandori (1992)

We propose a simple model of repeated games with private monitoring and time-varying information structures. We then obtain an example demonstrating that the set of achievable equilibrium payoffs may shrink when players' information regarding opponents' information structures is increased.     

Coordination failure in repeated games with private monitoring

Players coordinate continuation play in repeated games with public monitoring. We investigate the robustness of such equilibrium behavior with respect to ex-ante small private-monitoring perturbations. We show that with full support of public signals, no perfect public equilibrium is robust if it induces a “regular” 2×2$2\times 2$ coordination game in the continuation play. This regularity condition is violated in all belief-free equilibria. Indeed, with an individual full rank condition, every interior belief-free equilibrium is robust. We also analyze block belief-free equilibria and point out that the notion of robustness is sensitive to whether we allow for uninterpretable signals.     

Group efforts when performance is determined by the “best shot”

We investigate the private provision of a public good whose level is determined by the maximum effort made by a group member. Costs of effort are either commonly known or privately known. For symmetric perfect-information games, any number of players may be active and we characterize the unique (mixed-strategy) equilibrium in which active contributors use the same strategy. Increasing the number of active players leads to stochastically lower individual efforts and level of the public good. When information is private, the symmetric equilibrium is in pure strategies. Increasing the number of players yields a pointwise reduction in the equilibrium contribution strategy but an increase in equilibrium payoffs. Comparative statics with respect to costs and levels of risk aversion are derived. Finally, whether information is public or private, equilibria are inefficient—we provide mechanisms that improve efficiency.     

Plausible cooperation

There is a large repeated games literature illustrating how future interactions provide incentives for cooperation. Much of the earlier literature assumes public monitoring. Departures from public monitoring to private monitoring that incorporate differences in players' observations may dramatically complicate coordination and the provision of incentives, with the consequence that equilibria with private monitoring often seem unrealistically complex or fragile. We set out a model in which players accomplish cooperation in an intuitively plausible fashion. Players process information via a mental system – a set of psychological states and a transition function between states depending on observations. Players restrict attention to a relatively small set of simple strategies, and consequently, might learn which perform well.     

Infinitely repeated games with public monitoring and monetary transfers

This paper studies infinitely repeated games with imperfect public monitoring and the possibility of monetary transfers. It is shown that all public perfect equilibrium payoffs can be implemented with a simple class of stationary equilibria that use stick-and-carrot punishments. A fast algorithm is developed that exactly computes the set of pure strategies equilibrium payoffs for all discount factors.     

Communication in repeated games with costly monitoring

We study repeated games with discounting where perfect monitoring is possible, but costly. It is shown that if players can make public announcements, then every payoff vector which is an interior point in the set of feasible and individually rational payoffs can be implemented in a sequential equilibrium of the repeated game when the discount factor is high enough. Thus, efficiency can be approximated even when the cost of monitoring is high, provided that the discount factor is high enough.