Collusion through mediated communication in repeated games with imperfect private monitoring

Summary. This paper studies repeated games with imperfect private monitoring when there exists a third-party mediator who coordinates play by giving non-binding instructions to players on which action to take and by collecting their private information. The paper presents a Nash-threat folk theorem for a communication equilibrium based on such mediation when monitoring is jointly -perfect in the sense that every player is almost perfectly monitored collectively by other players.JEL Classification Numbers: C72, D82.I am very grateful to Mark Armstrong, V. Bhaskar, and Michihiro Kandori for helpful comments. Part of this research was conducted while I was visiting the University College London. Their hospitality is gratefully acknowledged.     

Perfect communication equilibria in repeated games with imperfect monitoring

This paper introduces an equilibrium concept called perfect communication equilibrium for repeated games with imperfect private monitoring. This concept is a refinement of Myerson's [Myerson, R.B., 1982. Optimal coordination mechanisms in generalized principal agent problems, J. Math. Econ. 10, 67–81] communication equilibrium. A communication equilibrium is perfect if it induces a communication equilibrium of the continuation game, after every history of messages of the mediator. We provide a characterization of the set of corresponding equilibrium payoffs and derive a Folk Theorem for discounted repeated games with imperfect private monitoring.     

Communication equilibrium payoffs in repeated games with imperfect monitoring

We characterize the set of communication equilibrium payoffs of any undiscounted repeated matrix-game with imperfect monitoring and complete information. For two-player games, a characterization is provided by Mertens, Sorin, and Zamir (Repeated games, Part A (1994) CORE DP 9420), mainly using Lehrer's (Math. Operations Res. (1992) 175) result for correlated equilibria. The main result of this paper is to extend this characterization to the n-player case. The proof of the characterization relies on an analogy with an auxiliary 2-player repeated game with incomplete information and imperfect monitoring. We use Kohlberg's (Int. J. Game Theory (1975) 7) result to construct explicitly a canonical communication device for each communication equilibrium payoff.     

Communication in repeated network games with imperfect monitoring

I consider repeated games with private monitoring played on a network. Each player has a set of neighbors with whom he interacts: a player's payoff depends on his own and his neighbors' actions only. Monitoring is private and imperfect: each player observes his stage payoff but not the actions of his neighbors. Players can communicate costlessly at each stage: communication can be public, private or a mixture of both. Payoffs are assumed to be sensitive to unilateral deviations. First, for any network, a folk theorem holds if some Joint Pairwise Identifiability condition regarding payoff functions is satisfied. Second, a necessary and sufficient condition on the network topology for a folk theorem to hold for all payoff functions is that no two players have the same set of neighbors not counting each other.     

Approximate efficiency in repeated games with correlated private signals

This paper presents repeated games with hidden moves, in which players receive imperfect private signals and are able to communicate. We propose a conditional probability approach to solve the learning problem in repeated games with correlated private signals and delayed communication. We then apply this approach to symmetric n-player games to obtain an approximate efficiency result.     

Communication in repeated games with costly monitoring

We study repeated games with discounting where perfect monitoring is possible, but costly. It is shown that if players can make public announcements, then every payoff vector which is an interior point in the set of feasible and individually rational payoffs can be implemented in a sequential equilibrium of the repeated game when the discount factor is high enough. Thus, efficiency can be approximated even when the cost of monitoring is high, provided that the discount factor is high enough.     

Recursive structure and equilibria in games with private monitoring

Summary. In each stage of a repeated game with private monitoring, the players receive payoffs and privately observe signals which depend on the players' actions and the state of world. I show that, contrary to a widely held belief, such games admit a recursive structure. More precisely, I construct a representation of the original sequential problem as a sequence of static games with incomplete information. This establishes the ground for a characterization of strategies and, hence, of behavior in interactive-decision settings where private information is present. Finally, the representation is used to give a recursive characterization of the equilibrium payoff set, by means of a multi-player generalization of dynamic programming. Received: February 11, 2002; revised version: July 22, 2002 RID="*" ID="*" I am very grateful to In-Koo Cho, Larry Epstein, Denis Gromb, Stephen Morris, Paolo Siconolfi, Lones Smith and Max Stinchcombe for several insights and suggestions. A referee's comments helped improving the exposition. Finally, I wish to thank the participants to the seminars at MEDS, NYU, Columbia University, Caltech, UCLA, University of Rochester, University of Texas-Austin, Northwestern Summer Microeconomics Conference 98, Summer in Tel Aviv 98, and NASM98.     

Adaptation and complexity in repeated games

The paper presents a learning model for two-player infinitely repeated games. In an inference step players construct minimally complex inferences of strategies based on observed play, and in an adaptation step players choose minimally complex best responses to an inference. When players randomly select an inference from a probability distribution with full support the set of steady states is a subset of the set of Nash equilibria in which only stage game Nash equilibria are played. When players make ‘cautious’ inferences the set of steady states is the subset of self-confirming equilibria with Nash outcome paths. When players use different inference rules, the set of steady states can lie between the previous two cases.     

A learning-based model of repeated games with incomplete information

This paper tests a learning-based model of strategic teaching in repeated games with incomplete information. The repeated game has a long-run player whose type is unknown to a group of short-run players. The proposed model assumes a fraction of ‘short-run’ players follow a one-parameter learning model (self-tuning EWA). In addition, some ‘long-run’ players are myopic while others are sophisticated and rationally anticipate how short-run players adjust their actions over time and “teach” the short-run players to maximize their long-run payoffs. All players optimize noisily. The proposed model nests an agent-based quantal-response equilibrium (AQRE) and the standard equilibrium models as special cases. Using data from 28 experimental sessions of trust and entry repeated games, including 8 previously unpublished sessions, the model fits substantially better than chance and much better than standard equilibrium models. Estimates show that most of the long-run players are sophisticated, and short-run players become more sophisticated with experience.     

Coordination failure in repeated games with private monitoring

Players coordinate continuation play in repeated games with public monitoring. We investigate the robustness of such equilibrium behavior with respect to ex-ante small private-monitoring perturbations. We show that with full support of public signals, no perfect public equilibrium is robust if it induces a “regular” 2×2$2\times 2$ coordination game in the continuation play. This regularity condition is violated in all belief-free equilibria. Indeed, with an individual full rank condition, every interior belief-free equilibrium is robust. We also analyze block belief-free equilibria and point out that the notion of robustness is sensitive to whether we allow for uninterpretable signals.     

Non-computable strategies and discounted repeated games

Summary A number of authors have used formal models of computation to capture the idea of bounded rationality in repeated games. Most of this literature has used computability by a finite automaton as the standard. A conceptual difficulty with this standard is that the decision problem is not closed. That is, for every strategy implementable by an automaton, there is some best response implementable by an automaton, but there may not exist any algorithm forfinding such a best response that can be implemented by an automaton. However, such algorithms can always be implemented by a Turing machine, the most powerful formal model of computation. In this paper, we investigate whether the decision problem can be closed by adopting Turing machines as the standard of computability. The answer we offer is negative. Indeed, for a large class of discounted repeated games (including the repeated Prisoner's Dilemma) there exist strategies implementable by a Turing machine for whichno best response is implementable by a Turing machine.The work was begun while Nachbar was a visitor at The Center for Mathematical studies in Economics and Management Science at Northwestern University; he is grateful for their hospitality. We are also grateful to Robert Anderson and Neil Gretsky and to seminar audiences at UCLA for useful comments, and to the National Science Foundation and the UCLA Academic Senate Committee on Research for financial support. This paper is an outgrowth of work reported in Learning and Computability in Discounted Supergames.     

Regret minimization in repeated matrix games with variable stage duration

Regret minimization in repeated matrix games has been extensively studied ever since Hannan's seminal paper [Hannan, J., 1957. Approximation to Bayes risk in repeated play. In: Dresher, M., Tucker, A.W., Wolfe, P. (Eds.), Contributions to the Theory of Games, vol. III. Ann. of Math. Stud., vol. 39, Princeton Univ. Press, Princeton, NJ, pp. 97–193]. Several classes of no-regret strategies now exist; such strategies secure a long-term average payoff as high as could be obtained by the fixed action that is best, in hindsight, against the observed action sequence of the opponent. We consider an extension of this framework to repeated games with variable stage duration, where the duration of each stage may depend on actions of both players, and the performance measure of interest is the average payoff per unit time. We start by showing that no-regret strategies, in the above sense, do not exist in general. Consequently, we consider two classes of adaptive strategies, one based on Blackwell's approachability theorem and the other on calibrated play, and examine their performance guarantees. We further provide sufficient conditions for existence of no-regret strategies in this model.     

Efficiency results in N player games with imperfect private monitoring

We demonstrate that efficiency is achievable in a certain class of N player repeated games with private, almost perfect monitoring. Our equilibrium requires only one period memory and can be implemented by two state automata. Furthermore, we show that this efficiency result holds with any degree of accuracy of monitoring if private signals are hemiindependent. Whereas most existing research focuses on two player cases or only a special example of N player games, our results are applicable to a wide range of N player games of economic relevance, such as trading goods games and price-setting oligopolies.     

Existence of Edgeworth equilibria for economies with asymmetric information

We analyze a general equilibrium model with asymmetrically informed agents. A basic and well-known consequence of asymmetric information is the failure of equal treatment property. Despite of this, we show that in every replica economy a private core allocation, which treats agents of the same type equally, exists. This result is provided in the framework of two different models, with and without expectations, and it suffices to guarantee in both cases the existence of a private Edgeworth equilibrium. The author is grateful to an anonymous referee for his/her careful reading and helpful comments and acknowledges support by Research Grant no. 2006132713-005 (Ministero Italiano dell’Università e della Ricerca).     

Existence of Nash equilibria in finite extensive form games with imperfect recall: A counterexample

This paper provides an example showing that for finite extensive form games without perfect recall existence of Nash equilibria in behaviour strategies is not guaranteed in general.     

Mixed-strategy equilibria and strong purification for games with private and public information

This paper shows the existence of mixed-strategy equilibria for games with private and public information under general conditions. Under the additional assumptions of finiteness of action spaces and diffuseness and conditional independence of private information, a strong purification result is obtained for the mixed strategies in such games. As a corollary, the existence of pure-strategy equilibria follows. I am very grateful to Yeneng Sun, Nicholas C. Yannelis and M. Ali Khan for helpful discussions and suggestions. I also wish to thank an anonymous referee whose comments led to many improvements in the paper.     

Finitely repeated games with monitoring options

We study finitely repeated games where players can decide whether to monitor the other players? actions or not every period. Monitoring is assumed to be costless and private. We compare our model with the standard one where the players automatically monitor each other. Since monitoring other players never hurts, any equilibrium payoff vector of a standard finitely repeated game is an equilibrium payoff vector of the same game with monitoring options. We show that some finitely repeated games with monitoring options have sequential equilibrium outcomes which cannot be sustained under the standard model, even if the stage game has a unique Nash equilibrium. We also present sufficient conditions for a folk theorem, when the players have a long horizon.     

Efficient budget balancing cartel equilibria with imperfect monitoring

Summary We modify the infinitely repeated Cournot game with imperfect monitoring of Green and Porter (1984) and Abreu, Pearce and Stacchetti (1986) to include heterogenous products and the possibility of balanced budget side payments (Holmström 1982). It is shown that a transfer mechanism which induces the efficient outcome exists under a reasonable technical assumption in contrast to the preceding authors. Intuitively, the existence of an observable random price vector rather than a single price makes it possible to identify likely defectors, eliminating the need for collective punishments.This paper is based on the last chapter of Demougin's dissertation at the University of Western Ontario.