Endogenous transfers in the Prisoner's Dilemma game: An experimental test of cooperation and coordination

We test a two-stage compensation mechanism for promoting cooperation in Prisoner's Dilemma games. Players first simultaneously choose binding non-negative amounts to pay their counterparts for cooperating, and then play the induced game knowing these amounts. In our games, all payment pairs consistent with mutual cooperation in subgame-perfect equilibrium transform these games into coordination games, with both mutual cooperation and mutual defection as Nash equilibria in the second stage. When endogenous transfer payments are not permitted, cooperation is much less likely. Mutual cooperation is most likely when the (sufficient) payments are identical, and it is also substantially more likely with payment pairs that bring the mutual-cooperation payoffs closer together. Both the Fehr–Schmidt and Charness–Rabin models predict that transfers that make final payoffs closer are preferred; however, they do not explain why equal transfers are particularly effective. Transfers are also effective in sustaining cooperation even when they are imposed and not chosen.     

Two equivalence results for two-person strict games

A game is strict if for both players, different profiles have different payoffs. Two games are best response equivalent if their best response functions are the same. We prove that a two-person strict game has at most one pure Nash equilibrium if and only if it is best response equivalent to a strictly competitive game, and that it is best response equivalent to an ordinal potential game if and only if it is best response equivalent to a quasi-supermodular game.     

On Renegotiation-Proof Equilibria in Finitely Repeated Games

This paper studies renegotiation-proof equilibria of Beno?̂t and Krishna (1993) in finitely repeated games with more than two players. We provide a simple characterization of the set of average payoffs from renegotiation-proof equilibria: the limiting set of average equilibrium payoffs is either efficient or dimensionally small as the horizon of the repeated game goes to infinity. Two sufficient conditions for the former to occur are provided. An example shows that those conditions cannot be weakened.Journal of Economic LiteratureClassification Numbers: C72, C73.     

Monotone Games with Positive Spillovers

A monotone game comprises the infinitely repeated play of an n-person stage game, subject to the constraint that players' actions be monotonically nondecreasing over time. These games represent a variety of strategic situations in which players are able to make (partial) commitments. If the stage games have positive spillovers and satisfy certain other conditions, then the limit points of the subgame perfect equilibria are precisely the approachable action profiles. This characterization is applied to voluntary contribution games, market games, and coordination games. Journal of Economic Literature Classification Number: C7.     

The formation of networks with transfers among players

We examine the formation of networks among a set of players whose payoffs depend on the structure of the network, when players may bargain by promising or demanding transfer payments when forming links. We vary three aspects of the game: (i) whether players can only make transfers to (and receive transfers from) players to whom they are directly linked, or whether they can also subsidize links that they are not directly involved in, (ii) whether or not transfers relating to a given link can be made contingent on the full resulting network or only on the link itself, and (iii) whether or not players can pay other players to refrain from forming links. We characterize the networks that are supported under these variations and show how each of the above aspects either accounts for a specific type of externality, or deals with the combinatorial nature of network payoffs.     

Lexicographic composition of simple games

Certain voting bodies can be modeled as a simple game where a coalition's winning depends on whether it wins, blocks or loses in two smaller simple games. There are essentially five such ways to combine two proper games into a proper game. The most decisive is the lexicographic rule, where a coalition must either win in G₁, or block in G₁ and win in G₂. When two isomorphic games are combined lexicographically, a given role for a player confers equal or more power when held in the first game than the second, if power is assessed by any semi-value. A game is lexicographically separable when the players of the two components partition the whole set. Games with veto players are not separable, and games of two or more players with identical roles are separable only if decisive. Some separable games are egalitarian in that they give players identical roles.     

The optimal degree of cooperation in the repeated Prisoners' Dilemma with side payments

In the infinitely repeated Prisoners' Dilemma with side payments, we characterize the Pareto frontier of the set of subgame perfect equilibrium payoffs for all possible combinations of discount factors. Play paths implementing Pareto dominant equilibrium payoffs are uniquely determined in all but the first period. Full cooperation does not necessarily implement these payoffs even when it maximizes total stage game payoffs. Rather, when the difference in players' discount factors is sufficiently large, Pareto dominant equilibrium payoffs are implemented by partial cooperation supported by repeated payments from the impatient to the patient player. When both players are sufficiently patient, such payoffs, while implemented via full cooperation, are supported by repeated payments from the impatient to the patient player. We characterize conditions under which public randomization has no impact on the Pareto dominant equilibrium payoffs and conditions under which such payoffs are robust to renegotiation.     

Correlated Equilibrium in Stochastic Games

We study the existence of uniform correlated equilibrium payoffs in stochastic games. The correlation devices that we use are either autonomous (they base their choice of signal on previous signals, but not on previous states or actions) or stationary (their choice is independent of any data and is drawn according to the same probability distribution at every stage). We prove that any n-player stochastic game admits an autonomous correlated equilibrium payoff. When the game is positive and recursive, a stationary correlated equilibrium payoff exists. Journal of Economic Literature Classification Numbers: C72, C73.     

Better-reply dynamics and global convergence to Nash equilibrium in aggregative games

We consider n-person games with quasi-concave payoffs that depend on a player's own action and the sum of all players' actions. We show that a discrete-time, stochastic process in which players move towards better replies—the better-reply dynamics—converges globally to a Nash equilibrium if actions are either strategic substitutes or strategic complements for all players around each Nash equilibrium that is asymptotically stable under a deterministic, adjusted best-reply dynamics. We present an example of a 2-person game with a unique equilibrium where the derivatives of the best-reply functions have different signs and the better-reply dynamics does not converge.     

Renegotiation in Repeated Games with Side-Payments

We consider repeated games with side-payments: players have an endowment of wealth in each period in which transfers can be made. We show that if endowments are large enough and the common discount factor high enough, then a strongly renegotiation–proof equilibrium (SRP) in the sense of Farrell and Maskin exists. As the discount factor goes to 1, the set of SRP payoffs converges to the set of efficient, individually rational payoffs. These results provide a justification for the efficiency principle when agreements are not enforceable. Journal of Economic Literature Classification Numbers: C73, D23, L14.     

Market Games in Large Economies with a Finite Number of Types

We study market games derived from an exchange economy with a continuum of agents, each having one of finitely many possible types. The type of agent determines his initial endowment and utility function. It is shown that, unlike the well-known Shapley–Shubik theorem on market games (Shapley and Shubik in J Econ Theory 1:9–25, 1969), there might be a (fuzzy) game in which each of its sub-games has a non-empty core and, nevertheless, it is not a market game. It turns out that, in order to be a market game, a game needs also to be homogeneous. We also study investment games – which are fuzzy games obtained from an economy with a finite number of agents cooperating in one or more joint projects. It is argued that the usual definition of the core is inappropriate for such a model. We therefore introduce and analyze the new notion of comprehensive core. This solution concept seems to be more suitable for such a scenario. We finally refer to the notion of feasibility of an allocation in games with a large number of players. Some of the results in this paper appear in a previous draft distributed by the name “Cooperative investment games or Population games”. An anonymous referee of Economic Theory is acknowledged for his/her comments     

Infinite horizon common interest games with perfect information

We consider infinite horizon common interest games with perfect information. A game is a K-coordination game if each player can decrease other players' payoffs by at most K times his own cost of punishment. The number K represents the degree of commonality of payoffs among the players. The smaller K is, the more interest the players share. A K-coordination game tapers off if the greatest payoff variation conditional on the first t periods of an efficient history converges to 0 at a rate faster than K^−t as t→∞. We show that every subgame perfect equilibrium outcome is efficient in any tapering-off game with perfect information. Applications include asynchronously repeated games, repeated games of extensive form games, asymptotically finite horizon games, and asymptotically pure coordination games.     

On the Least Core and the Mas-Colell Bargaining Set

We show that the least core of a TU coalitional game with a finite set of players is contained in the Mas-Colell bargaining set. This result is extended to games with a measurable space of players in which the worth of the grand coalition is at least that of any other coalition in the game. As a consequence, we obtain an existence theorem for the Mas-Colell bargaining set in TU games with a measurable space of players. Journal of Economic Literature Classification Number: C71.     

Equilibrium selection through incomplete information in coordination games: an experimental study

We perform an experiment on a pure coordination game with uncertainty about the payoffs. Our game is closely related to models that have been used in many macroeconomic and financial applications to solve problems of equilibrium indeterminacy. In our experiment, each subject receives a noisy signal about the true payoffs. This game (inspired by the “global” games of Carlsson and van Damme, Econometrica, 61, 989–1018, 1993) has a unique strategy profile that survives the iterative deletion of strictly dominated strategies (thus a unique Nash equilibrium). The equilibrium outcome coincides, on average, with the risk-dominant equilibrium outcome of the underlying coordination game. In the baseline game, the behavior of the subjects converges to the theoretical prediction after enough experience has been gained. The data (and the comments) suggest that this behavior can be explained by learning. To test this hypothesis, we use a different game with incomplete information, related to a complete information game where learning and prior experiments suggest a different behavior. Indeed, in the second treatment, the behavior did not converge to equilibrium within 50 periods in some of the sessions. We also run both games under complete information. The results are sufficiently similar between complete and incomplete information to suggest that risk-dominance is also an important part of the explanation.      

Asymmetric evolutionary games with non-linear pure strategy payoffs

In this paper, I extend the analytical framework of evolutionary game theory to games with two distinct types of players where the type-specific payoff functions are nonlinear on the right—bi-player-type nonlinear (BNL) evolutionary games. That is, asymmetric games where the payoffs for pairwise interactions are influenced by the ambient frequencies of the pertinent strategies of both types of players.While this paper is motivated by my interest in inter- and intra-gender conflicts of interest in sexual reproduction, BNL games also arise just as naturally in most two-species interactions. Thus, the methodology may provide a novel approach to investigating such classical ecological phenomena as prey–predator/host–parasite interactions and interspecies competition for resources.Finally, given the growing tendency to utilize evolutionary games in economic modeling, a case can be made for the current paper being of interest to traditional game-theoretic modelers in connection with situations such as buyer/seller or employer/employee interaction.     

Coordination of strategic responses to security threats: Laboratory evidence

Laboratory experiments are used to evaluate the extent to which players in games can coordinate investments that diminish the probability of losses due to security breaches or terrorist attacks. In this environment, economically sensible investments may be foregone if their potential benefits are negated by failures to invest in security at other sites. The result is a coordination game with a desirable high-payoff, high-security equilibrium and an undesirable low-security equilibrium that may result if players do not expect others to invest in security. One unique feature of this coordination situation is that investment in security by one player generates a positive externality such that all other players’ expected payoffs are increased, regardless of those other players’ investment decisions. Coordination failures are pervasive in a baseline experiment with simultaneous decisions, but coordination is improved if players are allowed to move in an endogenously determined sequence. In addition, coordinated security investments are observed more often when the largest single security threat to individuals is preventable by their own decisions to invest in security. The security coordination game is a “potential game,” and the success of coordination on the more secure equilibrium is related to the notion of potential function maximization and basin of attraction.      

Axiomatizations of two types of Shapley values for games on union closed systems

A situation in which a finite set of players can obtain certain payoffs by cooperation can be described by a cooperative game with transferable utility, or simply a TU-game. A (single-valued) solution for TU-games assigns a payoff distribution to every TU-game. A well-known solution is the Shapley value. In the literature various models of games with restricted cooperation can be found. So, instead of allowing all subsets of the player set N to form, it is assumed that the set of feasible coalitions is a subset of the power set of N. In this paper, we consider such sets of feasible coalitions that are closed under union, i.e. for any two feasible coalitions also their union is feasible. We consider and axiomatize two solutions or rules for these games that generalize the Shapley value: one is obtained as the conjunctive permission value using a corresponding superior graph, the other is defined as the Shapley value of a modified game similar as the Myerson value for games with limited communication.     

A learning-based model of repeated games with incomplete information

This paper tests a learning-based model of strategic teaching in repeated games with incomplete information. The repeated game has a long-run player whose type is unknown to a group of short-run players. The proposed model assumes a fraction of ‘short-run’ players follow a one-parameter learning model (self-tuning EWA). In addition, some ‘long-run’ players are myopic while others are sophisticated and rationally anticipate how short-run players adjust their actions over time and “teach” the short-run players to maximize their long-run payoffs. All players optimize noisily. The proposed model nests an agent-based quantal-response equilibrium (AQRE) and the standard equilibrium models as special cases. Using data from 28 experimental sessions of trust and entry repeated games, including 8 previously unpublished sessions, the model fits substantially better than chance and much better than standard equilibrium models. Estimates show that most of the long-run players are sophisticated, and short-run players become more sophisticated with experience.     

On the Irrelevance of Risk Attitudes in Repeated Two-Outcome Games

We study equilibrium and maximin play in supergames consisting of the sequential play of a finite collection of stage games, where each stage game has two outcomes for each player. We show that for two-player supergames in which each stage game is strictly competitive, in any Nash equilibrium of the supergame, play at each stage is a Nash equilibrium of the stage game provided preferences over certain supergame outcomes satisfy a natural monotonicity condition. In particular, equilibrium play does not depend on risk attitudes. We establish an invariance result for games with more than two players when the solution concept is subgame perfection. Journal of Economic Literature Classification Numbers: C72, C9.     

Coalition Formation and Potential Games

In this paper we study the formation of coalition structures in situations described by a cooperative game. Players choose independently which coalition they want to join. The payoffs to the players are determined by an allocation rule on the underlying game and the coalition structure that results from the strategies of the players according to some formation rule. We study two well-known coalition structure formation rules and show that for both formation rules there exists a unique component-efficient allocation rule that results in a potential game. Journal of Economic Literature Classification Numbers: C71, C72.