A spectrum of equilibration processes in game theory

In game theory, four dynamic processes converging towards an equilibrium are distinguished and ordered by way of agents' decreasing cognitive capacities. In the eductive process, each player has enough information to simulate perfectly the others' behavior and gets immediately to the equilibrium. In epistemic learning, each player updates his beliefs about others' future strategies, with regard to their sequentially observed actions. In behavioral learning, each player modifies his own strategies according to the observed payoffs obtained from his past actions. In the evolutionary process, each agent has a fixed strategy and reproduces in proportion to the utilities obtained through stochastic interactions. All along the spectrum, longer term dynamics makes up for weaker rationality, and physical relations substitute for mental interactions. Convergence, if any, is towards an always stronger equilibrium notion and selection of an equilibrium state becomes more sensitive to context and history. The processes can be mixed if associated to different periods, agents or mechanisms and deepened if obtained by formal reasoning principles.     

Learning by trial and error

A person learns by trial and error if he occasionally tries out new strategies, rejecting choices that are erroneous in the sense that they do not lead to higher payoffs. In a game, however, strategies can become erroneous due to a change of behavior by someone else. We introduce a learning rule in which behavior is conditional on whether a player experiences an error of the first or second type. This rule, called interactive trial and error learning, implements Nash equilibrium behavior in any game with generic payoffs and at least one pure Nash equilibrium.     

On the convergence to the Nash bargaining solution for action-dependent bargaining protocols

We consider a non-cooperative multilateral bargaining game and study an action-dependent bargaining protocol, that is, the probability with which a player becomes the proposer in a round of bargaining depends on the identity of the player who previously rejected. An important example is the frequently studied rejector-becomes-proposer protocol. We focus on subgame perfect equilibria in stationary strategies which are shown to exist and to be efficient. Equilibrium proposals do not depend on the probability to propose conditional on the rejection by another player. We consider the limit, as the bargaining friction vanishes. In case no player has a positive probability to propose conditional on his rejection, each player receives his utopia payoff conditional on being recognized. Otherwise, equilibrium proposals of all players converge to a weighted Nash bargaining solution, where the weights are determined by the probability to propose conditional on one's own rejection.     

Decompositions and potentials for normal form games

A basic model of commitment is to convert a two-player game in strategic form to a “leadership game” with the same payoffs, where one player, the leader, commits to a strategy, to which the second player always chooses a best reply. This paper studies such leadership games for games with convex strategy sets. We apply them to mixed extensions of finite games, which we analyze completely, including nongeneric games. The main result is that leadership is advantageous in the sense that, as a set, the leader's payoffs in equilibrium are at least as high as his Nash and correlated equilibrium payoffs in the simultaneous game. We also consider leadership games with three or more players, where most conclusions no longer hold.     

Learning to play games in extensive form by valuation

Game theoretic models of learning which are based on the strategic form of the game cannot explain learning in games with large extensive form. We study learning in such games by using valuation of moves. A valuation for a player is a numeric assessment of her moves that purports to reflect their desirability. We consider a myopic player, who chooses moves with the highest valuation. Each time the game is played, the player revises her valuation by assigning the payoff obtained in the play to each of the moves she has made. We show for a repeated win-lose game that if the player has a winning strategy in the stage game, there is almost surely a time after which she always wins. When a player has more than two payoffs, a more elaborate learning procedure is required. We consider one that associates with each move the average payoff in the rounds in which this move was made. When all players adopt this learning procedure, with some perturbations, then, with probability 1 there is a time after which strategies that are close to subgame perfect equilibrium are played. A single player who adopts this procedure can guarantee only her individually rational payoff.     

Alternating-Offer Bargaining with Two-Sided Incomplete Information

I study alternating-offer bargaining games with two-sided incomplete information about the players' discount rates. For both perfect Bayesian equilibrium and a rationalizability-style notion, I characterize the set of expected payoffs which may arise in the game. I also construct bounds on agreements that may be made. The set of expected payoffs is easy to compute and incorporate into applied models. My main result is a full characterization of the set of perfect Bayesian equilibrium payoffs for games in which the distribution over the players' discount rates is of wide support, yet is in a weak sense close to a point mass distribution. I prove a lopsided convergence result: each player cannot gain from a slight chance that she is a strong type, but the player can suffer greatly if there is a slight chance that she is a weak type.     

Dynamic common agency

A general model of dynamic common agency with symmetric information is considered. The set of truthful Markov perfect equilibrium payoffs is characterized and the efficiency properties of the equilibria are established. A condition for the uniqueness of equilibrium payoffs is derived for the static and the dynamic game. The payoff is unique if and only if the payoff of each principal coincides with his marginal contribution to the social value of the game. The dynamic model is applied to a game of agenda setting.     

Arms Races and Negotiations

Two players simultaneously decide whether or not to acquire new weapons in an arms race game. Each player's type determines his propensity to arm. Types are private information, and are independently drawn from a continuous distribution. With probability close to one, the best outcome for each player is for neither to acquire new weapons (although each prefers to acquire new weapons if he thinks the opponent will). There is a small probability that a player is a dominant strategy type who always prefers to acquire new weapons. We find conditions under which the unique Bayesian–Nash equilibrium involves an arms race with probability one. However, if the probability that a player is a dominant strategy type is sufficiently small, then there is an equilibrium of the cheap-talk extension of the game where the probability of an arms race is close to zero.     

A non-cooperative bargaining game with risk averse players and an uncertain finite horizon

For an alternating offer bargaining game with an uncertain horizon, the equilibrium payoff to a player is greater, the less risk averse is he relative to his opponent. As the horizon becomes infinite in length, the equilibrium partition converges to the Nash bargaining solution.     

Nash equilibrium when players account for the complexity of their forecasts

Nash equilibrium is often interpreted as a steady state in which each player holds the correct expectations about the other players' behavior and acts rationally. This paper investigates the robustness of this interpretation when there are small costs associated with complicated forecasts. The model consists of a two-person strategic game in which each player chooses a finite machine to implement a strategy in an infinitely repeated 2×2 game with discounting. I analyze the model using a solution concept called Nash Equilibrium with Stable Forecasts (ESF). My main results concern the structure of equilibrium machine pairs. They provide necessary and sufficient conditions on the form of equilibrium strategies and plays. In contrast to the “folk theorem,” these structural properties place severe restrictions on the set of equilibrium paths and payoffs. For example, only sequences of the one-shot Nash equilibrium can be generated by any ESF of the repeated game of chicken.     

Non-cooperative bargaining in apex games and the kernel

This paper studies non-cooperative bargaining with random proposers in apex games. Two different protocols are considered: the egalitarian protocol, which selects each player to be the proposer with equal probability, and the proportional protocol, which selects each player with a probability proportional to his number of votes. Expected equilibrium payoffs coincide with the kernel for the grand coalition regardless of the protocol. The equilibrium is in mixed strategies and the indifference conditions can be reinterpreted in the language of the kernel.     

Representing equilibrium aggregates in aggregate games with applications to common agency

An aggregate game is a normal-form game with the property that each playerʼs payoff is a function of only his own strategy and an aggregate of the strategy profile of all players. Such games possess properties that can often yield simple characterizations of equilibrium aggregates without requiring that one solves for the equilibrium strategy profile. When payoffs have a quasi-linear structure and a degree of symmetry, we construct a self-generating maximization program over the space of aggregates with the property that the solution set corresponds to the set of equilibrium aggregates of the original n-player game. We illustrate the value of this approach in common-agency games where the playersʼ strategy space is an infinite-dimensional space of nonlinear contracts. We derive equilibrium existence and characterization theorems for both the adverse selection and moral hazard versions of these games.     

Mixed-strategy equilibria in the Nash Demand Game

In the Nash Demand Game, each of the two players announces the share he demands of an amount of money that may be split between them. If the demands can be satisfied, they are; otherwise, neither player receives any money. This game has many pure-strategy equilibria. This paper characterizes mixed-strategy equilibria. The condition critical for an equilibrium is that players’ sets of possible demands be balanced. Two sets of demands are balanced if each demand in one set can be matched with a demand in the other set such that they sum to one. For Nash’s original game, a complete characterization is given of the equilibria in which both players’ expected payoffs are strictly positive. The findings are applied to the private provision of a discrete public good.     

Program equilibrium

In a computerized setting, players' strategies can be implemented by computer programs, to be executed on a shared computational devise. This situation becomes typical to new Internet economies, where agent technologies play a major role. This allows the definition of a program equilibrium. Following the fundamental ideas introduced by von Neumann in the 1940s (in parallel to his seminal contribution to game theory), a computer program can be used both as a set of instructions, as well as a file that can be read and compared with other files. We show that this idea implies that in a program equilibrium of the one-shot prisoners dilemma mutual cooperation is obtained. More generally, we show that the set of program equilibrium payoffs of a game coincides with the set of feasible and individually rational payoffs of it.     

Global dynamics in repeated games with additively separable payoffs

This paper studies the global dynamics of a class of infinitely repeated two-player games in which the action space of each player is an interval, and the one-shot payoff of each player is additively separable in actions. We define an immediately reactive equilibrium (IRE) as a pure-strategy subgame perfect equilibrium such that each player's action is a stationary function of the opponent's last action. We completely characterize IREs and their dynamics in terms of certain indifference curves. Our results are used to show that in a prisoners' dilemma game with mixed strategies, gradual cooperation occurs when the players are sufficiently patient, and that in a certain duopoly game, kinked demand curves emerge naturally.     

Wishful Thinking in Strategic Environments

Towards developing a theory of systematic biases about strategies, I analyse strategic implications of a particular bias: wishful thinking about the strategies. I identify a player as a wishful thinker if she hopes to enjoy the highest pay-off that is consistent with her information about the others' strategies. I develop a straightforward elimination process that characterizes the strategy profiles that are consistent with wishful thinking, mutual knowledge of wishful thinking, and so on. Every pure-strategy Nash equilibrium is consistent with common knowledge of wishful thinking. For generic two-person games, I further show that the pure Nash equilibrium strategies are the only strategies that are consistent with common knowledge of wishful thinking. My analysis also illustrates how one can characterize the strategic implications of general decision rules using the tools of game theory.     

Purification in the infinitely-repeated prisoners' dilemma

This paper investigates the Harsanyi [Harsanyi, J.C., 1973. Games with randomly disturbed payoffs: A new rationale for mixed-strategy equilibrium points. International Journal of Game Theory 2 (1), 1–23]-purifiability of mixed strategies in the repeated prisoners' dilemma with perfect monitoring. We perturb the game so that in each period, a player receives a private payoff shock which is independently and identically distributed across players and periods. We focus on the purifiability of one-period memory mixed strategy equilibria used by Ely and Välimäki [Ely, J.C., Välimäki, J., 2002. A robust folk theorem for the prisoner's dilemma. Journal of Economic Theory 102 (1), 84–105] in their study of the repeated prisoners' dilemma with private monitoring. We find that any such strategy profile is not the limit of one-period memory equilibrium strategy profiles of the perturbed game, for almost all noise distributions. However, if we allow infinite memory strategies in the perturbed game, then any completely-mixed equilibrium is purifiable.     

A note on the one-deviation property in extensive form games

In an extensive form game, an assessment is said to satisfy the one-deviation property if for all possible payoffs at the terminal nodes the following holds: if a player at each of his information sets cannot improve upon his expected payoff by deviating unilaterally at this information set only, he cannot do so by deviating at any arbitrary collection of information sets. Hendon et al. (1996. Games Econom. Behav. 12, 274–282) have shown that pre-consistency of assessments implies the one-deviation property. In this note, it is shown that an appropriate weakening of pre-consistency, termed updating consistency, is both a sufficient and necessary condition for the one-deviation property. The result is extended to the context of rationalizability.     

Infinite horizon common interest games with perfect information

We consider infinite horizon common interest games with perfect information. A game is a K-coordination game if each player can decrease other players' payoffs by at most K times his own cost of punishment. The number K represents the degree of commonality of payoffs among the players. The smaller K is, the more interest the players share. A K-coordination game tapers off if the greatest payoff variation conditional on the first t periods of an efficient history converges to 0 at a rate faster than K^−t as t→∞. We show that every subgame perfect equilibrium outcome is efficient in any tapering-off game with perfect information. Applications include asynchronously repeated games, repeated games of extensive form games, asymptotically finite horizon games, and asymptotically pure coordination games.     

Impermanent types and permanent reputations

We study the impact of unobservable stochastic replacements for the long-run player in the classical reputation model with a long-run player and a series of short-run players. We provide explicit lower bounds on the Nash equilibrium payoffs of a long-run player, both ex-ante and following any positive probability history. Under general conditions on the convergence rates of the discount factor to one and of the rate of replacement to zero, both bounds converge to the Stackelberg payoff if the type space is sufficiently rich. These limiting conditions hold in particular if the game is played very frequently.