Always cooperate 2026-10-14
Under cooperative initial memories, matches involving only Tit for tat and always cooperate contain only cooperation, so all four payoffs equal . The two-condition criterion for evolutionary stability has both differences zero. Thus Tit for tat is not an evolutionarily stable strategy against a strategy space containing unconditional cooperation, even if it is a Nash equilibrium. This counterexample is valid for finite horizons and discounting as well as infinite averages.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 52 6 b Solution Created 2026-10-03 Updated 2026-10-14
Under the standard two-condition criterion for evolutionary stability, the strict claim fails. Tit for tat and always cooperate both cooperate in every round when playing either each other or their own type under the specified initial memories. HenceBoth stability comparisons tie. The neutrality between Tit for tat and unconditional cooperation proves that Tit for tat is not an evolutionarily stable strategy in the stated strategy space, and cannot strictly invade every strategy. The final differently spelled name is interpreted as the same rule, since no second strategy is defined.
There is a useful qualified invasion result. For a resident with , put . The long-run payoff of reactive strategies givesThus, if the fraction of Tit for tat players is , their payoff advantage isMoreover . Under the additional cooperative-efficiency condition , this is positive whenever . Tit for tat invasion of a reactive resident then occurs from every positive frequency, although its invasion exponent at frequency zero vanishes. The replicator equation is , so the initial increase is slow and frequency-dependent. Residents with remain cooperative on all reached histories and tie instead. If , some almost-cooperative residents have , and even this qualified invasion conclusion fails.
For the exceptional opposite-response resident , its self-payoff is while its payoff in either order against Tit for tat is . The advantage is . Under , invasion at arbitrarily small frequency requires ; otherwise it needsFinally, taking an infinite undiscounted average before the rare-mutant limit is essential. In an -round match against always defect, the first round contributes to Tit for tat and to the defector, followed by rounds of payoff . The finite-horizon invasion threshold of Tit for tat against unconditional defection isprovided the denominator is positive and the threshold is below one. Thus a finite horizon generally prevents invasion from an arbitrarily rare introduction. The source's absent payoff table prevents choosing which extra payoff inequalities were intended, but the symbolic cases and the strict-ESS counterexample do not depend on guessing it.