How Game Theory Explains Animal Mating Strategies

Biologists use game theory—a mathematical framework originally designed to analyze economic decisions—to understand how animals compete for mates and maximize their reproductive success. This article explores how evolutionary game theory models, such as the concept of Evolutionarily Stable Strategies (ESS), explain diverse and often complex mating behaviors in the animal kingdom, including the cooperative dynamics of birds and the famous “rock-paper-scissors” mating cycle of side-blotched lizards.

The Shift from Economics to Evolutionary Biology

In traditional game theory, players make conscious, rational choices to maximize their personal gain. In evolutionary biology, however, the “players” are animals acting on genetic instincts, and the “payoff” is evolutionary fitness—specifically, the survival and successful reproduction of offspring.

Natural selection acts as the referee. Over generations, behaviors that yield higher reproductive payoffs become more common in a population, while less successful behaviors are phased out.

Evolutionary Stable Strategies (ESS)

Coined by biologist John Maynard Smith, an Evolutionary Stable Strategy (ESS) is a strategy which, if adopted by most members of a population, cannot be invaded or replaced by any alternative, mutant strategy. Biologists use ESS to determine why certain mating behaviors persist over millions of years.

If a population of birds relies entirely on a “faithful” mating strategy, a “cheating” mutant strategy might easily invade and spread because it avoids the energetic costs of parenting. However, if too many individuals cheat, the survival rate of offspring drops, making faithfulness advantageous once again. Game theory helps calculate the exact mathematical balance where these competing strategies reach a stable equilibrium.

The Rock-Paper-Scissors Mating Game

One of the most famous real-world applications of game theory in biology is the mating strategy of the male side-blotched lizard (Uta stansburiana). These lizards exhibit three distinct, genetically determined throat colors, each corresponding to a different mating strategy:

• Orange-throated males are highly aggressive and defend large territories containing multiple females.
• Blue-throated males are moderately aggressive and defend smaller territories containing only one female, often cooperating with other blue males.
• Yellow-throated males are “sneakers.” They do not defend territories; instead, they mimic females to slide past dominant males and mate secretly.

Using game theory, biologists modeled this dynamic as a classic game of Rock-Paper-Scissors: * Orange beats Blue: Orange males use their sheer size and aggression to take over the territories of blue males. * Yellow beats Orange: Because orange males guard too many females over large areas, they cannot protect them all from the yellow “sneakers.” * Blue beats Yellow: Blue males guard only one female and cooperate with neighbors, making it nearly impossible for yellow males to sneak in.

This loop ensures that no single strategy ever dominates. The population exists in a perpetual, mathematically stable cycle.

Honest Signaling and the Handicap Principle

Game theory also explains why males of many species develop highly inconvenient physical traits, such as the peacock’s heavy, bright tail or the elaborate songs of songbirds.

Under the “Handicap Principle,” formulated by Amotz Zahavi and mathematically modeled using game theory, these traits act as honest signals of genetic quality. Because a weak male cannot afford the biological cost of growing and maintaining a massive tail while escaping predators, only high-quality males can successfully display this “handicap.” Females use these costly signals to make optimal mating choices, ensuring their offspring inherit superior genes.