Moloch Trap Diagnosis
Find incentives that make rational individuals create a worse group outcome
- Difficulty
- Advanced
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 97%
Boeree uses Moloch as a memorable label for negative-sum incentive traps. Participants optimize a short-term reward because refusing to do so leaves them at a competitive disadvantage, even though the resulting arms race makes many of them worse off. The behavior settles into a lower Nash equilibrium: no individual can safely deviate alone, but participants would prefer a different stable state if everyone moved together. Beauty filters illustrate the mechanism. Using them can win attention, while opting out can reduce reach; widespread use then intensifies appearance pressure and makes users dislike their unfiltered faces. Diagnosing the trap means identifying the reward, sacrifice, unilateral penalty, and the coordinated or structural change needed to reach a better equilibrium.
Origin
Boeree calls Moloch the god or demon of negative-sum games while discussing her Beauty Wars video.
Core principles
- 01Individual incentives can produce collectively unwanted outcomes
- 02Short-term optimization can sacrifice values participants actually care about
- 03Stable behavior is not necessarily a good equilibrium
- 04A better equilibrium may require coordinated rule or incentive changes
How to run it
- 1
Identify the local reward
Name the metric or short-term outcome each participant is rewarded for optimizing.
Pro tip Look for prestige, attention, revenue, or survival incentives.
Watch out Stated values may differ from what the system actually rewards.
- 2
Trace the sacrifice
Document what participants give up as they compete for the reward.
Pro tip Include psychological and social costs, not only money.
Watch out A cost spread across many people can remain invisible to each decision-maker.
- 3
Test unilateral exit
Ask what happens to one participant who refuses the dominant strategy while others continue.
Pro tip A meaningful penalty for opting out is evidence of an arms race.
Watch out Do not blame participants for responding to a real competitive disadvantage.
- 4
Map both equilibria
Describe the current stable outcome and the alternative stable outcome participants would prefer.
Pro tip State why neither can be reached or left by one actor alone.
Watch out A preferred outcome is not an equilibrium unless it can remain stable.
- 5
Change coordination or incentives
Design a rule, norm, product change, or coordinated commitment that makes movement toward the higher equilibrium viable.
Pro tip Target the payoff structure rather than relying on moral appeals alone.
Watch out A solution that asks only one participant to absorb the penalty will not scale.
In the wild
Boeree says a subtle beauty filter can improve a creator's appearance, likes, and growth. Yet comparing the filtered and real face can create misery, while refusing the filter carries a competitive cost when others continue using it.
→ Participants remain in a lower equilibrium that rewards an appearance arms race many do not enjoy.
Common mistakes
Blaming bad individuals
The trap can persist because ordinary people respond rationally to incentives, not because every participant wants the harmful outcome.
Telling one person to opt out
Unilateral restraint may impose the exact competitive penalty that keeps the lower equilibrium stable.
Is it for you?
Best for
Systems where individually sensible optimization repeatedly creates widespread harm or dissatisfaction.
Not ideal for
Problems caused mainly by one actor's error rather than interacting incentives and strategic responses.
From the transcript
“It's like the god of negative sum games. It's the a force of bad usually economic incentives that make people sort of sacrifice things that…”
“And so we're in this weird situation where no one wants to do stuff that makes them hate their face, but they're doing it anyway.”
“You know, we could all be in a higher Nash equilibrium where we're not doing it, but instead we're all stuck down there because of…”
From the episode
#611: Liv Boeree, Poker and Life — Core Strategies, Turning $500 into $1.7M, Cage Dancing, Game Theory, and Metaphysical Curiosities
Liv Boeree