Five Vital Signs of Scale
Stress-test every weakest link before turning a promising pilot into scale
- Difficulty
- Advanced
- Time to result
- ~months to results
- Steps
- 6
- Confidence
- 99%
List argues that scalable ideas do not depend on one silver bullet; they survive five potential weakest links. First, verify that the original result is real rather than a false positive. Second, know the audience and measure how much of the market actually responds. Third, test whether the situation and delivery system can be reproduced, including access to talent and participant adherence. Fourth, measure spillovers and unintended consequences that may appear only when many people adopt the idea. Fifth, understand the supply side: inputs, marginal costs, and whether economies or diseconomies emerge. A failure in any one vital sign can create a voltage effect, turning a strong pilot into a weak scaled result. Scale only where all five remain healthy.
Origin
List developed the five vital signs after his successful Chicago Heights preschool met policymakers' doubts about whether it could scale.
Core principles
- 01Scaling is a weakest-link problem rather than a silver-bullet problem
- 02A strong pilot can be a false positive
- 03An effect may work for only one slice of the audience
- 04Delivery conditions and input markets change with scale
- 05Spillovers and supply costs can erase or amplify the original effect
How to run it
- 1
Verify the voltage
Replicate the initial result and determine whether it is a genuine effect rather than a false positive. Establish that the pilot's apparent strength is real.
Pro tip Use a fresh sample rather than repeatedly inspecting the original data.
Watch out Scaling magnifies false positives as well as real effects.
- 2
Know the audience
Measure which people respond and estimate the size of that slice. Do not treat one successful audience as the whole market.
Pro tip Break results out by meaningful population segments.
Watch out Averages can conceal a narrow responsive group.
- 3
Reproduce the situation
Identify the setting, delivery system, adherence, and input quality required for the effect. Test whether those conditions remain available at larger volume.
Pro tip Use an existing routine or institution when it lowers adoption friction.
Watch out A pilot staffed by scarce exceptional people may not be reproducible.
- 4
Measure spillovers
Look for market responses, network effects, congestion, substitution, and other consequences caused by wider adoption. Include both positive and negative externalities.
Pro tip Compare partial rollout with full-market behavior.
Watch out A benefit to early recipients can disappear when everyone receives it.
- 5
Model the supply side
Calculate how input availability and marginal delivery cost change with scale. Determine whether economies of scale lower costs or bottlenecks raise them.
Pro tip Separate upfront development cost from repeated delivery cost.
Watch out A cheap treatment can still be expensive to deliver.
- 6
Gate the expansion
Treat any fatal weakness as a reason to narrow, redesign, or stop the scale-up. Expand only into audiences and circumstances supported by all five signs.
Pro tip Scale selectively where the vital signs are strongest.
Watch out One excellent characteristic cannot compensate for a broken weakest link.
In the wild
List uses Jonas Salk's polio vaccination as a strong scale case. The result replicated, worked across children, fit an existing pediatric checkup and vaccination routine, reduced transmission to others, and became cheap to manufacture after large upfront research costs.
→ The intervention satisfied the five vital signs and scaled broadly through the healthcare system.
When five percent of drivers could receive tips, those drivers worked more and earned more per hour. When tipping expanded to every driver, many more drivers worked, empty-car time increased, and the market response exactly offset the extra tip income.
→ A positive pilot effect disappeared at full scale because of an unintended market spillover.
Common mistakes
Hunting for a silver bullet
One outstanding feature cannot rescue an idea whose audience, delivery, spillovers, or supply side fails at scale.
Ignoring full-market behavior
Partial rollout can miss competition, congestion, and participation changes that appear only after broad adoption.
Assuming pilot inputs are abundant
A program built with a small group of unusually strong staff may fail when expansion requires thousands of comparable people.
Is it for you?
Best for
Leaders deciding whether and where to scale a validated product, program, treatment, or policy.
Not ideal for
Ideas that have not yet produced a credible pilot effect worth testing for scale.
From the transcript
“scaling is actually a weakest link problem”
“there are five major reasons why ideas don't scale and that's what i call the five vital signs in the book”
“your idea is scalable if it doesn't have one of these flaws”
From the episode
#566: John List — A Master Economist on Strategic Quitting, How to Practice Theory of Mind, Learnings from Uber, Optimizations to Boost Donations, the Primitives of Decision-Making, and How Field Experiments Reveal Hidden Realities
John List