Independent Hiring Bar
Use job-like evidence and a separate decision-maker to resist rushed hiring
- Difficulty
- Moderate
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 98%
The Independent Hiring Bar combines role-specific evidence with a decision structure designed to resist urgency bias. Start with the closest available proof of future performance: a designer's portfolio, a technical exercise, or a work product that resembles the actual job. Add behavioral questions that expose judgment and accountability; when candidates discuss failure, look for a genuine miss and whether they own their contribution instead of blaming others. The final control is organizational. Because hiring managers feel the pain of an empty role, they are biased toward accepting a candidate. Duolingo lets another person hold the final quality bar. This matters especially in its low-churn environment, where waiting months for someone materially better can pay off over an eight-year tenure.
Origin
Luis von Ahn described Duolingo's role-specific assessments and the separate hiring-bar decision on The Tim Ferriss Show, including a year-long CFO search.
Core principles
- 01Match assessment to the actual job
- 02Prefer demonstrated work over self-description
- 03Test whether candidates own real failures
- 04Separate staffing urgency from the quality decision
- 05Wait longer when employees are likely to stay longer
How to run it
- 1
Define job evidence
Identify what successful work in the role actually looks like. Choose an assessment that reproduces that work as closely as practical.
Pro tip Use existing work when it is highly diagnostic, as with a design portfolio.
Watch out Generic interview fluency can conceal weak job performance.
- 2
Collect a work sample
Have the candidate complete relevant work either live or offline. Allow adequate time when speed is not part of the job.
Pro tip Judge the same dimensions you expect to judge after hiring.
Watch out A sample unrelated to day-to-day work creates false confidence.
- 3
Probe failure ownership
Ask for a real failure and keep probing until the candidate describes one. Listen for recognition, responsibility, and learning.
Pro tip Distinguish an actual failure from a success disguised as weakness.
Watch out Repeatedly blaming managers or colleagues predicts the same behavior after hiring.
- 4
Expose urgency bias
Record why the role feels urgent and how that pressure may distort judgment. Keep the operational pain separate from the candidate's quality.
Pro tip Name the vacancy cost explicitly before final interviews.
Watch out After a long search, fatigue can make almost any candidate appear sufficient.
- 5
Use an independent bar holder
Give a qualified person who does not directly suffer from the vacancy authority to reject the hire. Include the hiring manager's evidence but not their urgency.
Pro tip Reciprocate by holding the bar for each other's hires.
Watch out The independent reviewer still needs enough role context to judge the evidence fairly.
In the wild
Luis spent about a year searching for a chief financial officer and began wanting to take whoever was available after roughly nine months. Duolingo waited and hired Matt Skaruppa, whom Luis described as amazing and central to the company's public-market preparation.
→ The company avoided lowering its bar under search fatigue and hired a CFO Luis believed was the right person.
Duolingo asks candidates to describe a failure and listens for whether it is genuine, whether they recognize it, and whether they blame other people. A polished non-failure or a story in which the candidate was always right is treated as a bad sign.
→ The interview surfaces accountability patterns that may recur after the candidate joins.
Common mistakes
Accepting a disguised success
A failure answer such as caring too much does not demonstrate self-awareness. Keep probing for a real miss.
Letting the vacancy vote
The person in pain from an empty role is strongly biased toward hiring. Move final bar authority to someone else.
Testing unrelated abilities
Assessments should resemble the work the person will perform. Remote proxies make the decision less reliable.
Is it for you?
Best for
Organizations where hires remain for years and the cost of accepting a below-bar candidate is high.
Not ideal for
Emergency staffing where the cost of leaving the role vacant clearly exceeds the long-term cost of a weaker hire.
From the transcript
“work product is is really good i i think that really tells you whether and it has to be pretty close to what they're supposed…”
“when you are the hiring manager so the person that's actually going to work with them and usually it's because you you're hiring somebody because…”
“ultimately at duolingo the decisions are not by the hiring manager”
From the episode
#607: Luis von Ahn, Co-Founder and CEO of Duolingo — How to Be (Truly) Mission-Driven, Monetization Experiments, 10x Growth, Org Chart Iterations for Impacting Metrics, The Intricate Path to an IPO, Best Hiring Practices, Catching Exam Cheaters, The Allure of Toto Toilets, The Future of Duolingo, and How to Stand Out in Your Career