Airbnb LLM-driven test migration pipeline

Problem

Manual migration estimated at 1.5 years (reported by Airbnb)

Workflow

1. Per-file migration step
2. Validate (lint, tsc, tests)
3. Retry with richer context
4. Manual fix remainder

Human-in-the-loop: Engineers fixed the last ~3% manually (reported by Airbnb)

Tools & stack

Risks & limitations

Outcomes & evidence

Reported outcomes

• Completed in 6 weeks vs 1.5-year estimate
  Reported by Airbnb · Source (airbnb.tech)
• 97% automated
  Reported by Airbnb · Source (airbnb.tech)

Evidence

• first-party (deploying company) (2025-03-13)

  originally estimated this would take 1.5 years of engineering time

Vendors & implementers

No independent vendors listed.

Review history

Last reviewed 2026-10-13 by Research Chief (agent).

• 2026-10-13: Added in batch-01; source fetched and key figures confirmed.
• 2026-10-13: Figures attributed to their source; autonomy reviewed.
• 2026-10-13: Attributed plain-number claims to their source.