What is Chaos Engineering?
Chaos engineering, told as a story about quietly checking whether the spare generator actually works.
Does our spare generator actually work?No one's sure — it's never been switched off.
A safety net you've never tested might fail when you need it most.It's just gathering dust — no one even remembers when it was last turned on.
Secretly switch one ride off during normal hours — if the spare takes right over, it worked.Do it small, while real guests are still there.
A mechanic quietly switches one off, then checks the gauge to see if the spare takes over.Power drops for a moment, then climbs back once the spare kicks in.
Doing it with no plan at all causes a real accident.It has to be small, reversible, and announced ahead of time.
Chaos engineering = deliberately causing a small, controlled break during normal operation to check whether your backups actually work.
Chaos engineering deliberately injects failure into a system to confirm it holds up the way it was designed to. You form a hypothesis ("it should survive this"), keep the blast radius small, and widen the scope gradually in the real production environment. Doing it on a regular schedule becomes a game day.
When grown-ups say it
- Chaos Engineering
- Quietly checking whether your backup actually works. Done on purpose, small, and planned in advance.
- Fault injection
- Deliberately switching one ride off. This is the actual act chaos engineering performs.
- A planned experiment
- Not random — an experiment planned ahead of time. Decide in advance when, what, and how long.
- Hypothesis testing
- Confirming the belief that "it should survive this." If you're wrong, that's the real payoff.
- Limiting the blast radius
- Starting small and widening it gradually. You never switch off the whole park at once.
- Relation to game days
- A scheduled drill everyone does together. Doing it on a regular schedule becomes a game day. → a fake fire drill day
- Failover
- The very act of the spare taking over. Chaos engineering is how you confirm this actually works.
- Resilience verification
- Turning "it should survive" into "it did survive." Different from a promise made only in words. → the people who keep the park open