What are Security Metrics?
Security metrics — MTTD, MTTR and friends — told as a story about a guard who answers the king's 'is our castle safe?' with numbers instead of feelings.
The king asks: is our castle safe? The guard answers by feel."Probably" fixes nothing. Feelings differ from person to person, and you can't compare yesterday with today.
Without measuring, you don't notice a thief inside for a hundred days — or a bell ringing a hundred times a day.Thieves stay hidden for a long time (dwell), and the bell rings too often because of cats (the big screen). Neither shows until you count.
Security metrics are numbers instead of feelings: how fast we notice, how fast we chase out.From the thief getting in to the bell ringing; from the bell to the thief being out. Measure just these two and you can see the castle improve.
Draw the graph every month. When the bars go down, the castle is getting better.Board wait is the book of cracks, opened fake letters is the thief lesson, rooms with a dog is the guard dogs. Each number lights up one pillar.
There are two kinds of sign: are we doing well, and is danger growing.The green sign is our skill; the red sign is the danger ahead. The five pillars tell you which numbers to measure.
Security metrics = answering "is it safe?" with numbers, not feelings: time to notice, time to chase out, the cat ratio among rings, days waiting for boards. Measure monthly — when the bars go down, the castle is getting better.
Security metrics measure the state of security in numbers: MTTD (mean time to detect), MTTR (mean time to respond/recover), dwell time, false-positive rate, patch SLA compliance, phishing click and report rates, coverage. KPIs show how well our work performs, KRIs show growing risk — and both are read as trends.
When grown-ups say it
- MTTD (Mean Time to Detect)
- From the thief getting in to the bell ringing. Count the average days. Shorter is better.
- MTTR (Mean Time to Respond)
- From the bell to the thief being out. A better book of steps makes it shorter. → the book for when a thief gets in
- Dwell time
- All the days the thief was inside. Goes down when you go looking instead of waiting for the bell. → the watchman who doesn't wait
- False positive rate
- The cat ratio. How many rings were false. Tuning the rules brings it down. → the guard room's big screen
- Patch SLA
- The promised wait for boards. How many days you promised to fix a crack within, and whether you kept it. → the monthly book of cracks
- Click rate, report rate
- Who opened the fake letter, who reported it. Openers should fall and reporters rise. → the thief lesson
- Coverage
- The share of rooms with a dog. You can't guard a room you don't know about. → a dog in every room, counting doors from outside
- KPI vs KRI
- The green sign and the red sign. KPI is our skill (performance), KRI is growing risk. Read both. → the risk scale