DORA Metrics Implementation
Delivery measured from the systems that already record it. Cycle time, deployment frequency, change failure rate and recovery time, reconstructed from your history rather than estimated.
- Who
- Founder holds the engineering leadership seat; the delivery team executes underneath it.
What you're seeing
- A board asked how delivery is trending and the answer was assembled by hand.
- Usually means There is no ongoing measurement, so every request for one costs an engineer a day and produces a number nobody can reproduce next quarter.
- Two teams report velocity and the numbers cannot be compared.
- Usually means Story points are team-local by design. Comparing them measures how each team estimates, which is why the comparison always produces an argument rather than a decision.
- Nobody knows how often a deploy causes a problem.
- Usually means Change failure rate is unmeasured, so caution is substituting for evidence. It shows up as batching, longer release cycles, and a growing reluctance to ship on a Friday.
- A process change was made six months ago and nobody can say whether it helped.
- Usually means There was no baseline before it. This is the most expensive consequence of not measuring — improvements and regressions are both invisible, so the same debates recur indefinitely.
Measured, not estimated
The four metrics come out of Git and CI. Nobody points a ticket, nobody fills in a form, and there is nothing for a well-meaning team to round in a favourable direction.
That property is what makes them worth the setup. Estimation-based measures describe how a team estimates, which is a real thing but not the thing anyone wanted to know. Artefact-based measures describe what happened. When the two disagree — and they routinely do — the disagreement is itself a finding worth having.
The first deliverable is a reconstructed baseline covering the previous six to twelve months, because the history is already there. That turns the first report into a trend, which people act on, rather than a single number, which people argue about.
Definitions before collection
The tedious part of this work is agreeing what counts, and skipping it is what makes the numbers worthless later.
Does a configuration change count as a deploy. Does a rollback count as a deploy, as a failure, or as both. Is recovery measured from when the fix merged or from when it was serving traffic. Does a hotfix that bypassed the normal path count at all.
None of these have universally correct answers. All of them have to be answered the same way every time, and written down, or the series breaks silently the first time the tooling changes and nobody notices for a quarter.
The protocol decides whether it lasts
What determines the survival of a metrics programme is not the dashboard. It is the written agreement about what the numbers may be used for.
Used to locate where the delivery system leaks time, they keep working indefinitely and the team helps improve them. Used to compare individuals, or teams with different work, they stop describing reality within a quarter — not because anyone cheats, but because everyone rationally optimises for what is being watched.
So two dashboards get built, deliberately. One for engineering, with enough resolution to investigate. One for the board, with the four numbers and a trend line and no per-team breakdown at all.
Where it sits
This capability sits under Engineering Velocity as the instrument the diagnosis runs on, inside the five-day Engineering Audit as the reconstructed baseline, under CTO Consulting where a velocity sprint needs a before-and-after, and inside Delivery Implementation where it is installed early so the later milestones can be evaluated.
Two neighbours. Board Delivery Reporting is what turns these four numbers into something a non-technical director can read without context. And Process Rebuild is usually what the numbers point at once they exist.
How the work runs
-
Reconstruct the baseline
Six to twelve months of history pulled from version control and CI, so the first report shows a trend rather than a single point.
-
Define the events precisely
What counts as a deploy, as a failure, as recovered. Ambiguity here is what makes cross-team comparison meaningless.
-
Instrument for ongoing collection
Collection wired into the pipeline so the numbers keep arriving without anyone maintaining a spreadsheet.
-
Set the reading protocol
Who looks, how often, and what the metric is allowed to be used for — which is the part that decides whether the programme survives.
What arrives
- A twelve-month reconstructed baseline for the four metrics
- Automated collection wired into the existing pipeline
- A dashboard aimed at engineering, and a separate one aimed at the board
- A written statement of what these numbers may and may not be used for
What it costs your team
Two to three hours of engineering time for access and event definitions. Collection runs itself afterwards.
How we decide
The baseline is reconstructed from history before anything is instrumented
Costs It is more work up front than turning collection on and waiting.
Version control already contains six to twelve months of the answer. Reconstructing it means the first report is a trend rather than a single point, which is the difference between a number people argue about and a picture people act on. Starting collection today means the first useful reading is two quarters away.
No individual's numbers are reported
Costs It refuses the analysis executives most often ask for.
Applied to a person, these metrics measure ticket size, and people respond by changing ticket size — at which point the data stops describing anything. The moment a team believes per-engineer measurement is happening, the instrument breaks. A team that trusts the numbers is worth more than any one answer about an individual.
The event definitions are written down and agreed before collection
Costs It is a tedious conversation about what counts as a deploy.
Ambiguity here is what makes cross-team comparison meaningless. Does a config change count. Does a rollback count as a deploy, a failure, or both. Is recovery when the fix merged or when it was live. Deciding these once, in writing, is what makes the numbers survive a change of tooling.
Where this has run
Frequently Asked Questions
Sources
- DORA — the four key metricsdora.dev
- DORA — DevOps Research and Assessmentdora.dev
- DORA — State of DevOps reportdora.dev
- Google Cloud — DevOps capabilitiescloud.google.com
Page reviewed

