Matrix/Development

Development

How developers work with AI day-to-day. From sidebar chat to fleet agents.

4capabilities20levels60practices60guides
The matrix · full map
Capability ↓
Maturity →
L1 · Stage 01
Assisted
L2 · Stage 02
Delegated
L3 · Stage 03
Systematic
L4 · Stage 04
Governed
Sweet spot
L5 · Stage 05
Self-improving
01·15 guides
Coding Agent Usage
How your team uses AI coding assistants - from autocomplete to autonomous agent fleets
Autocomplete and a chat window
3 practices·3 guides
An agent in the IDE, rules in the repo
3 practices·3 guides
CLI agents become the primary interface
3 practices·3 guides
Unattended agents, inside a written boundary
3 practices·3 guides
A fleet ships faster than you can read
3 practices·3 guides
02·15 guides
Context Engineering
What information agents receive about your codebase, architecture, and conventions
The agent sees one open file
3 practices·3 guides
CLAUDE.md tells it the basics
3 practices·3 guides
Context is served, not scavenged
3 practices·3 guides
The org pushes context to the agent
3 practices·3 guides
Context maintains itself
3 practices·3 guides
03·15 guides
Code Review & Quality
How AI-generated code is reviewed, validated, and approved before merging
Humans review everything, slowly
3 practices·3 guides
AI suggests, humans still decide
3 practices·3 guides
Lint is architecture; AI takes first pass
3 practices·3 guides
Green merges on policy, never without an owner
3 practices·3 guides
Human eyes only on Red
3 practices·3 guides
04·15 guides
Testing Strategy
How tests are written, maintained, and validated in an AI-assisted workflow
Tests by hand, flakes by habit
3 practices·3 guides
Agents write tests, humans own the oracle
3 practices·3 guides
Requirements are the oracle, not the code
3 practices·3 guides
A red test means a real defect
3 practices·3 guides
The suite heals itself
3 practices·3 guides
Climb the matrix

You don't have to figure this out alone.

Every level in this matrix has a path. Read the playbooks the teams that have climbed it wrote. Run the assessment with our consultants. Start where you are.

Live with Visdom

Book an AI Maturity Assessment session with your team.

We walk you through all four perspectives, score where you actually are, and leave you with a 90-day plan to climb in the dimensions that matter most.

Book an assessment See what's included90-day plan - scored assessment - coaching
Author Commentary

The September 2026 zeitgeist is the factory floor.

July told you verification was the throughput limit. August did something less romantic and more useful: it built the machinery. Vercel published an actual operating manual for a software factory - specialised agents in isolated sandboxes, and every run terminating in one of four states: success, flawed, blocked, manual. Only `success` ships. The other three are not failures, they are routing instructions, and each points at a different repair: better prompts and evals, a missing environment, or a boundary drawn in the wrong place. Addy Osmani took that taxonomy and named the thing it measures - a verification budget - and made the trade explicit: when agent velocity outruns your capacity to check the work, you have exactly three levers, and two of them are unpleasant.

The month's sharpest reversal is in testing. Birgitta Böckeler ran TDD inside the agent loop and found that non-TDD solutions consistently beat TDD ones, at three to eight times fewer tokens - because an agent told to write the test first makes locally-minimal decisions around that first test and hardens a bad design early. TDD's real benefits, she argues, are human ones: fear management, forced pacing, permission to relax. Machines do not feel fear. Her sample is five batches and she says so plainly, so take it as a provocation rather than a verdict - but the direction it points is already supported: stop mandating the *process* and measure the *outcome*. Mutation testing is the obvious instrument, and the number that should end the coverage argument is a component with 100% line coverage and 61% mutation strength. Meanwhile 31% of accepted AI completions are deleted within fifteen minutes, so acceptance rate joins coverage in the vanity pile.

One correction to last month's edition, because it matters. July's news was Claude Code flipping its default permission mode to Manual. On August 14 it flipped back to auto - but the honest reading is not "the industry gave up on control". Developers approve 97% of permission prompts; humans caught 13.6% of dangerous commands where a classifier caught 89%. What replaced the human click was not the classifier alone but a declarative ruleset that outranks it: `permissions.deny` cannot be overridden by the classifier or by stated intent, and auto mode stays opt-in on Enterprise and the API. The maturity signal moved accordingly. It is no longer whether a human is in the loop, and it is not the classifier either. It is whether your autonomy policy is written down, version-controlled and reviewed like any other production config.

Other perspectives