Agentic Engineer: orchestration + supervision + architecture

The Agentic Engineer is the L5 role that emerges when AI agents become the primary development modality and the human's job is to architect, orchestrate, and supervise rather than implement.

L5 · SELF-IMPROVINGWhat this level takes
MUSTNot met, not at this level
  • PEV (Plan, Execute, Verify) loop is the standard workflow for all engineering tasks
  • Non-coder contributors can produce software changes via agent interfaces
  • Agentic Engineer role combines orchestration, supervision, and architecture responsibilities
SHOULDExpected in practice, not required
  • Agentic Engineer career ladder exists with defined progression criteria
  • Non-coder contribution rate is tracked as an organizational capability metric
EVIDENCEHow you would check
  • Agentic Engineer role description with orchestration and supervision responsibilities
  • PEV loop documentation and adoption evidence in team workflows
  • Non-coder contributor logs showing software changes via agent interfaces
DEPENDS ON
  • Organization L4 (Team Structure & Roles) - developer-as-agent-manager role must be established
  • Development L5 (Coding Agent Usage) - multi-agent orchestration must be operational

What It Is

The Agentic Engineer is the L5 role that emerges when AI agents become the primary development modality and the human's job is to architect, orchestrate, and supervise rather than implement. The title combines three distinct responsibilities: orchestration (designing and operating the systems that coordinate agent work), supervision (maintaining quality and alignment as agent fleets operate autonomously), and architecture (defining the technical structures and constraints within which agents work safely and effectively).

This is not a senior developer with better AI tools. The Agentic Engineer's primary identity is as an orchestrator of AI systems, not as a software implementer who uses AI as an aid. The career path to Agentic Engineer typically runs through staff engineer, AI champion, context engineer, and L4 fleet manager - it requires a progression of skills that builds to the full role. People who arrive at the Agentic Engineer role without this progression tend to have deep orchestration skills but shallow domain knowledge, which makes them effective at scaling agent systems but less effective at designing the architectural constraints that make agent systems safe in complex domains.

The three components of the role are distinct and require different skills. Orchestration is a systems engineering concern: how do agent tasks get routed, prioritized, parallelized, and coordinated across a fleet? This requires knowledge of distributed systems patterns, workflow engines, and event-driven architectures. Supervision is a quality and safety concern: how do you verify that agents are doing what they're supposed to, at the quality level required, without creating more human oversight work than the agents' output is worth? This requires analytical skill and the ability to design automated verification systems. Architecture is a domain and system design concern: what constraints, patterns, and structures make a given codebase safe for autonomous agent operation? This requires deep understanding of the specific domain and technical system.

At L5, the Agentic Engineer is designing for hundreds or thousands of agent runs per week, not for the individual developer's 5-agent fleet. The work is organizational infrastructure: the orchestration systems, the supervision frameworks, the architectural standards, and the safety controls that make AI-autonomous development reliable at scale.

Why It Matters

The Agentic Engineer role creates the organizational capability that L5 requires:

  • Translates AI potential into reliable production outcomes - L4 teams can get high throughput from individual developers; L5 teams need that throughput to be reliable, safe, and consistent at organizational scale; the Agentic Engineer is what makes that translation possible
  • Owns the hardest coordination problems - as agent fleets scale, the coordination problems become genuinely hard: conflict avoidance, task routing, context sharing across agents, output validation; these are not problems that can be solved by individual developers on their own teams; they require a specialist who thinks about these problems at the organizational level
  • Bridges software architecture and AI systems - the most important architectural decisions for AI-augmented organizations are at the intersection of software architecture and AI systems design; most architects understand one but not the other; the Agentic Engineer is the professional who understands both
  • Enables the non-coder contributor model - L5's ability to have product managers and domain experts direct agent fleets without writing code depends on the orchestration and supervision infrastructure that the Agentic Engineer builds; this unlocks organizational capabilities that no other role provides
  • Defines the next generation of engineering practice - the Agentic Engineer is developing a new discipline; the patterns, practices, and tools they create will be the foundation of how software engineering works in the post-AI era; this is not incremental improvement, it's paradigm definition
TIP

The question that best distinguishes an Agentic Engineer from a senior developer with good AI skills is: "Can you design a system where 100 agents run continuously without human supervision for 8 hours, producing reliable, high-quality outputs?" If the honest answer requires significant caveats about human check-ins, the role is L4, not L5.

Getting Started

  1. Master the full L4 skill set first - the Agentic Engineer role builds on deep L4 competency; before pursuing L5, a developer should be consistently effective at 5-7 parallel agents, have experience with multi-agent coordination (planner-worker patterns, agent-spawned sub-agents), and have contributed to context engineering infrastructure
  2. Study orchestration systems design - the technical foundations of agent orchestration are borrowed from distributed systems: workflow engines (Temporal, Prefect), task queues, event-driven architectures, and observability systems; invest in this technical knowledge as a foundation for orchestration design
  3. Design a supervision architecture for your organization - create a conceptual architecture for how agent outputs would be verified automatically without human review for each category of agent task; this is the core intellectual challenge of the Agentic Engineer role; working through this design reveals the gaps in current tooling and the places where human judgment is still genuinely necessary
  4. Build and operate a production agent workflow - there is no substitute for owning a production agent workflow end-to-end: designing the task routing, writing the supervision checks, handling the failure modes, iterating on the architecture as problems emerge; start with a smaller-scale workflow (10-20 agent runs per day) before scaling
  5. Develop architectural constraint patterns - identify the architectural patterns in your codebase that make agent operation safe (service boundaries, data access patterns, test coverage requirements) and the patterns that make it dangerous (God objects, implicit global state, untested integration points); the Agentic Engineer's architectural work is making more of the codebase fall in the safe category
  6. Connect with the emerging professional community - the Agentic Engineer role is new enough that much of the relevant knowledge is in practitioners' heads rather than textbooks; engage with the communities where this knowledge is being developed: Anthropic's engineering blog, the LangChain and LlamaIndex communities, AI engineering practitioners on technical forums

Common Pitfalls

Treating orchestration as purely technical. The most sophisticated orchestration architecture fails if the agents it coordinates don't have good context, clear task specifications, or adequate quality controls. Orchestration is the coordination layer; it amplifies whatever is in the underlying layer. An Agentic Engineer who focuses on orchestration without also owning context quality and supervision design is building on a weak foundation.

Designing for the average case, not the failure case. Agent orchestration systems encounter failure modes that are qualitatively different from traditional software failure modes: agents that run but produce subtly wrong outputs, agents that interpret ambiguous tasks in unexpected ways, agents that make decisions that are individually correct but collectively inconsistent. The Agentic Engineer must design for these failure modes explicitly, not assume that successful test cases are representative.

Scaling before stabilizing. The temptation at L5 is to scale the agent infrastructure before the underlying quality is stable. A system that runs 100 agents in parallel but produces 40% incorrect outputs at scale is not more valuable than a system that runs 20 agents and produces 90% correct outputs. Scale amplifies quality problems rather than solving them. Stabilize quality first, then scale.

Neglecting the human-agent interface. The Agentic Engineer designs systems that primarily run autonomously - but they also need to design the interfaces through which humans interact with those systems: how does a product manager direct an agent fleet? How does a developer review an agent's architectural decision? How does a security team audit agent behavior? These interfaces are as important as the underlying orchestration, and they are frequently underinvested.

Working in isolation from the business. L5 Agentic Engineers who optimize for technical elegance without maintaining close connection to business outcomes build impressive systems that solve the wrong problems. The Agentic Engineer's architectural and orchestration decisions should be grounded in the specific business outcomes they enable: faster feature delivery, lower defect rates, reduced technical debt accumulation. Stay connected to these outcomes as the primary measure of the work's value.

How Different Roles See It

BobHEAD OF ENGINEERING

Bob's organization is approaching L5. The AI infrastructure is mature, the developers are operating effectively as fleet managers, and the organization is producing at 4-5x the throughput of two years ago. Bob is starting to think about what the next step looks like and realizes he needs someone who can design the organizational-scale orchestration system that turns individual team-level agent workflows into a coordinated, supervised, architecturally-coherent enterprise capability.

What Bob should do: Bob should identify whether the Agentic Engineer he needs is someone to develop from within or hire from outside. The internal candidate - likely Victor or someone on Victor's trajectory - has the domain knowledge and organizational context that an external hire lacks. An external hire might bring more sophisticated orchestration experience but will need 6-12 months to develop the domain context. Bob should have a frank conversation with his best L4 fleet managers about whether the Agentic Engineer role interests them and what they would need to grow into it. If the internal path is viable, investment in training and mentorship is more effective than an external search. If it isn't viable, define the hire's first 90 days explicitly: spend time with each team understanding the domain before designing the organizational orchestration architecture.

SarahPRODUCTIVITY LEAD

Sarah is trying to define the hiring profile for Agentic Engineers for an organization that has never hired for this role. She's looking at job postings from other companies and finding wildly inconsistent definitions - some are really just senior developers with AI interest, others are ML engineers who have wandered into agent systems, and a few are the genuine role she's trying to hire for.

What Sarah should do: Sarah should define the Agentic Engineer role by its outputs, not by its inputs. The outputs: a production agent orchestration system that runs reliably; a supervision framework that maintains quality without requiring constant human review; architectural standards that make agent operation safe in the organization's specific technical environment; and a capability-building program that helps L4 developers develop toward L5. Any candidate who can demonstrate these outputs from previous work is the right hire, regardless of how they got there. Sarah should design the interview process around these outputs: ask candidates to describe a production agent workflow they designed end-to-end, including the failure modes they designed for and how they verified output quality at scale.

VictorSTAFF ENGINEER - AI CHAMPION

Victor has been on the journey from AI champion through context engineer to L4 fleet manager. He's now being given the opportunity to define and inhabit the Agentic Engineer role for the organization. He's uncertain because the role is new and he's not sure he's fully qualified for it - nobody is fully qualified for a role that didn't exist 18 months ago.

What Victor should do: Victor should recognize that being on the frontier of a new role is not the same as being unqualified for it. The skills he has - deep codebase knowledge, fleet management experience, context engineering expertise, and the ability to see systems problems across the organization - are exactly the skills the Agentic Engineer role requires. What he doesn't have yet is experience with organizational-scale orchestration systems; he should invest in this deliberately by designing a small production workflow end-to-end, studying how other practitioners are approaching the orchestration and supervision problems, and connecting with the external community of agentic engineering practitioners. Victor should also be generous with his knowledge as he develops this expertise - the Agentic Engineer who builds the field rather than just claiming a title is more valuable to the organization and to the broader engineering community.

Where does your team actually sit on this?

This guide describes one level of one area. Run the assessment to place your team across all 16 areas, see which gates you have passed, and get a report you can take to your stakeholders.

Start the assessment