Agent knows only public API knowledge
When an agent operates with only public API knowledge, it answers questions about your codebase using information from its training data - open-source documentation, public GitHub
- ·No MCP servers are configured
- ·Agents rely solely on public API knowledge from training data
- ·Team is aware of MCP as a standard for agent-tool integration
- ·Integrations, if any, are manual (copy-paste between tools)
Evidence
- ·No MCP configuration files in repository or developer environment
- ·Absence of tool integration beyond IDE built-ins
What It Is
When an agent operates with only public API knowledge, it answers questions about your codebase using information from its training data - open-source documentation, public GitHub repositories, Stack Overflow, and official library references. It knows what the Stripe API looks like in general, what a typical PostgreSQL schema looks like, how Express.js middleware works. It does not know what your Stripe integration looks like, what your PostgreSQL schema looks like, or how your Express middleware is wired.
This state is almost universal at L1. The agent is genuinely helpful for generic programming tasks - "how do I write a regex that matches email addresses," "what does Array.reduce do," "show me an example of a React useEffect" - but degrades significantly the moment the question becomes internal. "What parameters does our UserService.create method accept?" gets answered with a guess based on what UserService.create usually looks like in public codebases. The guess is often structurally plausible but specifically wrong.
The core problem is that the agent has no way to distinguish between your API and the public API it was trained on. If your internal library wraps a popular framework and diverges from the default conventions, the agent will follow the public convention and produce code that fails at runtime. This failure mode is particularly insidious because the code looks correct - it would be correct for the standard library. Only a developer who knows the internal divergence will catch it.
Why It Matters
- Hidden correctness degradation - agents confidently produce wrong internal-API usage without any signal that they're guessing; the errors surface later in testing or code review, not at generation time
- Quantifies the context gap - measuring how often agents suggest the wrong internal API variant reveals exactly how much value is being lost to the public-API-only limitation
- Makes internal library investment risky - teams that build internal abstractions on top of popular libraries are penalized at this level; the more your codebase diverges from public conventions, the worse agent output quality becomes
- Motivates the simplest MCP investment - pointing an agent at your actual source code (via a filesystem MCP server or Claude Code's native file access) immediately closes the gap for the most common failure mode
- Differentiates agent types - understanding this limitation helps teams route tasks correctly: use agents for generic tasks where public knowledge is sufficient, and route internal-API tasks to agents with actual codebase access
Getting Started
5 steps to get from here to the next level
Common Pitfalls
Mistakes teams actually make at this stage - and how to avoid them
How Different Roles See It
Bob's team is building on top of an internal platform layer that wraps several external services. Senior developers know the internal conventions well, but new hires and the AI agents they use keep using the external service APIs directly instead of the internal wrappers. This causes subtle bugs and requires senior developers to spend time in code review catching incorrect API usage.
What Bob should do - role-specific action plan
Sarah notices that junior developers and new hires using AI tools produce code with more internal API mistakes than senior developers using the same tools. The seniors catch the mistakes in review, but the back-and-forth is adding review cycles and slowing delivery. She suspects the AI tools are part of the problem.
What Sarah should do - role-specific action plan
Victor has personally solved this problem for himself by maintaining a detailed CLAUDE.md file and a set of internal API snippets he pastes into agent context when working on integration tasks. His agent output quality is noticeably higher than his colleagues', but the solution doesn't scale - it depends on his personal knowledge of what context to provide.
What Victor should do - role-specific action plan
Further Reading
4 resources worth reading - hand-picked, not scraped
From the Field
Recent releases, projects, and discussions relevant to this maturity level.
MCP & Tool Integration