AI systems

Context Is The Scarce Resource

Why an agentic system’s quality is often determined before the model receives its first instruction.

The model receives the applause because it performs the visible magic. The surrounding system does quieter work; it decides what the model can know, what it may do, what must be checked, and whether a polished answer deserves to become a real decision.

Capability Is Abundant; Relevance Is Not

Modern models can generate, classify, reason, search, transform, and act across an extraordinary range of tasks. That breadth creates a seductive design habit: provide more documents, allow more tools, increase autonomy, and hope raw capability resolves whatever the workflow failed to define.

It usually does not. Every instruction, memory, document, tool, and agent competes for attention. A large context window can hold more information, but storage is not understanding. Context becomes useful only when it changes a decision, protects a constraint, exposes a risk, or supplies evidence the system would otherwise lack.

The goal is not maximum context. The goal is sufficient, trustworthy context at the moment a decision requires it.

The Prompt Is Not The Product

A prompt can be excellent and still sit inside a poor system. If the source material is stale, the requested outcome is ambiguous, the tools are overpowered, or nobody owns verification, clever wording merely helps the workflow fail more fluently.

This is why I think of prompt engineering as one craft inside context engineering. The prompt shapes an interaction. The context system shapes the conditions surrounding that interaction: which sources are eligible, how they are transformed, when they expire, which tools are available, what state survives, and how the result returns to accountable human work.

That distinction is not semantic decoration. It changes where teams invest. Instead of endlessly tuning a paragraph of instructions, they begin improving the information architecture, decision boundaries, evaluation method, and operating model around the model.

Context Has A Supply Chain

Useful context must be sourced, selected, shaped, timed, and attributed. A serious system needs to distinguish stable policy from recent state, source evidence from interpretation, user intent from inferred preference, and a hard constraint from a helpful suggestion.

That makes context engineering resemble a supply chain:

  • Source: Where did this information come from; who owns its accuracy?
  • Select: Why is this evidence relevant to the current decision?
  • Transform: What was summarized, filtered, translated, or normalized before the model saw it?
  • Route: Which decision receives which information; why does it belong there?
  • Expire: When does the information stop being safe to reuse?
  • Prove: Can the final claim be traced back to the evidence that supports it?

Every transformation can create value; every transformation can also introduce loss. A summary may reveal the signal or flatten the nuance. A memory may create continuity or preserve an obsolete assumption. Retrieval may focus the model or confidently deliver the wrong neighborhood of information. The pipeline must make those tradeoffs visible enough to inspect.

More Context Can Reduce Intelligence

More information feels safer because omission is easy to fear. Yet redundant documents create contradictions; old memory competes with current state; generic instructions dilute task-specific constraints; unfiltered retrieval turns the model into the final relevance engine even when the application knows far more about the workflow.

The result can look intelligent while becoming less dependable. The answer grows longer, the confidence grows smoother, and the relationship between claim and evidence grows harder to see. This is expensive twice: first in computation, then in the human effort required to discover which elegant sentence came from the wrong source.

A useful reduction test is simple: if a piece of context disappeared, would the system make a meaningfully worse decision? If not, it may be noise. The inverse matters even more: what missing or stale fact could make the system confidently wrong? That is the context worth protecting.

Design The Decision Boundary First

Before choosing a model, define the decision. What must become true? What evidence changes the recommendation? What action may the system take? What consequence follows if it is wrong? Who owns the residual uncertainty?

Those answers create boundaries for context, tools, autonomy, and verification. A low-risk formatting task may need a template and one source document. A procurement recommendation may need verified requirements, current vendor evidence, explicit financial assumptions, conflict checks, and an accountable reviewer. The model might be identical; the systems should not be.

This is also where cost becomes more honest. The cheapest model is not economical if people must rebuild its work. The most capable model is not efficient if the task never needed its range. Capability should be matched to the consequence and uncertainty of the step, not to the excitement surrounding the technology.

Verification Is Context Moving Forward

Verification is often treated as a final gate: generate the answer, then inspect it. I prefer to see verification as context produced for the next decision. Tests, citations, calculations, reviewer notes, unresolved questions, and provenance are not administrative exhaust; they are evidence that lets the workflow continue responsibly.

This changes the design of agentic work. An agent should not merely return a conclusion. It should return the state that makes the conclusion understandable: sources consulted, assumptions made, tools used, conflicts found, checks passed, checks skipped, and uncertainty that remains.

Visible state does not eliminate failure. It makes failure less mysterious, recovery less expensive, and improvement more grounded than another round of prompt superstition.

A Worked Example: The Executive Brief

Imagine leadership asks whether an emerging AI capability merits an enterprise pilot. The weak workflow asks a powerful model to research the topic and write a persuasive memo. The output may be impressive; the decision system is almost absent.

A contextual pipeline begins by separating the decision from the topic. What would the pilot need to prove? Which users and workflows matter? What safety, integration, legal, financial, or adoption constraint can stop the effort? Which claims require primary evidence? What uncertainty is acceptable at pilot scale but unacceptable at production scale?

Research, analysis, and synthesis can then become separate capability lanes. Research gathers attributable evidence. Analysis tests the evidence against the decision criteria. Synthesis communicates what matters to the audience. Verification checks citations, calculations, contradictions, and recommendation logic. A human owner accepts the residual uncertainty because authority was designed, not implied.

The final brief may be shorter than the model-first version. It will also be easier to defend, revise, and act upon; that is a better form of intelligence.

Humans Need A Real Job In The Loop

“Human in the loop” sounds responsible, but it can hide an empty role. If the reviewer receives a polished answer without sources, intermediate state, or decision criteria, the person is not governing the system. The person is being asked to absorb its ambiguity at the last possible moment.

Human authority should be specific. One person may approve a tool action; another may resolve a domain conflict; another may decide whether the evidence is sufficient for business risk. The system should prepare each person for that judgment instead of delivering a theatrical approval button.

Context Efficiency Is A Quality Question

I am interested in context efficiency, but not as a contest to minimize tokens in isolation. The stronger question is how much trustworthy decision quality the system preserves per unit of context, cost, time, and human attention.

An efficient pipeline removes information that does not change the decision; preserves provenance through transformation; routes expensive capability only where it adds value; and spends verification effort in proportion to consequence. Sometimes that produces a smaller system. Sometimes it justifies a larger one. Efficiency is not austerity; it is disciplined allocation.

What I Am Still Testing

The Contextual Pipeline Framework is my current model, not a declaration of completion. I am still testing how to measure context quality without rewarding brevity for its own sake; how to route work by risk rather than task label; how to price verification; how to preserve provenance across multi-agent handoffs; and how to distinguish useful autonomy from expensive motion.

The durable idea is simpler than the framework: intelligence is a property of the whole accountable system. The model matters. So do the sources, boundaries, tools, evidence, people, and feedback surrounding it. When those parts work together, the result does more than sound smart; it becomes useful work someone can understand, defend, and improve.

Read nextCreate Clarity, Then Give It Away

Continue the conversation

Good ideas improve under pressure.

If this model resembles something you are seeing in practice, or fails to account for it, I’d value the conversation.