Guide · Architecture
A hybrid router for high-stakes agentic work
A decision framework for reserving expensive capability for the requests that need it, while keeping routine work observable and reversible.
1. Decide whether a hybrid route is justified
When is a two-model route operationally safer and economically better than sending every request to one endpoint?
Begin with a narrow, reviewable split: route multi-file agentic coding and high-ambiguity tasks to the higher-capability lane; route stable classification, extraction, and straightforward drafting to the lower-cost lane.
2. State the assumptions that make the route auditable
A blended result is only useful when the route can be reconstructed later. Record the conditions that determine dispatch before comparing projected cost.
- Traffic can be labeled by task type before dispatch.
- Quality loss has a measurable business cost and an escalation mechanism.
- Latency and price are measured under the same host and workload conditions.
- Fallback behavior is tested independently from the primary route.
3. Separate facts, derived relationships, and interpretation
Evidence quality changes what a routing result can support. Keep teaching fixtures and editorial judgment visibly separate from observed prices, service measurements, and production outcomes.
Verify the input/output mix and host prices.
Verify acceptance rate, recovery cost, and human review.
Replace the fixture with production telemetry.
4. Compare routing policies on the same cost basis
The illustrative scenario below demonstrates how three routing policies can be reviewed. It does not report live prices, measured savings, or a recommended production split.
Illustrative monthly cost index
| Policy | Monthly index |
|---|---|
| Single premium lane | 100 |
| Hybrid with review | 62 |
| Single economy lane | 41 |
5. Choose the route and its guardrail together
The routing condition, preferred lane, and operational guardrail form one decision. Separating them makes a cheap path look safer than it is.
Guardrail: human review on sampled completions.
Guardrail: schema validation and fallback.
Guardrail: circuit breaker and event log.
6. Continue with the decision surfaces
Use the framework to build a shortlist, inspect model constraints, and compare candidates under the same assumptions.
