Skip to main content
Version: Latest (main)

Proposals

This collection records ideas and design decisions that need more context than a feature guide. The status on each page distinguishes proposed work from experiments, implemented contracts, and decisions that intentionally limit the product scope.

Routing & Selection​

How the router understands requests, bounds model choice, and improves selection without taking over serving-layer scheduling.

ProposalCreatedStatusScope
Decision Model as the First-Class Model2026-11-05ImplementedOne family of decision models answers every routing judgment through System One, with signals, algorithms, plugins, configuration v0.5 and response headers rebuilt around it (#5886).
Decision Ranking Semantics2026-09-01ProposalTier, priority, and comparable-confidence ordering for decision selection.
Routing Scope: Per-Query and Capacity-Aware Routing2026-07-14Decision recordKeeps semantic routing per-query and capacity handling in the serving layer.
Router Learning2026-06-20ImplementedOnline adaptation, route protection, and offline recipe improvement.
Success-Constrained Model Selection2026-09-04ProposalCalibrated success estimates and lifecycle-cost selection under Router Learning (#3412).
Prompt Classification Routing2025-10-08ProposalKeyword, regex, embedding, and classifier signal fusion.

Workflows, Memory & Tools​

Multi-step execution and contextual capabilities that coordinate models, retrieval, memory, and tools around a routed request.

ProposalCreatedStatusScope
Router Flow Workflows2026-06-30ImplementedBounded static and dynamic multi-model workflows.
Agent-Aware Router Contracts2026-08-29ProposalBounded agentic facts and external-runtime handoff at Router seams (Epic #2994).
Deliberation Algorithms2026-06-17ProposalGrounding-aware multi-model synthesis.
Agentic Memory2026-02-09Proof of conceptCross-session memory retrieval and persistence.
OpenAI RAG Integration2026-01-23ImplementedRetrieval through OpenAI Files and Vector Stores.
Advanced Tool Filtering2026-01-14SupersededExplainable filtering and reranking of tool candidates.

Safety & Resilience​

Failure, eligibility, and response-quality boundaries that keep routing behavior explicit when a model cannot or should not handle a request.

ProposalCreatedStatusScope
Model Execution Fallback2026-08-10ImplementedSafe ownership boundary for cross-model fallback.
PRISM2026-03-20ProposalModel qualification and legitimacy checks.
TruthLens2025-12-02ProposalGateway-level hallucination detection and mitigation.

Configuration & Protocols​

Shared contracts for authoring router behavior and reaching the routing engine from different client and transport protocols.

ProposalCreatedStatusScope
Open Intelligence Index 1.0 and Unified Model Arena2026-09-09ImplementedDefines the six open core benchmarks, complete-case index, physical/virtual ranking, operator evidence, routing objectives, and benchmark-version migration.
Unified Model Catalog and Evaluation Index2026-09-04ImplementedUnifies provider, protocol, model, reasoning, presentation, Day-0, and benchmark-comparison metadata.
Standalone Mode2026-10-06ImplementedThe Router serves the OpenAI-compatible API and proxies to backends itself, with one routing core for standalone and extproc modes (#4623).
Unified Config Contract v0.32026-03-17ImplementedOne configuration contract across authoring and deployment surfaces.
Multi-Protocol Adapter Architecture2026-02-18ImplementedProtocol-independent access to the routing engine.
System One API Schemas2026-11-11ImplementedVersioned schemas (systemone/0.2, vllm-sr/5.0, vllm-sr/4.0) for every decision-model API, one API registry for listeners and upstreams, and one codec layer through a schema-neutral IR (#6143).
Standalone HTTP Gateway2026-08-31SupersededA separate gateway binary linking the router packages; superseded by Standalone Mode.

Serving Integrations​

Layering contracts that connect semantic model choice to infrastructure-owned model serving, replica selection, and execution.

ProposalCreatedStatusScope
vLLM Production Stack Integration2025-10-13ProposalLayered semantic and infrastructure routing.
NVIDIA Dynamo Integration2025-10-09ProposalSemantic routing above Dynamo's worker-level routing.

Statuses describe the document's current role:

  • Proposal: a design that is not presented as fully shipped.
  • Proof of concept: an experiment with explicit production limitations.
  • Implemented: a contract represented in the current repository.
  • Decision record: an architectural choice, including work intentionally kept outside the router.
  • Superseded: replaced by a later proposal, kept for its history and analysis.