Find your focus and passion
Build and grow with the community.
MoM & Routing
Build measurable and continuously improving model pools, recipes, and multi-model routing.
wg/mom-routingFocus
- Model pools, recipes, and lifecycle
- Multi-model collaboration algorithms and strategies
- Model-pool optimization and cross-model efficiency
Router Models & Inference Runtime
Improve Router Models and provide an extensible inference runtime for the model ecosystem.
wg/router-models-inference-runtimeFocus
- Built-in model post-training and release
- Router-native model families beyond BERT
- Self-improvement, fine-tuning, and runtime contracts
Data Plane & Networking
Run a portable and reliable online request path across standalone and gateway-integrated deployments.
wg/data-plane-networkingFocus
- OpenAI-compatible standalone data plane
- Envoy ExtProc, gateways, and networking integrations
- Performance optimization, streaming, dispatch, retries, and telemetry
Enterprise & Environment
Deliver production-grade security, operations, and deployments across supported environments and hardware.
wg/enterprise-environmentFocus
- Management authentication, authorization, identity integration, and audit
- Existing Insights, production observability, workload simulation, and capacity planning
- Stable, scalable deployment APIs and reference stacks
- Multi-environment and multi-hardware support
Agentic & Context
Optimize bounded context, memory, and session continuity for long-running and agentic workloads.
wg/agentic-contextFocus
- Context optimization, prompt-visible memory, and session state
- Session budgets, tool-loop continuity, and safe model or workflow switching
- Typed agent-aware boundaries and bounded collaboration receipts for external runtimes
Developer Experience & Ecosystem
Make vLLM Semantic Router easy to adopt, configure, extend, diagnose, and contribute to.
wg/developer-experience-ecosystemFocus
- First-run CLI, configuration, recipes, errors, and troubleshooting
- Dashboard workflows built on canonical Router and deployment contracts
- Reviewed agent-assisted workflows, documentation, localization, and ecosystem guides
Evaluation & Quality
Make every supported capability measurable and every change verifiable.
wg/evaluation-qualityFocus
- Decision-level routing and first-class MoM evaluation
- Performance coverage, reports, baselines, and hardware qualification
- CI, behavioral E2E, compatibility, security, and regression gates
Lead and Member roles
Roles make technical ownership and contribution paths visible.
- Lead
- One or more per group; a Committer or a Contributor sponsored by a Maintainer.
- Member
- A Contributor with at least one merged repository commit.
- Visibility
- Confirmed Leads and Members appear here with their avatar and name.
- Authority
- Workgroup roles are separate from Open Source Team repository and release authority.
Need a new Workgroup? Propose one only when a durable problem does not fit an existing charter.
Open a proposal