跳到主要内容

4 篇博文 含有标签「release」

查看所有标签

vLLM Semantic Router v0.4 Hermes: Many Models, One Improving System

· 阅读需 23 分钟

An application should not need a new integration every time the best model changes. Hermes gives it one stable model name, while vLLM Semantic Router chooses from a qualified pool, delivers the answer, and measures whether that choice helped.

Themis (v0.3) made routing stateful and inspectable. Hermes turns that foundation into a model system that can improve as models and workloads change.

982 commits · 130 contributors · 107 first-time contributors since Themis. This is a milestone built by a growing community across models, runtime, evaluation, and the experience of putting it all to work.

vLLM Semantic Router v0.4 Hermes: one model name, a system built to improve

Hermes: many models, one improving system.

Introducing Decision 1.0: Open Decision Foundation Models

· 阅读需 10 分钟

From the next move to a whole queue of decisions. Meet Decision 1.0. Sound on.

AI is moving from generating answers to making decisions inside software.

Those decisions are everywhere: route an intent, gate an action by confidence, combine signals into a score, or ask many questions at once. Small decisions can shape the behavior of an entire system.

That vision is deeply aligned with vLLM Semantic Router: understand each request, apply policy, and choose what should happen next. It is why we invested in Decision 1.0: six open-weight Decision Foundation Models—and why we will keep improving them in the open.

Read the paper → · Explore the six models → · Try Decision Studio →

Introducing Vela 1.0

· 阅读需 10 分钟

Every request finds its way. Meet Vela in 87 seconds. Sound on.

Today, we're excited to release Vela 1.0: 14 open models built for a world of many models.

Vela helps systems understand requests, protect sensitive information, find better context, and connect text, images, and audio. It is the model family we're building for vLLM Semantic Router, and a new foundation for everyone turning a collection of models into a capable system.

Explore all 14 models → · Try in Vela Studio →

Semantic Router Q4 2025 Roadmap: Journey to Iris

· 阅读需 15 分钟
Xunzhuo Liu
Intelligent Routing @vLLM | Open Source & AI @AMD
Huamin Chen
AI @Microsoft
Chen Wang
Senior Staff Research Scientist @ IBM
Yue Zhu
Staff Research Scientist @ IBM

As we approach the end of 2025, we're excited to share our Q4 2025 roadmap for vLLM Semantic Router. This quarter marks a significant milestone in our project's evolution as we prepare for our first major release: v0.1, codename "Iris", expected in late 2025 to early 2026.

iris