跳到主要内容

1 篇博文 含有标签「lettucedetect」

查看所有标签

LettuceDetect v2 in Semantic Router: Generative Hallucination Detection as a vLLM Endpoint

· 阅读需 9 分钟
Ádám Kovács
Co-founder @ KR Labs · LettuceDetect
Bowei He
Postdoctoral Researcher @ MBZUAI · McGill
Xunzhuo Liu
Intelligent Routing @vLLM
Huamin Chen
Distinguished Engineer @ Red Hat

Semantic Router can now verify grounded responses with a generative span detector served by vLLM. The new endpoint detector backend runs LettuceDetect v2 against every fact-checkable answer: unsupported spans are located to the character, typed against a hallucination taxonomy, and explained — in one call, before the response reaches the user.

The models come out of a joint paper between KR Labs and the Semantic Router team, Beyond Document Grounding: Span-Level Hallucination Detection over Code, Tool Output, and Documents (arXiv:2607.00895). This post walks through the paper — the benchmark, the taxonomy, the models, and what they score — and then through the integration that puts the detector into the serving stack.

LettuceDetect v2 flagging contract hallucinations through Semantic Router