跳到主要内容
版本:最新版(main)

Extension reference

vllm-sr/5.0 is systemone/0.2, the published System One standard, plus the fields below, extension set 5.0. Every vllm-sr message is a complete standard message: an extension field is an additive hint in its natural place, and a vllm-sr server answers an unknown field with 400 naming it.

The last column says what the Router does with the field when the target deployment speaks systemone/0.2: it strips a field the standard part of the message already expresses, refuses at load a rule that needs one the standard cannot carry, and never expects a response field.

Request​

FieldTypeSinceFamiliesOn systemone/0.2Description
rolesobject of user or context or answer5.0vela2, vela3, vela3_d3strippedWhich state keys hold the user's content, context, or the answer under check. Role-aware families read the state's parts by these roles; without roles, the whole state is the user's content on every family.
optionsobject5.0allstrippeddeadline_ms (work not started by then is not run, and its questions answer deadline_exceeded), return_meta (the response adds meta) and max_tokens (the scan budget of a model that reads a long part in windows). A standard target is bounded by the client's own timeout instead.

Question​

FieldTypeSinceFamiliesOn systemone/0.2Description
presetstring5.0decision1, vela2, vela3, vela3_d3strippedA question the model was trained on, such as pii, answered by its trained head. The question still carries its own instructions and criteria, which any other server answers.
head (span)router or broad5.0vela2, vela3, vela3_d3refused at loadThe span head that answers: router, or broad on models that have a broad span head.
decision_adapter (choice, noul, score)boolean5.0vela3_d3refused at loadAnswers with the package's opt-in decision adapter, on Vela 3.0 d3 sizes that declare one.
overstring or array of string5.0vela2, vela3, vela3_d3refused at loadThe state keys the question reads, in state order; by default the whole state (a span: its answer part if present, else its user part).
overflowwindow or truncate5.0vela2, vela3, vela3_d3strippedHow a model with a scan budget reads a part longer than one input: window (whole, in windows) or truncate (its first tokens).
require_full_inputboolean5.0allrefused at loadFails the question unless every state part is read completely; its answer then carries input_coverage: complete, which the standard has no field for.
threshold (set, span)number5.0vela2, vela3, vela3_d3refused at loadReplaces the model's decision threshold for a set or span question; the applied value comes back in thresholds.
at (box)number5.0decision3, vela3_d3refused at loadA box question on a video: the second to read, from the start of the state's only video.
rate (track)1 or 25.0decision3, vela3_d3refused at loadA track question's updates per second over the whole video, 1 (the default) or 2.

Question type​

FieldTypeSinceFamiliesOn systemone/0.2Description
spanobject5.0vela2, vela3, vela3_d3refused at loadWhere each label of criteria occurs in the text it reads. The answer is a noul (the highest probability any word reached) and its spans under spans.
setobject5.0vela2, vela3refused at loadWhich labels of criteria apply, each with its own probability, under sets; each label also answers as a noul under <question>.<label>.
trackobject5.0decision3, vela3_d3refused at loadA box for each sampled moment of the state's only video, on models whose card declares track questions.

Asset type​

FieldTypeSinceFamiliesOn systemone/0.2Description
videoobject5.0decision3, vela3_d3refused at loadA video, placed where its placeholder is, on models whose card lists the video modality.

Answer​

FieldTypeSinceFamiliesOn systemone/0.2Description
abstain_probability (choice, noul)number5.0vela2, vela3never sentThe probability of the model's abstain option, where it has one (not calibrated).
input_coveragecomplete5.0allnever sentProof that a require_full_input question read every state part completely.
errorinvalid_question or invalid_input or max_length_exceeded or scan_budget_exceeded or invalid_model_output or deadline_exceeded or unavailable5.0allnever sentWhy this question has no answer, on POST /v1/decisions, which answers the other questions in the same 200.
reasonstring5.0allnever sentA fixed word for why the question failed; it never carries request data.
messagestring5.0allnever sentWhy the question failed, for a person to read.

Response​

FieldTypeSinceFamiliesOn systemone/0.2Description
spansobject of array of object5.0vela2, vela3, vela3_d3never sentEach span question's spans: label, start and end (Unicode code points into the text it read, end exclusive), text and probability.
setsobject of object5.0vela2, vela3never sentEach set question's selected labels and the probability of every label.
thresholdsobject of number5.0vela2, vela3, vela3_d3never sentThe threshold applied to each set or span question.
span_headsobject of router or broad5.0vela2never sentThe span head that answered each span question, on models with a broad span head.
metaobject5.0allnever sentWith options.return_meta, the model's verified identity, revision, precision, numerics, engine, device and timings.
routingobject5.0the Routernever sentAdded by the Router's vllm-sr/auto routing: the recipe, decision, algorithm, stage and model that answered, and the model calls made.

Error​

FieldTypeSinceFamiliesOn systemone/0.2Description
codestring5.0allnever sentA stable error code beside the standard detail, such as invalid_request, model_not_found, overloaded or question_failed.
questionstring5.0allnever sentThe question whose failure answers the request (question_failed).
statestring5.0allnever sentIn a batch, the name of the request the failed question belongs to.
reasonstring5.0allnever sentA fixed word for why the request or its question failed; it never carries request data.
limitinteger5.0allnever sentThe limit reason names, when one was broken (bytes, pixels, seconds or tokens).

Listing entry​

FieldTypeSinceFamiliesOn systemone/0.2Description
versionstring5.0allnever sentThe extension set version the server answers with, such as 5.0.
featuresarray of string5.0allnever sentThe question types and extension features the model answers, which vllm-sr/auto routes by.
cardobject5.0allnever sentThe model card, with its limits and placement.

Endpoint​

EndpointSinceFamiliesDescription
POST /v1/systemone/batch5.0allNamed standard requests answered in one call, each as it would be alone. An item takes the batch's model and may repeat it. A systemone/0.2 target has no batch endpoint, so a batch is split into single requests.
POST /v1/decisions5.0allThe body of POST /v1/systemone, answered with a failed question's error, reason and message in its own answer of a 200, instead of failing the request.
GET /health5.0allReadiness, with the extension set version the server answers with.

Removed forms​

The model runtime contract 4.0.0 accepted these forms; the standard expresses them, so 5.0 answers them with 400 naming the replacement.

FormLevelReplaced byNote
choicesquestioncriteriaAn object of option keys to descriptions, for choice and noul.
levelsquestioncriteriaAn ordered array of level descriptions, for score.
labelsquestioncriteriaAn object of labels to descriptions, for set and span.
imagesrequestassetsAssets of type image, placed by their placeholders.
videosrequestassetsAssets of type video.
statesrequestPOST /v1/systemone/batch/v1/systemone takes exactly one request.
long_contextoptionsTypeSafe-Danger-Zone-Long-Context: trueThe standard's request header.
errorerrordetailThe standard detail, with flat code, question, state, reason and limit.
datalistingmodels[].cardRouter mode keeps the OpenAI data list for Chat clients.
implicit rolesstaterolesState keys carry no meaning; roles names the parts.