Skip to main content
Version: Latest (main)

vela3-turbo

Vela 3.0 on d3-turbo, the largest Vela: it answers each request on d3-turbo's state-once path, then asks the router questions again with their adapters on.

PropertyValue
Repositoryvllm-sr/vela3-turbo, pinned at ce95e6d9e10d
FamilyVela 3.0
Parameters27.6B loaded
BackboneQwen3.5 text
Base packagevllm-sr/d3-turbo at da17b5d0c860
Precision (--dtype auto)BF16 on a GPU, FP32 on a CPU
Weightsabout 55.3 GB at BF16, 110.5 GB at FP32
Device memory72 GiB or more
Readstext, image, video

Question types​

TypeAnswers
choiceYes
noulYes
scoreYes
setYes, asked as one noul per label
spanYes, on the router span head

Rules that read the request's images (input.image) or the current turn's videos (input.video) can resolve to it.

Built-in questions​

The Vela 3.0 family was trained on the Router's built-in questions, so the Router asks each one in its trained form; the support matrix lists which.

note

This model has no calibrated thresholds: a built-in question without a predicate uses 0.5, and the configuration load warns with uncalibrated_preset.

Hardware​

Each time it loads, the model compares its answers with the reference answers recorded for its revision. They are recorded for:

  • AMD GPU (ROCm) (rocm)

On a CPU or an NVIDIA GPU no reference is recorded, so the model serves there with its self-check reported as unverified.

Choose a model lists the validated hardware.

Quantization​

The runtime loads no quantized packages of the Vela 3.0 family: it runs at its published precision.

Deploy it​

Serve it on its own in Engine mode, to ask it directly:

vllm-sr serve vllm-sr/vela3-turbo --engine --platform rocm

Or make it the Router's decision model:

config.yaml
global:
model_catalog:
deployments:
primary:
provider: model_runtime
artifact: vllm-sr/vela3-turbo
device: auto
system:
decision_model: {deployment: primary}

device: auto takes the first validated GPU with enough free memory, else the CPU; name rocm:0 or cuda:0 to pin a GPU.

To run it on another host and attach the Router to it:

vllm-srun serve vllm-sr/vela3-turbo --device auto --host 0.0.0.0 --port 8100

Then set endpoint: http://<host>:8100 and model: vela3-turbo on the deployment; see Attach to a runtime you run.

Learn more​