跳到主要内容

1 篇博文 含有标签「multimodal」

查看所有标签

Decision 3.0 on Apple Silicon: Text, Image and Video Decisions on a Mac

· 阅读需 6 分钟
Alex Weng
Fluid Inference

d3-lite sorts 1,000 sample pull requests into the vLLM-SR workgroups, on an M5 Pro. Right: GPU load and the per-PR log.

Decision 3.0 runs on a Mac.

Decision 3.0 brought text, image and video decisions to one open model family. We converted the three smaller sizes (d3-lite 0.8B, d3-nano 2B and d3-mini 4B) to Core ML and built demos for text, screenshots and live video.

A decision made on the Mac has no per-call cost and no network round trip, and the pull request, web page or video never leaves the machine. That fits alongside vLLM-SR: routine decisions can be answered on the device, and the ones that need a bigger model can go to the router.

Get the Core ML models → · Swift runtime → · Watch the demo on X →