Skip to content

Cloudflare clef vs vLLM-SR Decision 2.0 Vega 27B

vLLM-SR Decision 2.0 Vega 27B is more accurate on the Jev Decision Index, Cloudflare clef is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecCloudflare clefvLLM-SR Decision 2.0 Vega 27B
ProviderCloudflarevLLM Semantic Router
Decision Index score53.155.9
Calibration error (ECE)0.0400.086
Median latency (p50)102 ms120 ms
Cost per 1,000 decisions——
Parameters28B28B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licenseapache-2.0apache-2.0

FAQ

Is Cloudflare clef or vLLM-SR Decision 2.0 Vega 27B more accurate?

vLLM-SR Decision 2.0 Vega 27B scores higher on the Jev Decision Index (55.9 vs 53.1).

Which is better calibrated, Cloudflare clef or vLLM-SR Decision 2.0 Vega 27B?

Cloudflare clef has the lower expected calibration error (0.040 vs 0.086), so its stated confidence is closer to how often it is right.

Is Cloudflare clef or vLLM-SR Decision 2.0 Vega 27B cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.