Skip to content

vLLM-SR Decision 2.0 Eos 0.8B vs ScaleDown Classify-1

vLLM-SR Decision 2.0 Eos 0.8B and ScaleDown Classify-1 have no measured difference in accuracy, calibration or cost in our data yet.

SpecvLLM-SR Decision 2.0 Eos 0.8BScaleDown Classify-1
ProvidervLLM Semantic RouterScaleDown
Decision Index score17.5—
Calibration error (ECE)0.130—
Median latency (p50)25 ms—
Cost per 1,000 decisions—$0.0080
Parameters870M—
Open weightsYesNo
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutEncoder classifier
Licenseapache-2.0proprietary

FAQ

Is vLLM-SR Decision 2.0 Eos 0.8B or ScaleDown Classify-1 more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, vLLM-SR Decision 2.0 Eos 0.8B or ScaleDown Classify-1?

No calibration difference between vLLM-SR Decision 2.0 Eos 0.8B and ScaleDown Classify-1 is recorded yet.

Is vLLM-SR Decision 2.0 Eos 0.8B or ScaleDown Classify-1 cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.