Skip to content

vLLM-SR d3-lite (0.8B) vs GLiNER2.5-Decide

vLLM-SR d3-lite (0.8B) is more accurate on the Jev Decision Index, GLiNER2.5-Decide is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecvLLM-SR d3-lite (0.8B)GLiNER2.5-Decide
ProvidervLLM Semantic RouterFastino
Decision Index score26.210.1
Calibration error (ECE)0.0940.088
Median latency (p50)37 ms23 ms
Cost per 1,000 decisions——
Parameters853M486M
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no, Extraction (typed spans)
MechanismDecoder LM with a decision readoutSpan encoder (GLiNER family)
Licenseapache-2.0apache-2.0

FAQ

Is vLLM-SR d3-lite (0.8B) or GLiNER2.5-Decide more accurate?

vLLM-SR d3-lite (0.8B) scores higher on the Jev Decision Index (26.2 vs 10.1).

Which is better calibrated, vLLM-SR d3-lite (0.8B) or GLiNER2.5-Decide?

GLiNER2.5-Decide has the lower expected calibration error (0.088 vs 0.094), so its stated confidence is closer to how often it is right.

Is vLLM-SR d3-lite (0.8B) or GLiNER2.5-Decide cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.