GLiNER2.5-Decide vs mmastrac diffusiongemma (vLLM PR 57250)
mmastrac diffusiongemma (vLLM PR 57250) is more accurate on the Jev Decision Index, GLiNER2.5-Decide is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.
| Spec | GLiNER2.5-Decide | mmastrac diffusiongemma (vLLM PR 57250) |
|---|---|---|
| Provider | Fastino | mmastrac |
| Decision Index score | 10.1 | 34.3 |
| Calibration error (ECE) | 0.088 | 0.202 |
| Median latency (p50) | 23 ms | 127 ms |
| Cost per 1,000 decisions | — | — |
| Parameters | 486M | 26B |
| Open weights | Yes | Yes |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no, Extraction (typed spans) | Choice (one of N options), Score (ordered rubric), Yes / no |
| Mechanism | Span encoder (GLiNER family) | Diffusion LM |
| License | apache-2.0 | — |
FAQ
Is GLiNER2.5-Decide or mmastrac diffusiongemma (vLLM PR 57250) more accurate?
mmastrac diffusiongemma (vLLM PR 57250) scores higher on the Jev Decision Index (34.3 vs 10.1).
Which is better calibrated, GLiNER2.5-Decide or mmastrac diffusiongemma (vLLM PR 57250)?
GLiNER2.5-Decide has the lower expected calibration error (0.088 vs 0.202), so its stated confidence is closer to how often it is right.
Is GLiNER2.5-Decide or mmastrac diffusiongemma (vLLM PR 57250) cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.