mmastrac diffusiongemma (vLLM PR 57250) vs ScaleDown Classify-1
mmastrac diffusiongemma (vLLM PR 57250) and ScaleDown Classify-1 have no measured difference in accuracy, calibration or cost in our data yet.
| Spec | mmastrac diffusiongemma (vLLM PR 57250) | ScaleDown Classify-1 |
|---|---|---|
| Provider | mmastrac | ScaleDown |
| Decision Index score | 36.3 | — |
| Calibration error (ECE) | 0.202 | — |
| Median latency (p50) | 127 ms | — |
| Cost per 1,000 decisions | — | $0.0080 |
| Parameters | 26B | — |
| Open weights | Yes | No |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no | Choice (one of N options), Score (ordered rubric), Yes / no |
| Mechanism | Diffusion LM | Encoder classifier |
| License | — | proprietary |
FAQ
Is mmastrac diffusiongemma (vLLM PR 57250) or ScaleDown Classify-1 more accurate?
At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.
Which is better calibrated, mmastrac diffusiongemma (vLLM PR 57250) or ScaleDown Classify-1?
No calibration difference between mmastrac diffusiongemma (vLLM PR 57250) and ScaleDown Classify-1 is recorded yet.
Is mmastrac diffusiongemma (vLLM PR 57250) or ScaleDown Classify-1 cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.