JoshuaSP diffusiongemma (open-jev) vs ScaleDown Classify-1
JoshuaSP diffusiongemma (open-jev) and ScaleDown Classify-1 have no measured difference in accuracy, calibration or cost in our data yet.
| Spec | JoshuaSP diffusiongemma (open-jev) | ScaleDown Classify-1 |
|---|---|---|
| Provider | JoshuaSP | ScaleDown |
| Decision Index score | 47.3 | — |
| Calibration error (ECE) | 0.215 | — |
| Median latency (p50) | 260 ms | — |
| Cost per 1,000 decisions | — | $0.0080 |
| Parameters | 26B | — |
| Open weights | Yes | No |
| Question types | Choice (one of N options), Score (ordered rubric), Yes / no | Choice (one of N options), Score (ordered rubric), Yes / no |
| Mechanism | Diffusion LM | Encoder classifier |
| License | — | proprietary |
FAQ
Is JoshuaSP diffusiongemma (open-jev) or ScaleDown Classify-1 more accurate?
At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.
Which is better calibrated, JoshuaSP diffusiongemma (open-jev) or ScaleDown Classify-1?
No calibration difference between JoshuaSP diffusiongemma (open-jev) and ScaleDown Classify-1 is recorded yet.
Is JoshuaSP diffusiongemma (open-jev) or ScaleDown Classify-1 cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.