Skip to content

Matilda Jev v1.5 vs ScaleDown Classify-1

Matilda Jev v1.5 and ScaleDown Classify-1 have no measured difference in accuracy, calibration or cost in our data yet.

SpecMatilda Jev v1.5ScaleDown Classify-1
ProviderMaincodeScaleDown
Decision Index score59.2—
Calibration error (ECE)0.077—
Median latency (p50)89 ms—
Cost per 1,000 decisions—$0.0080
Parameters26B—
Open weightsYesNo
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutEncoder classifier
Licenseapache-2.0proprietary

FAQ

Is Matilda Jev v1.5 or ScaleDown Classify-1 more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Matilda Jev v1.5 or ScaleDown Classify-1?

No calibration difference between Matilda Jev v1.5 and ScaleDown Classify-1 is recorded yet.

Is Matilda Jev v1.5 or ScaleDown Classify-1 cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.