Skip to content

Matilda Jev v1.5 vs Cloudflare clef

Matilda Jev v1.5 is more accurate on the Jev Decision Index, Cloudflare clef is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecMatilda Jev v1.5Cloudflare clef
ProviderMaincodeCloudflare
Decision Index score59.253.1
Calibration error (ECE)0.0770.040
Median latency (p50)89 ms102 ms
Cost per 1,000 decisions——
Parameters26B28B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licenseapache-2.0apache-2.0

FAQ

Is Matilda Jev v1.5 or Cloudflare clef more accurate?

Matilda Jev v1.5 scores higher on the Jev Decision Index (59.2 vs 53.1).

Which is better calibrated, Matilda Jev v1.5 or Cloudflare clef?

Cloudflare clef has the lower expected calibration error (0.040 vs 0.077), so its stated confidence is closer to how often it is right.

Is Matilda Jev v1.5 or Cloudflare clef cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.