Skip to content

decisio v0.8.0 on gemma-4-12B-it vs Cloudflare clef-flash

decisio v0.8.0 on gemma-4-12B-it and Cloudflare clef-flash have no measured difference in accuracy, calibration or cost in our data yet.

Specdecisio v0.8.0 on gemma-4-12B-itCloudflare clef-flash
ProvideraminryCloudflare
Decision Index score—47.6
Calibration error (ECE)—0.025
Median latency (p50)—53 ms
Cost per 1,000 decisions——
Parameters—10B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
License—apache-2.0

FAQ

Is decisio v0.8.0 on gemma-4-12B-it or Cloudflare clef-flash more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, decisio v0.8.0 on gemma-4-12B-it or Cloudflare clef-flash?

No calibration difference between decisio v0.8.0 on gemma-4-12B-it and Cloudflare clef-flash is recorded yet.

Is decisio v0.8.0 on gemma-4-12B-it or Cloudflare clef-flash cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.