Skip to content

decisio 0.6.0 (Gemma 4 31B) vs Cloudflare clef

decisio 0.6.0 (Gemma 4 31B) is more accurate on the Jev Decision Index, Cloudflare clef is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

Specdecisio 0.6.0 (Gemma 4 31B)Cloudflare clef
ProvideraminryCloudflare
Decision Index score58.553.1
Calibration error (ECE)0.1420.040
Median latency (p50)54 ms102 ms
Cost per 1,000 decisions——
Parameters31B28B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
License—apache-2.0

FAQ

Is decisio 0.6.0 (Gemma 4 31B) or Cloudflare clef more accurate?

decisio 0.6.0 (Gemma 4 31B) scores higher on the Jev Decision Index (58.5 vs 53.1).

Which is better calibrated, decisio 0.6.0 (Gemma 4 31B) or Cloudflare clef?

Cloudflare clef has the lower expected calibration error (0.040 vs 0.142), so its stated confidence is closer to how often it is right.

Is decisio 0.6.0 (Gemma 4 31B) or Cloudflare clef cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.