Skip to content

JoshuaSP diffusiongemma (open-jev) vs Cloudflare clef

Cloudflare clef is more accurate on the Jev Decision Index, Cloudflare clef is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecJoshuaSP diffusiongemma (open-jev)Cloudflare clef
ProviderJoshuaSPCloudflare
Decision Index score47.353.1
Calibration error (ECE)0.2150.040
Median latency (p50)260 ms102 ms
Cost per 1,000 decisions——
Parameters26B28B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDiffusion LMDecoder LM with a decision readout
License—apache-2.0

FAQ

Is JoshuaSP diffusiongemma (open-jev) or Cloudflare clef more accurate?

Cloudflare clef scores higher on the Jev Decision Index (53.1 vs 47.3).

Which is better calibrated, JoshuaSP diffusiongemma (open-jev) or Cloudflare clef?

Cloudflare clef has the lower expected calibration error (0.040 vs 0.215), so its stated confidence is closer to how often it is right.

Is JoshuaSP diffusiongemma (open-jev) or Cloudflare clef cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.