Skip to content

Jev-Style 2B v3 vs Cloudflare clef-flash

Cloudflare clef-flash is more accurate on the Jev Decision Index, Cloudflare clef-flash is better calibrated. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecJev-Style 2B v3Cloudflare clef-flash
ProviderchaoliangUNSWCloudflare
Decision Index score31.447.6
Calibration error (ECE)0.1180.025
Median latency (p50)70 ms53 ms
Cost per 1,000 decisions——
Parameters2B10B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licenseapache-2.0apache-2.0

FAQ

Is Jev-Style 2B v3 or Cloudflare clef-flash more accurate?

Cloudflare clef-flash scores higher on the Jev Decision Index (47.6 vs 31.4).

Which is better calibrated, Jev-Style 2B v3 or Cloudflare clef-flash?

Cloudflare clef-flash has the lower expected calibration error (0.025 vs 0.118), so its stated confidence is closer to how often it is right.

Is Jev-Style 2B v3 or Cloudflare clef-flash cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.