Skip to content

open-jev (pngwn) vs amos-1-large

open-jev (pngwn) and amos-1-large have no measured difference in accuracy, calibration or cost in our data yet.

Specopen-jev (pngwn)amos-1-large
ProviderpngwnScira (mukaddamzaid)
Decision Index score32.1—
Calibration error (ECE)0.059—
Median latency (p50)112 ms—
Cost per 1,000 decisions——
Parameters5B—
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licensecc-by-nc-4.0apache-2.0

FAQ

Is open-jev (pngwn) or amos-1-large more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, open-jev (pngwn) or amos-1-large?

No calibration difference between open-jev (pngwn) and amos-1-large is recorded yet.

Is open-jev (pngwn) or amos-1-large cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.