Skip to content

amos-1-medium vs Hopper 12B (trained)

amos-1-medium and Hopper 12B (trained) have no measured difference in accuracy, calibration or cost in our data yet.

Specamos-1-mediumHopper 12B (trained)
ProviderScira (mukaddamzaid)HopitAI
Decision Index score—47.3
Calibration error (ECE)—0.076
Median latency (p50)—290 ms
Cost per 1,000 decisions——
Parameters—12B
Open weightsYesYes
Question typesChoice (one of N options), Score (ordered rubric), Yes / noChoice (one of N options), Score (ordered rubric), Yes / no
MechanismDecoder LM with a decision readoutDecoder LM with a decision readout
Licenseapache-2.0research-and-demo

FAQ

Is amos-1-medium or Hopper 12B (trained) more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, amos-1-medium or Hopper 12B (trained)?

No calibration difference between amos-1-medium and Hopper 12B (trained) is recorded yet.

Is amos-1-medium or Hopper 12B (trained) cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.