Baseten: Mammoth 1 (free) vs Hopper (G) 1.2
Baseten: Mammoth 1 (free) and Hopper (G) 1.2 have no measured difference in accuracy, calibration or cost in our data yet.
| Spec | Baseten: Mammoth 1 (free) | Hopper (G) 1.2 |
|---|---|---|
| Provider | Baseten | HopitAI |
| Decision Index score | — | 40.2 |
| Calibration error (ECE) | — | 0.093 |
| Median latency (p50) | — | 23 ms |
| Cost per 1,000 decisions | Free | — |
| Parameters | — | 5B |
| Open weights | — | Yes |
| Question types | — | Choice (one of N options), Score (ordered rubric), Yes / no |
| Mechanism | — | Decoder LM with a decision readout |
| License | — | research-and-demo |
FAQ
Is Baseten: Mammoth 1 (free) or Hopper (G) 1.2 more accurate?
At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.
Which is better calibrated, Baseten: Mammoth 1 (free) or Hopper (G) 1.2?
No calibration difference between Baseten: Mammoth 1 (free) and Hopper (G) 1.2 is recorded yet.
Is Baseten: Mammoth 1 (free) or Hopper (G) 1.2 cheaper per 1,000 decisions?
A hosted price is not recorded for both models; open-weight models cost the compute you run them on.
Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.