Skip to content

Baseten: Mammoth 1 (free) vs Jobe

Baseten: Mammoth 1 (free) and Jobe have no measured difference in accuracy, calibration or cost in our data yet.

SpecBaseten: Mammoth 1 (free)Jobe
ProviderBasetenMantisShrimpdev
Decision Index score—30.4
Calibration error (ECE)—0.123
Median latency (p50)—54 ms
Cost per 1,000 decisionsFree—
Parameters—5B
Open weights—Yes
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Decoder LM with a decision readout
License——

FAQ

Is Baseten: Mammoth 1 (free) or Jobe more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Mammoth 1 (free) or Jobe?

No calibration difference between Baseten: Mammoth 1 (free) and Jobe is recorded yet.

Is Baseten: Mammoth 1 (free) or Jobe cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.