Skip to content

Baseten: Mammoth 1 (free) vs mini-jev

Baseten: Mammoth 1 (free) and mini-jev have no measured difference in accuracy, calibration or cost in our data yet.

SpecBaseten: Mammoth 1 (free)mini-jev
ProviderBasetenr-ms
Decision Index score—22.8
Calibration error (ECE)—0.346
Median latency (p50)—67 ms
Cost per 1,000 decisionsFree—
Parameters—4B
Open weights—Yes
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Decoder LM with a decision readout
License——

FAQ

Is Baseten: Mammoth 1 (free) or mini-jev more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Mammoth 1 (free) or mini-jev?

No calibration difference between Baseten: Mammoth 1 (free) and mini-jev is recorded yet.

Is Baseten: Mammoth 1 (free) or mini-jev cheaper per 1,000 decisions?

A hosted price is not recorded for both models; open-weight models cost the compute you run them on.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.