Skip to content

Baseten: Mammoth 1 (free) vs Vansa-3.4

Baseten: Mammoth 1 (free) is cheaper per 1,000 decisions. Choose on whichever of accuracy, calibration and cost matters most for your decisions.

SpecBaseten: Mammoth 1 (free)Vansa-3.4
ProviderBasetenVansa
Decision Index score——
Calibration error (ECE)——
Median latency (p50)——
Cost per 1,000 decisionsFree$0.0068
Parameters——
Open weights—No
Question types—Choice (one of N options), Score (ordered rubric), Yes / no
Mechanism—Hosted API
License—proprietary

FAQ

Is Baseten: Mammoth 1 (free) or Vansa-3.4 more accurate?

At least one of the two has no Jev Decision Index score yet, so their accuracy cannot be compared here.

Which is better calibrated, Baseten: Mammoth 1 (free) or Vansa-3.4?

No calibration difference between Baseten: Mammoth 1 (free) and Vansa-3.4 is recorded yet.

Is Baseten: Mammoth 1 (free) or Vansa-3.4 cheaper per 1,000 decisions?

Baseten: Mammoth 1 (free) is cheaper: about Free vs $0.0068 per 1,000 decisions at 200 input tokens each.

Cost per 1,000 decisions assumes 200 input tokens per decision. Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.