SWE-bench Multilingual Leaderboard
coding13 models · Updated October 2026
On the SWE-bench Multilingual benchmark, Gemini 3 Flash ranks #1 with a score of 72.7, while DeepSeek: DeepSeek V3.2 offers the best score-per-dollar at $0.80/1M output tokens. The full ranking, with cost per million tokens, is below.
💰 Best value
DeepSeek: DeepSeek V3.2 — score 59.0 at $0.80/1M output tokens
| # | Model | Score | Output / 1M | Context |
|---|---|---|---|---|
| 1 | Gemini 3 FlashOpenCode | 72.7 | $3.00 | 1M |
| 2 | Anthropic: Claude Opus 4.6Anthropic | 72.0 | $25.00 | 1M |
| 3 | Anthropic: Claude Opus 4.5Anthropic | 70.7 | $25.00 | 200K |
| 4 | Z.ai: GLM 5Z.ai | 69.7 | $1.92 | 205K |
| 5 | Gemini 3 ProGoogle DeepMind | 68.7 | — | — |
| 6 | MiniMax 2.5Regolo AI | 68.3 | $3.50 | 190K |
| 7 | MoonshotAI: Kimi K2.5MoonshotAI | 67.3 | $2.50 | 262K |
| 8 | Anthropic: Claude Sonnet 4.5Anthropic | 67.0 | $15.00 | 1M |
| 9 | OpenAI: GPT-5.2OpenAI | 66.7 | $14.00 | 400K |
| 10 | OpenAI: GPT-5.2-CodexOpenAI | 66.3 | $14.00 | 400K |
| 11 | Anthropic: Claude Haiku 4.5Anthropic | 64.7 | $5.00 | 200K |
| 12 | DeepSeek: DeepSeek V3.2DeepSeek | 59.0 | $0.80 | 164K |
| 13 | OpenAI: GPT-5 MiniOpenAI | 39.7 | $2.00 | 400K |
What does SWE-bench Multilingual test?
Evaluation framework with 2,294 real GitHub software-engineering problems.
Frequently asked questions
Pricing is indicative — confirm with the provider before production use. Updated October 2026.