Benchmarks and comparisons with decision models

OpenRouter benchmark of Jev 1.13 vs Claude Opus 5 on Banking77: 81.0% vs 84.4% accuracy at a fraction of the latency and cost.

Study comparing one direct Jev question per row with 12–14 Jev-scored dimensions and fitted weights on three classification tasks.

SREGym blog post on Kubernetes incident diagnosis with no LLM agent: Jev picks a root cause from collected evidence.

Blog post testing Jev in 16,000 calls against two OpenAI models, covering where it wins, where it breaks and how to set thresholds.

Independent evaluation by Senko Rasic comparing Jev zero-shot on Croatian text against a self-fine-tuned BERT.

Research note testing whether Jev's typed answers can be manipulated by prompt injection, across 14,495 logged calls with raw logs.

Classmethod DevelopersIO independent test of Jev for LLM model routing, reporting 40 successful calls and 10 of 10 correct classifications.

Head-to-head eval page where TrustedRouter's gev-1.0 outperforms Jev on the same JevBench questions and also accepts images.

Halv blog post reporting a 57.1% agent cost reduction from putting Jev in the agent loop on SWE-rebench Astra pairs.

Japanese Zenn article by mizchi pitting Jev against itself at gomoku, with source code and timing logs.

Anthony Maio's Substack essay on what a model that cannot generate text is for, with a critical look at Jev's claims.

Independent benchmark of Jev versus four LLMs on Banking77 routing and prompt injection, plus a gated cascade.

James Cruce's write-up on choosing local LAYA over hosted Jev: the 421M open model beat a home-made router on a frozen replay.

X article by @juanmacias testing Jev on a legal corpus, listed as the 9th independent evaluation.

Hacker News thread on Decision Index 0.2.1, which compared about 70 open reproductions of Jev's decision model.

Reddit post benchmarking Jev against generative LLMs, a BERT classifier and LAYA on the same task.

An X post comparing Jev with a private fine-tuned classifier at matched precision.

X post by a WebMCP benchmark author reporting Jev plus a small LLM solved 100% of tasks at about 112x lower model cost.

X post reporting a measured catalog-search run where Jev reranking alone did not beat vector retrieval.

Video post on X comparing Jev with a structured-output Qwen baseline running on Cerebras.

X post contrasting a 706K-parameter model filling a form in one 50 ms pass with an LLM agent needing 23 turns and 39.6 s.

X post claiming Playwright CLI with Jev choosing each step was 98% cheaper and twice as fast as the Playwright MCP.

X post comparing Jev with a hand-built regex on 544 Spanish data-protection resolutions: 98.2% agreement for about five cents.

Vals AI's independent benchmark of Jev: matched a frontier model on claim verification at a fraction of cost, but ranked last on LegalBench.