Skip to content

Benchmarks and comparisons with decision models

Head-to-head studies and leaderboards that measure accuracy, calibration, latency and cost of decision models against LLMs or each other.

354 public projects · page 2 of 12

  • Live race labelling 1,000 app reviews with four typed Jev questions versus Gemini 3.8 Flash JSON output.

    AppprototypeJavaScript
  • Jev plays Chrome Dino and a local shooter arena from structured state, with speculative jump/duck questions and code-owned execution.

    ProjectprototypePython
  • Flappy Arena races Jev against GPT-6 Luna on the same seeded Flappy Bird course, each choosing flap or wait live.

    ProjectprototypeJavaScript
  • Classifies 1,000 arXiv AI papers into 24 topics with one Jev Choice each and checks agreement against an LLM judge.

    ProjectprototypePython
  • Jev-protocol-compatible random baseline server in Rust: answers noul, choice and score with fast pseudo-random numbers, as a mock or floor.

    ProjectprototypeRust
  • Web Snake autoplay where each move is a System One Choice from Jev or wire-compatible Drex, with a side-by-side compare mode.

    ProjectprototypeTypeScript
  • Browser table tennis against Jev, where every paddle position is a live Choice among pixel-labelled bands with no local prediction.

    ProjectprototypePython
  • Trade Arena proof of concept comparing trading strategies on 13 US stock funds, grown out of a pre-registered Jev study.

    ProjectprototypePython
  • Browser arena where local Laya and hosted Jev race in Snake and fight in a Mortal-Kombat-style game, with every move a real decision.

    ServiceprototypePython
  • Chrome T-Rex game where local Laya on MLX and hosted Jev choose moves side by side, with latency charts and crash replays.

    ServiceprototypePython
  • Experimental Conway's Life game where Jev makes each move with one boolean per legal cell, plus a broker that wraps any LLM as Jev.

    ProjectprototypeTypeScript
  • Jev-compatible open System One engine with a Claude Code-style terminal REPL showing live probabilities, plus an experiment harness.

    ProjectprototypePython
  • Browser Pac-Man race comparing hosted Jev and self-hosted Laya choosing routes from the same board state, after code removes fatal routes.

    ServiceprototypeJavaScript
  • Novelty demo that turns Jev answers to 22 Boolean gate questions into lookup tables for a simulated RISC-V CPU running compiled C.

    Projectprototype
  • Hackathon arena where 200 people attack a support agent and a Jev allow/block/escalate gate on every tool call is hardened each round.

    ProjectprototypePython
  • Browser arcade games (2048, runner, chess, Flappy Bird, Sudoku) where small decision models choose each move from text options.

    ProjectprototypePython
  • Browser lane-racing demo where Jev, OpenAI Decisions and a local EmbeddingGemma model each choose a lane for the same obstacles.

    ProjectprototypeJavaScript
  • Portuguese workshop: a LangGraph sales agent where each decision step can be made by Jev or a frontier LLM and measured side by side.

    ProjectprototypePython
  • Benchmark testing whether Jev or open Kev can replace an LLM judge in agent guardrail callbacks on 7,925 public examples.

    ProjectresearchPython
  • 33-chapter Chinese tutorial on agentic RL and GRPO, including a chapter on when Jev-style external decision models beat training with RL.

    ProjectresearchPython
  • Study of Jev's choices in multi-armed bandits, testing whether Bayesian instructions and supplied statistics improve its exploration.

    Projectresearch
  • Experiments testing whether Jev can spot positive-expected-value dice bets from payout tables, and whether recent wins or losses sway it.

    Projectresearch
  • Deterministic evidence selector for noisy Codex investigations; its earlier Jev subagent router is kept for the record, not recommended.

    Projectresearch
  • Pre-registered field test of Jev, GLiNER2.5-Decide, Laya and other decision models against small LLMs on fresh September 2026 data.

    ProjectresearchPython
  • Experiment using Jev Noul judgments on accumulated evidence to decide when Zilliz's DeepSearcher agent should stop searching.

    ProjectresearchPython
  • GoodWatch movie and TV recommendation monorepo, listed for an experiment comparing Jev question designs for attribute scoring.

    ProjectresearchTypeScript
  • Bilingual research report on what Jev is, how its claims compare with independent evidence, and the open-source alternatives.

    Projectresearch
  • Zero-shot run of Jev 1.13 on all seven LexGLUE legal tasks (23,607 examples) versus GPT-5.6 Luna, open models and fine-tuned BERT.

    ProjectresearchPython
  • Six recorded chess experiments with Jev via OpenRouter, candidly showing that unaided Jev still blunders pieces.

    ProjectresearchPython
  • Pre-specified study running Jev and GPT-4.1 as 300 synthetic survey respondents; question format mattered more than model.

    ProjectresearchPython