Benchmarks and comparisons with decision models
Head-to-head studies and leaderboards that measure accuracy, calibration, latency and cost of decision models against LLMs or each other.
354 public projects · page 2 of 12
Live race labelling 1,000 app reviews with four typed Jev questions versus Gemini 3.8 Flash JSON output.
AppprototypeJavaScriptJev plays Chrome Dino and a local shooter arena from structured state, with speculative jump/duck questions and code-owned execution.
ProjectprototypePythonFlappy Arena races Jev against GPT-6 Luna on the same seeded Flappy Bird course, each choosing flap or wait live.
ProjectprototypeJavaScriptClassifies 1,000 arXiv AI papers into 24 topics with one Jev Choice each and checks agreement against an LLM judge.
ProjectprototypePythonJev-protocol-compatible random baseline server in Rust: answers noul, choice and score with fast pseudo-random numbers, as a mock or floor.
ProjectprototypeRustWeb Snake autoplay where each move is a System One Choice from Jev or wire-compatible Drex, with a side-by-side compare mode.
ProjectprototypeTypeScriptBrowser table tennis against Jev, where every paddle position is a live Choice among pixel-labelled bands with no local prediction.
ProjectprototypePythonTrade Arena proof of concept comparing trading strategies on 13 US stock funds, grown out of a pre-registered Jev study.
ProjectprototypePythonBrowser arena where local Laya and hosted Jev race in Snake and fight in a Mortal-Kombat-style game, with every move a real decision.
ServiceprototypePythonChrome T-Rex game where local Laya on MLX and hosted Jev choose moves side by side, with latency charts and crash replays.
ServiceprototypePythonExperimental Conway's Life game where Jev makes each move with one boolean per legal cell, plus a broker that wraps any LLM as Jev.
ProjectprototypeTypeScriptJev-compatible open System One engine with a Claude Code-style terminal REPL showing live probabilities, plus an experiment harness.
ProjectprototypePythonBrowser Pac-Man race comparing hosted Jev and self-hosted Laya choosing routes from the same board state, after code removes fatal routes.
ServiceprototypeJavaScriptNovelty demo that turns Jev answers to 22 Boolean gate questions into lookup tables for a simulated RISC-V CPU running compiled C.
ProjectprototypeHackathon arena where 200 people attack a support agent and a Jev allow/block/escalate gate on every tool call is hardened each round.
ProjectprototypePythonBrowser arcade games (2048, runner, chess, Flappy Bird, Sudoku) where small decision models choose each move from text options.
ProjectprototypePythonBrowser lane-racing demo where Jev, OpenAI Decisions and a local EmbeddingGemma model each choose a lane for the same obstacles.
ProjectprototypeJavaScriptPortuguese workshop: a LangGraph sales agent where each decision step can be made by Jev or a frontier LLM and measured side by side.
ProjectprototypePythonBenchmark testing whether Jev or open Kev can replace an LLM judge in agent guardrail callbacks on 7,925 public examples.
ProjectresearchPython33-chapter Chinese tutorial on agentic RL and GRPO, including a chapter on when Jev-style external decision models beat training with RL.
ProjectresearchPythonStudy of Jev's choices in multi-armed bandits, testing whether Bayesian instructions and supplied statistics improve its exploration.
ProjectresearchExperiments testing whether Jev can spot positive-expected-value dice bets from payout tables, and whether recent wins or losses sway it.
ProjectresearchDeterministic evidence selector for noisy Codex investigations; its earlier Jev subagent router is kept for the record, not recommended.
ProjectresearchPre-registered field test of Jev, GLiNER2.5-Decide, Laya and other decision models against small LLMs on fresh September 2026 data.
ProjectresearchPythonExperiment using Jev Noul judgments on accumulated evidence to decide when Zilliz's DeepSearcher agent should stop searching.
ProjectresearchPythonGoodWatch movie and TV recommendation monorepo, listed for an experiment comparing Jev question designs for attribute scoring.
ProjectresearchTypeScriptBilingual research report on what Jev is, how its claims compare with independent evidence, and the open-source alternatives.
ProjectresearchZero-shot run of Jev 1.13 on all seven LexGLUE legal tasks (23,607 examples) versus GPT-5.6 Luna, open models and fine-tuned BERT.
ProjectresearchPythonSix recorded chess experiments with Jev via OpenRouter, candidly showing that unaided Jev still blunders pieces.
ProjectresearchPythonPre-specified study running Jev and GPT-4.1 as 300 synthetic survey respondents; question format mattered more than model.
ProjectresearchPython