Skip to content

Benchmarks and comparisons with decision models

Head-to-head studies and leaderboards that measure accuracy, calibration, latency and cost of decision models against LLMs or each other.

354 public projects · page 6 of 12

  • WebGL card game Speed against a Jev-powered CPU, showing Jev's decision latency and accuracy against a rule validator in real time.

    AppprototypeJavaScript
  • MuJoCo Franka arm stacking cubes: code proposes and simulates small moves, Jev picks moves, grasp, release and completion, vs Claude.

    AppprototypePython
  • Browser playground: configure a pool of OpenRouter models, let Jev pick one for a task, then judge whether its pick was right.

    AppprototypeJavaScript
  • Self-hosted playground running SystemOne requests through an emulator, Jev and an LLM judge to compare per-question fidelity.

    AppprototypePython
  • Deterministic 3D restaurant simulator that replays the same evening to compare rule-based, camera-assisted and Jev-planned waiters.

    DemoprototypeTypeScript
  • Chinese 'emotion lie detector' demo comparing Jev's Choice, Score and Noul judgments on a message with a general LLM.

    CLIprototypePython
  • Terminal Sudoku where Python owns the rules and Jev picks one move per turn, solving easy boards but struggling once it must guess.

    DemoprototypePython
  • Bulgarian blog categoriser comparing Jev and local Laya on 50 posts, with a small local LLM naming new topics.

    AppprototypePython
  • Toy local Jev-shaped decision API on a 0.5B model that answers yes/no, choice and score questions by scoring option tokens.

    ServiceprototypePython
  • Local natural-language task workspace where Jev, OpenAI or Gemini turn requests into view and task changes, with speed and cost comparisons.

    AppprototypeTypeScript
  • Experiment testing whether Jev knows music theory via SATB part-writing and quizzes vs Claude, plus a Jev-driven Rhodes piano demo.

    AppresearchJavaScript
  • Small experiment: reordering enum options changed a local Jev clone's answers on its old default, while hosted Jev's did not.

    DemoresearchPython
  • Experiment screening ADHD review abstracts as include or exclude with Jev, scored against Cohen et al. 2006 abstract triage labels.

    AppresearchPython
  • Measurement-first lab deciding which classifier technique, Jev, rules or other models, earns a place in a coding-agent fleet.

    Appresearch
  • Experimental Jev wire-compatible engine that claims to produce typed decisions from Mandelbrot fractal dynamics rather than a trained model.

    ServiceresearchPython
  • Perplexity's Apache-2.0 multimodal decision model on Qwen3.8-27B, reporting 61.56 on the Decision Index versus 57.9 for Jev.

    ServiceproductionPython
  • JevK5★ 150

    Apache-2.0 open-weight Jev alternative that answers yes/no, choice and score questions with per-option probabilities in one pass.

    LibrarybetaPython
  • 50 small interactive demos comparing Jev's Choice, Score and Noul with OpenAI gpt-4o-mini side by side, runnable offline from fixtures.

    ModelbetaJavaScript
  • Small open vision-language decision models (2B, 4B, 9B) that answer typed questions about photos and records with a trained can't-tell.

    ModelbetaPython
  • Small open decision models (0.8B and 4B, from Qwen3.5) with a server that speaks Jev's /v1/systemone format in one forward pass.

    ServicebetaPython
  • Open System One decision model (LoRA on Qwen3.5-4B) that reads typed answers from logits in one pass, with its benchmark harness.

    ModelbetaPython
  • Video demo classifying 50 mock YouTube comments with Jev (intent, value, video idea) and comparing speed and cost with GPT-4o-mini.

    ModelprototypePython
  • Serves MiniCPM5-2B-8bit on Apple Silicon as a Jev-compatible /v1/systemone service and reproduces its JevBench score.

    ModelprototypePython
  • Bring-your-own-key wrapper that exposes Upstage Solar Pro4 or Mini4 behind Jev's /v1/systemone shape, with a comparison benchmark.

    LibraryprototypePython
  • NanoJev★ 2,543

    0.6B open Jev replica returning full option distributions with no decoding; one checkpoint plays ViZDoom, Maze and Snake.

    ModelresearchPython
  • reflex★ 166

    Small open decision model on a frozen Qwen3.5-4B serving /v1/systemone in about 200 ms, benchmarked against Jev on JevBench.

    ServiceresearchPython
  • mini-jev★ 59

    Preregistered study: reading a frozen Qwen3-4B's option-letter logits matches grammar-constrained JSON accuracy, and runs faster.

    ModelresearchPython
  • Open Apache-2.0 Jev-like model family on Qwen3.8-27B that reads one-token candidate preferences and serves a TypeSafe-compatible API.

    ServiceresearchPython
  • Recipe that answers JevBench typed decisions with frozen Gemma-4-12B-it on stock vLLM by reading one option-letter token's probability.

    ModelresearchPython
  • InternLM's open multimodal decision models (0.8B-4B) trained on Qwen3.5, with calibration tooling and a 96-case calibration benchmark.

    ModelresearchPython