Benchmarks and comparisons with decision models

Recorded benchmark of Jev versus two frontier LLMs on 100 synthetic security-triage cases, with a static dashboard.

Study finding commercial decision models including Jev give different yes/no probabilities on Taiwan statements by Chinese script.

Tic-tac-toe teaching project comparing Jev Choice, Score and Noul designs across three levels of state detail.

Static charts comparing Jev with 110 other models on Thai standardized exams for accuracy, cost, speed and calibration.

Backtest harness that tests Jev as a BUY/SELL/HOLD trader on NQ level-10 order-book data, with replay, viewer and paper-trading modes.

Lightweight reproduction of the Jev shape on a ModernBERT encoder and a diffusion LLM, comparing speed, accuracy, calibration and cost.

Short evaluation finding that Jev plays chess poorly, often calling unbalanced positions draws.

Local app testing Jev as a chess decision-maker against Stockfish, with Stockfish grading every pick.

Reproducible experiments and reports on what Jev can and cannot do, from skill routing to GPQA and housing prices.

Japanese research deck, article and source ledger tracking TypeSafe's Jev and System One models over time.

TypeSafe's official drop-in replacement for the SDK's system_one call backed by OpenAI, Anthropic or Gemini, for comparing Jev with LLMs.

Official TypeSafe code to reproduce evals.typesafe.ai: four workflow evals comparing Jev with frontier LLMs on cost and accuracy.

Local-first knowledge search with BM25 shortlisting and Jev Noul reranking by default, seven selectable pipelines and cited answers.

Bun harness that runs Jev over datasets via OpenRouter, streams JSONL answers, and checks calibration, stability and regressions.

Grounded extraction where code proposes spans with exact offsets and Jev only classifies each one; a LangExtract alternative.

C# System One client and benchmark comparing Microsoft-Decision-1, Jev and open-jev on the same labelled support tickets.

RuneBench fork where Jev plays RuneScape by choosing from about 50 bounded rs-sdk actions and per-tick interventions.

Playground comparing generative UI via an LLM writing json-render specs with Jev choosing and arranging prepared components.

Calibration experiments showing Jev's Choice probabilities on fair dice and coins stay high while accuracy stays at chance.

Rust client, CLI, terminal UI and eval harness for asking System One questions of a local model served on Xeon Phi cards.

Reproducible bake-off of Playwright CLI alone, CLI plus Jev, and Playwright MCP on fuzzy browser goals, with honest results.

Interactive teaching site where Jev races frontier LLMs in games, an arena, a sandbox and quizzes, with a keyless replay mode.

Next.js site with six live Jev demos, each compared side by side with Gemini or Claude on latency, cost and agreement.

Workbench that turns OpenAI chat requests into Jev state and questions, compares both outputs, and publishes question sets as proxy routes.

Reliability testing for typed decision models: contracts, calibration metrics, metamorphic fuzzing and CI pass/warn/fail gates.

Browser agent that acts on one look at the page with one open-model call per action; Jev is an optional chooser backend.

Fixed-wing landing simulator and benchmark where Jev maps four Choice decisions to aircraft controls against humans, baselines and LLMs.

Small demo collection testing Jev's spatial reasoning with maze single-step choices versus multi-step lookahead.

Japanese demo judging the same utterance with Jev and an LLM to compare emotion-shift outputs and speed side by side.

Local single-page playground for Jev with templates from 37 benchmark datasets, showing gold answers next to typed results.