Benchmarks and comparisons with decision models

Browser-agent benchmark comparing WebMCP with screenshots, DOM and code execution, including a Jev + Mercury 2.5 configuration.

Independent benchmark asking whether Jev can replace an LLM reranker, on natural-language search over 6,245 YC companies, with a live demo.

Benchmark and web UI comparing dozens of zero-shot extraction and classification systems, including Jev-like engines.

First Chinese calibration benchmark for Jev-class models: accuracy, ECE, option order and script robustness.

Living index of real Jev use cases, repos, patterns and benchmarks, with every headline figure tagged self-reported or independent.

Evidence-aware map of 137 research items on Jev and typed probabilistic decisions, with evidence tiers and an interactive atlas.

Jev project list where each entry links to the line of code calling Jev, plus an independent 2,390-question test of vendor claims.

Datawhale's Chinese Jev course: notebooks on the three primitives, translated recipes, evaluation and local Laya fine-tuning.

Hugging Face Space indexing open reproductions of Jev and comparing them on a versioned decision benchmark with calibration metrics.

Experiment testing how well Jev predicts financial markets; the author reports it does not do well, like most LLMs.

Side-by-side comparison of Jev and DeepSeek-flash on speed, tokens, cost and accuracy for extraction, classification and reranking.

Microsoft's hosted decision model announcement, claiming top accuracy on 36 benchmarks and low latency versus GPT-6 Sol.

Retrospective test of Jev 1.13 classifying 8,054 Kepler Objects of Interest against hidden NASA Exoplanet Archive dispositions.

Blog benchmark testing Jev against Mistral Small and Gemini Flash-Lite at validating local event listings, with cost and latency.

Independent leaderboard grading Jev and six LLMs on the same typed questions against human labels, with open per-decision data.

Static benchmark dashboard comparing Jev with two OpenAI Luna settings on Japan's 2026 university Common Test.

LangWatch comparison of Jev against seven open models under 1B on 15 decision tasks, with intervals, latency and contamination checks.

Paper testing, without labels, whether Jev's probabilities obey probability axioms such as P(X) + P(not X) = 1.

Paper introducing an encoder-only System One model for Chinese with domain fine-tunes and the CJ-Bench benchmark.

Paper evaluating zero-shot Jev 1.13 on 37 datasets against Qwen and Gemma option probabilities, with code and raw responses released.

Paper testing Jev, Laya, Decider and Nimble against classifiers and LLM judges on prompt injection and risk screening.

Paper introducing an adversarial benchmark for decision models: one appended opinion flips 12.1% of Jev 1.13 decisions.

Paper auditing 28 early Jev papers and proposing a 14-item checklist for evaluating typed decision models.

Independent paper testing Jev's self-reported fields against ground truth, finding a collapsed verdict vocabulary and misleading flags.

TypeSafe's published eval methodology and per-model results for System One decision workflows.

Sayora write-up comparing Jev with production embeddings for picking the right website page to answer caller questions.

Blog review of a scheduler's pre-publish check where Jev answers four yes/no questions per social caption, compared with blind Fable labels.

Small browser game built to test how Jev handles unknown or unexpected input.

Independent early-access trial of Jev that measures its calibrated judgments and reports cost per decision.

LangChain post comparing Jev with LLM judges for agent evaluation on accuracy, repeatability, latency and cost.