All decision model projects

Independent evaluation of Jev on MetaTool, When2Call and BFCL V4 tool selection, abstention and tool-use decisions.

1,000-decision benchmark of Jev 1.13 across 25 deterministic reasoning families, showing where it excels and where it fails.

Reproducible benchmark comparing Jev with hosted and open decision models on rule application, probabilities, latency and cost.

Reproducible 2,976-request measurement of whether batching questions in one Jev call bills the state once and keeps answers stable.

100-question benchmark placing Jev's reasoning at 77% against small Qwen3.5 models under different thinking budgets.

Benchmark asking Jev to pick the winner of 10,984 real Upworthy headline A/B tests: 64.5% overall, 74.7% when decisive.

100-question-per-cell check of Jev on Korean versus English reading, paraphrase and medical exams, with recorded responses.

Awesome-style map of Jev resources plus independent, reproducible benchmarks of primitives, confidence gating and fan-out latency.

Local benchmark comparing Jev with Laya-MLX on classifying GitHub issues for beginner-friendliness, CV fit and difficulty.

Speed and accuracy benchmark of hosted Jev 1.13 versus local Laya 421M on 1,470 synthetic items across eight decision tasks.

Pre-registered benchmark of Jev as a medical hallucination check on MedHallu, versus fast LLMs, on accuracy, latency and cost.

Jev-style medical QA on Qwen3.5-4B that picks the answer option in one forward pass instead of generating text.

Reproducible benchmark of Jev on Brazil's ENEM 2025 exam, measuring accuracy and calibration with an abstain option against open LLMs.

Unofficial study reproducing Jev-style parallel typed decisions on small stock models on an Apple Silicon laptop, with benchmarks.

Independent test of whether Jev's probabilities stay calibrated on 900 unseen rule-generated tickets plus three public benchmarks.

Measures whether SQL ORDER BY over Jev probabilities gives a defensible ranking: inversions, ordinality, calibration, wording and ties.

Benchmarks Jev against local open decision models on 480 general Persian questions, literary questions and a classical poetry pilot.

Reproducible Turkish RAG benchmark comparing Jev batch-Noul reranking with Cohere Rerank on quality, latency and cost.

Reproducible Chinese RAG reranking benchmark for Jev on T2Reranking with hard negatives, staged and cost-capped, logs published.

Benchmark for agent regression after config edits: a Jev Choice decides which approved answers changed meaning versus wording.

Reproducible evaluation of Jev 1.13 as a reward model, LLM judge and process verifier across eight benchmark tracks.

Jev as an LLM router on RouterArena and LLMRouterBench: the router beat the best single model, but a no-Jev ablation matched it.

Blind security benchmarks for Jev on public corpora: prompt-injection detection (96.5% with context) and vulnerable-code detection.

Benchmark of how well Jev spots real secret credentials in file snippets with a single Noul per case, plus latency analysis.

Exploratory study of zero-shot ham, spam and phishing email classification with Jev, compared with trained TF-IDF baselines.

Pre-registered benchmark where Jev makes every search and evidence decision for a 2B local model answering SimpleQA questions.

Benchmark asking Jev and a local LLM whether each collusion.wiki page was agent-written; neither beats the majority baseline.

Independent benchmark of Jev versus GPT-4.1-mini on 200 South African customer enquiries, showing how question wording changed results.

Benchmark of Jev versus rules, local PII models and LLMs at finding personal information: accuracy, leaks, cost and latency.

Open CC-BY-4.0 data behind jevals.com: leaderboards and per-decision logs grading Jev and LLMs on accuracy, calibration, cost and speed.