Evaluation grading with decision models

Secure, persistent VM sandboxes for AI agents, with a PR-review example that compares a general model with Jev on candidate findings.

Checks whether each cited paper supports its citing sentence: code fetches papers, Claude proves a quote, Jev scores it, a human decides.

Agent observability platform that finds and fixes agent failures, with an optional Jev preclassifier for conversation checks.

Open-source Claude Cowork alternative built on OpenCode; per list notes, its eval testkit uses Jev as a verification judge.

Windows Codex hook that audits a conversation's recorded execution with Jev and answers yes/no questions like 'Did the tests pass?'.

Agent skills for placing, building, evaluating and improving decision-model systems, with Jev as the default hosted example.

Recursive language model layer for coding agents that keeps inputs in a local evaluator, with optional Jev judge_many for typed calls.

Claude Code plugin and CLI for the Jev funnel: judge items in bulk, settle confident ones in code, send only uncertain ones onward.

Unofficial Claude Code plugin that checks 'done' claims and small judgment calls with Jev, logs receipts, and can warn on unverified stops.

Evaluation suite for decision models with 23,900 pinned rows across nine task families and three primitives, plus a leaderboard.

DeepSeek Harness plugin adding a jev_evaluate tool for mixed Noul, Choice and Score evaluation of text or JSON.

Decision plugin for agent harnesses where Jev recommends tools, skills or owners and scores output, for DeepSeek Harness and iPolloWork.

Node/Bun CLI for asking Jev boolean, choice and score questions over text or JSON, with direct or Vercel AI Gateway providers.

Unix-style tools where Jev learns a repo's decision norms and judges each node of a code lead as a bug, lead or clean.

TypeScript library adding policy, confidence gates, shadow mode, recipes and an eval CLI around Jev answers.

Eval-first MCP server for Jev: prototype questions, map them over many items, and measure accuracy and thresholds on labelled data.

MCP server exposing Jev as one evaluate tool, plus a harness comparing Jev's judgments with general LLMs on shared datasets.

Claude Code and Codex skills plus a study course for building with Jev, including Jevaluate, which rates how well projects use Jev.

CLI where several coding agents draft implementation plans and Jev scores them, decides on cross-review and picks the finaliser.

Optimises the instructions and criterion descriptions of a Jev Choice from labelled data with EvoPrompt or GEPA, scored by Brier.

Analytics engine that rates published posts on pre-registered rubrics with Jev and tests ratings against real engagement.

CLI that grades the coding-agent sessions on your disk (Claude Code, Codex, opencode, Gemini CLI) with Jev for cents.

Open-source BYOK arena where Jev faces another model as a judge on your question, with blind voting before costs are revealed.

pytest-style tool that pins fixtures and expected Jev answers, then fails a model upgrade when answers flip or confidence drops.

Claude Code plugin that logs your prompts locally and later has Jev score how well you prompt the coding agent over time.

Skill and plugin for Codex, Claude Code and other agents that helps them use Jev for bounded judgments and measure the effect.

Semantic test matchers for Vitest and Jest that ask Jev whether output satisfies a plain-English expectation and threshold the probability.

sort where the key is a description: Jev judges pairs of texts and a Bradley-Terry fit turns them into a scored ranking.

Community MCP server giving Codex, Claude and other clients two tools for typed Jev decisions: evaluate and classify.

Oh My Pi skill for method-first bulk classification: decide when to use Jev, then pilot and freeze a rubric for judge_batch.