Calibration and threshold setting with decision models
Measuring whether a model's probabilities can be trusted and picking per-question confidence thresholds, abstention rules and fallbacks.
236 public projects · page 5 of 8
Sutro's active-learning CLI that finds rows Jev is least sure about, asks you to label them, and uses GEPA to improve the definition.
CLIbetaPythonBun harness that runs Jev over datasets via OpenRouter, streams JSONL answers, and checks calibration, stability and regressions.
LibrarybetaTypeScriptTypeScript library of decision contracts, confidence thresholds, fallbacks, human review and evaluation patterns on top of the TypeSafe SDK.
LibrarybetaTypeScriptTypeScript library composing Jev judgments into deterministic threshold workflows that return explainable action sets.
LibrarybetaTypeScriptC++20 library for typed routing, classification and scoring with compile-time enum schemas, local Laya and optional System One.
LibrarybetaC++Rust crate and jud CLI where a decision is a .jud rubric file answered by a System One model, type-checked and testable without a key.
PluginbetaRustpijev: drop-in wrapper for the TypeSafe Python SDK that averages Jev answers across option orders in one request.
LibrarybetaPythonZero-dependency TypeScript wrapper for Jev where every typed decision has a required unsure branch the compiler enforces.
LibrarybetaTypeScriptSelf-hosted Go gateway for LLMs and decision models that prunes context, and audits and calibrates Jev or open-rlcd decisions.
ServicebetaGoRust derive layer that turns enums and structs into Choice, Score and Noul questions with compile-checked, confidence-gated answers.
LibrarybetaRustLocal Jev-compatible proxy that records an app's typed decisions, distils a head per decision site on Laya, and answers when confident.
ProxybetaPythonCommunity Rails integration for System One with configuration, persisted usage and cost telemetry, and fail-closed confidence policies.
LibrarybetaRubyCalculator with no arithmetic in its code: Jev picks each answer character from 13 options, exposing its distributions and jitter.
ServiceprototypeTypeScriptDeclarative compiler that turns state, decisions and labeled examples into a measured, frozen JSON program of typed Jev questions.
LibraryprototypePythonCalibration experiments showing Jev's Choice probabilities on fair dice and coins stay high while accuracy stays at chance.
LibraryresearchPythonLearning project that builds choose-an-answer decision models from scratch and from Qwen, with downloadable 0.8B and 4B releases.
LibraryresearchPython- Paper Radar★ 30
Daily arXiv and bioRxiv radar where Jev answers one yes/no per plain-English interest for every new paper; fork-and-go GitHub Action.
AppbetaPython Runnable Jev cookbooks, a plain-English guide and sixteen interactive simulations of how a typed decision model changes architecture.
AppbetaPython48-requirement spec and conformance suite for Jev-compatible servers, with a normalising proxy; shows confidence is not portable.
CLIbetaPythonPokémon Red on PyBoy where code owns route and arithmetic, Jev picks only at branches, and battle faint predictions are Brier-scored.
DemoprototypePythonReliability testing for typed decision models: contracts, calibration metrics, metamorphic fuzzing and CI pass/warn/fail gates.
DemoprototypePythonTwenty-questions game where Jev's confidence decides when to stop: it commits, hedges or refuses to guess.
DemoprototypeTypeScriptBrowser-only Jev testbed via Vercel AI Gateway for building boolean, choice and score questions and viewing probabilities and cost.
ServiceprototypeJavaScriptChinese 'emotion lie detector' demo comparing Jev's Choice, Score and Noul judgments on a message with a general LLM.
CLIprototypePythonChinese-language tutorial repo with six runnable Python demos and four notes on Jev primitives, with offline mock mode and live samples.
ServiceprototypePythonPortuguese-language Go proof of concept that tests whether Jev's confidence is calibrated enough to auto-route support tickets.
DemoprototypeGoPython harness stress-testing Jev's confidence, its accuracy as a RAGTruth hallucination judge, and its use as a RAG reranker.
DemoresearchPythonMeasurement-first lab deciding which classifier technique, Jev, rules or other models, earns a place in a coding-agent fleet.
Appresearch- kev★ 9,079
Family of small Jev-like decision models you can train and run yourself, with a server compatible with TypeSafe's SDK.
ServicebetaPython - poorjev★ 10
Local Jev alternative on zero-shot NLI models with temperature scaling and conformal abstention; reports ECE 0.170 to 0.071, offline.
ServicebetaPython