Skip to content

Calibration & Research

Work on the models themselves and on the quality of their probabilities. Open-weight reproductions, inference tricks that read option probabilities from ordinary LLMs, calibration and threshold studies, and papers sit here.

264 public projects · page 7 of 9

  • Valen★ 790

    Apache-2.0 multimodal System One models (0.8B, 2B, 4B) that take text, images or video and return probabilities over supplied candidates.

    ModelresearchPython
  • jev-visual★ 317

    Educational MLX project scoring typed questions about one image with Qwen3.5-0.8B on Apple Silicon, with game demos.

    ModelresearchPython
  • reflex★ 166

    Small open decision model on a frozen Qwen3.5-4B serving /v1/systemone in about 200 ms, benchmarked against Jev on JevBench.

    ServiceresearchPython
  • mini-jev★ 59

    Preregistered study: reading a frozen Qwen3-4B's option-letter logits matches grammar-constrained JSON accuracy, and runs faster.

    ModelresearchPython
  • Dohnuts★ 36

    Small multimodal System One models that choose, judge or score text, documents and images in one forward pass.

    ModelresearchPython
  • nirnay★ 9

    NIRNAY 450M: open Apache-2.0 decision model fine-tuned from Laya that reports 87.9% on Banking77 with fitted ECE 0.045.

    ModelresearchPython
  • Open-weight 0.6B decision model on a Qwen3 backbone: state and typed questions in, a probability for every option out, nothing decoded.

    ModelresearchPython
  • Open 27B multimodal decision model built largely by autonomous agents, serving choice, noul and score on a TypeSafe-compatible API.

    ModelresearchPython
  • Experimental 17M-400M English decision models for choice, yes/no, score and reranking, with weights, training code and an ONNX browser demo.

    ModelresearchPython
  • Bespoke Labs' open recipe, data and 9B LoRA model for Jev-style choice and true/false decisions, runnable on Apple Silicon or NVIDIA GPUs.

    ModelresearchPython
  • Open Apache-2.0 Jev-like model family on Qwen3.8-27B that reads one-token candidate preferences and serves a TypeSafe-compatible API.

    ServiceresearchPython
  • 706K-parameter Jev-style option scorer that rates fill, check, click or skip for each form element in one parallel pass.

    ModelresearchPython
  • Recipe that answers JevBench typed decisions with frozen Gemma-4-12B-it on stock vLLM by reading one option-letter token's probability.

    ModelresearchPython
  • Experiment showing a RLCD-trained LoRA decision head on Qwen3.5-4B generalises only where training data covers the task structure.

    ModelresearchPython
  • 399M ModernBERT-large decision model with one universal choice head answering Choice, Noul and Score in a single forward pass.

    ModelresearchPython
  • Calibration harness that reads yes/no, pick-one and rating answers from one forward pass of a frozen open vision-language model.

    ModelresearchPython
  • InternLM's open multimodal decision models (0.8B-4B) trained on Qwen3.5, with calibration tooling and a 96-case calibration benchmark.

    ModelresearchPython
  • Open Apache-2.0 System One decision models (4B, 9B, 27B on Qwen) with trainer, data builders, evals and every run record.

    ServiceresearchPython
  • PostHog's 9B Jev-like model that reasons before deciding, trained with SFT and CISPO, with a diffusion drafter for speed.

    ModelresearchPython
  • Minimal training project for a Jev-style decision model: Qwen3-0.6B with a pointer head that outputs probabilities over options.

    ModelresearchPython
  • Open multimodal decision model fine-tuned from Gemma 4 12B that returns option probabilities for text, image, audio and video questions.

    ModelresearchPython
  • Preprint survey of Jev-style typed decision models: their research roots, adaptation costs and what current evidence supports.

    Modelresearch
  • Open infrastructure for training, evaluating and deploying System 1 decision models, with calibrated LoRA checkpoints on a 27B backbone.

    ModelresearchPython
  • Open stack to synthesise decision data, train and calibrate a Qwen3.5-0.8B scorer, evaluate on Mind2Web and serve Jev-style.

    ServiceresearchPython
  • Training library for a small one-pass model that scores a changing list of text options and returns a probability per option.

    LibraryresearchPython
  • Clojure System One engine on Jolt that routes typed questions to Laya encoders, a llama.cpp 'thinker', Clef or TinyDecide.

    ModelresearchClojure
  • Reproduction of Jev's decision layer on any Qwen model: serves /v1/systemone by scoring option tokens, with no training or generation.

    ServiceresearchPython
  • Offline System One server that answers Jev-format questions with small open models, wire-compatible with TypeSafe's official SDK.

    ServiceresearchPython
  • Image-plus-text decision model on Qwen3-VL-2B with LoRA and an answer head that returns one probability per option.

    ModelresearchPython
  • Open MiniCPM5-2B decision model serving /v1/systemone: typed choice, noul and score probabilities in one forward pass.

    ModelresearchPython