Calibration & Research
Work on the models themselves and on the quality of their probabilities. Open-weight reproductions, inference tricks that read option probabilities from ordinary LLMs, calibration and threshold studies, and papers sit here.
264 public projects · page 7 of 9
- Valen★ 790
Apache-2.0 multimodal System One models (0.8B, 2B, 4B) that take text, images or video and return probabilities over supplied candidates.
ModelresearchPython - jev-visual★ 317
Educational MLX project scoring typed questions about one image with Qwen3.5-0.8B on Apple Silicon, with game demos.
ModelresearchPython - reflex★ 166
Small open decision model on a frozen Qwen3.5-4B serving /v1/systemone in about 200 ms, benchmarked against Jev on JevBench.
ServiceresearchPython - mini-jev★ 59
Preregistered study: reading a frozen Qwen3-4B's option-letter logits matches grammar-constrained JSON accuracy, and runs faster.
ModelresearchPython - Dohnuts★ 36
Small multimodal System One models that choose, judge or score text, documents and images in one forward pass.
ModelresearchPython - nirnay★ 9
NIRNAY 450M: open Apache-2.0 decision model fine-tuned from Laya that reports 87.9% on Banking77 with fitted ECE 0.045.
ModelresearchPython Open-weight 0.6B decision model on a Qwen3 backbone: state and typed questions in, a probability for every option out, nothing decoded.
ModelresearchPythonOpen 27B multimodal decision model built largely by autonomous agents, serving choice, noul and score on a TypeSafe-compatible API.
ModelresearchPythonExperimental 17M-400M English decision models for choice, yes/no, score and reranking, with weights, training code and an ONNX browser demo.
ModelresearchPythonBespoke Labs' open recipe, data and 9B LoRA model for Jev-style choice and true/false decisions, runnable on Apple Silicon or NVIDIA GPUs.
ModelresearchPythonOpen Apache-2.0 Jev-like model family on Qwen3.8-27B that reads one-token candidate preferences and serves a TypeSafe-compatible API.
ServiceresearchPython706K-parameter Jev-style option scorer that rates fill, check, click or skip for each form element in one parallel pass.
ModelresearchPythonRecipe that answers JevBench typed decisions with frozen Gemma-4-12B-it on stock vLLM by reading one option-letter token's probability.
ModelresearchPythonExperiment showing a RLCD-trained LoRA decision head on Qwen3.5-4B generalises only where training data covers the task structure.
ModelresearchPython399M ModernBERT-large decision model with one universal choice head answering Choice, Noul and Score in a single forward pass.
ModelresearchPythonCalibration harness that reads yes/no, pick-one and rating answers from one forward pass of a frozen open vision-language model.
ModelresearchPythonInternLM's open multimodal decision models (0.8B-4B) trained on Qwen3.5, with calibration tooling and a 96-case calibration benchmark.
ModelresearchPythonOpen Apache-2.0 System One decision models (4B, 9B, 27B on Qwen) with trainer, data builders, evals and every run record.
ServiceresearchPythonPostHog's 9B Jev-like model that reasons before deciding, trained with SFT and CISPO, with a diffusion drafter for speed.
ModelresearchPythonMinimal training project for a Jev-style decision model: Qwen3-0.6B with a pointer head that outputs probabilities over options.
ModelresearchPythonOpen multimodal decision model fine-tuned from Gemma 4 12B that returns option probabilities for text, image, audio and video questions.
ModelresearchPythonPreprint survey of Jev-style typed decision models: their research roots, adaptation costs and what current evidence supports.
ModelresearchOpen infrastructure for training, evaluating and deploying System 1 decision models, with calibrated LoRA checkpoints on a 27B backbone.
ModelresearchPythonOpen stack to synthesise decision data, train and calibrate a Qwen3.5-0.8B scorer, evaluate on Mind2Web and serve Jev-style.
ServiceresearchPythonTraining library for a small one-pass model that scores a changing list of text options and returns a probability per option.
LibraryresearchPythonClojure System One engine on Jolt that routes typed questions to Laya encoders, a llama.cpp 'thinker', Clef or TinyDecide.
ModelresearchClojureReproduction of Jev's decision layer on any Qwen model: serves /v1/systemone by scoring option tokens, with no training or generation.
ServiceresearchPythonOffline System One server that answers Jev-format questions with small open models, wire-compatible with TypeSafe's official SDK.
ServiceresearchPythonImage-plus-text decision model on Qwen3-VL-2B with LoRA and an answer head that returns one probability per option.
ModelresearchPythonOpen MiniCPM5-2B decision model serving /v1/systemone: typed choice, noul and score probabilities in one forward pass.
ModelresearchPython