Training-free inference techniques with decision models
Ways to get decision-model behaviour from ordinary LLMs, mostly by reading option logits in one forward pass instead of generating text.
128 public projects · page 2 of 5
Exact-target audit finding Jev's Choice probabilities are a step function on stated base rates while per-option Noul tracks them closely.
ProjectresearchPythonResearch decoder that treats Jev as a language model, assembling replies from repeated choices over phrases, words and letters.
ProjectresearchPythonPlayful experiments using Jev's Choice as a decoder: next character, next BPE token, and grammar-constrained SQL generation.
ProjectresearchPythonReads Jev-style choice, yes/no and score probabilities from masked diffusion language models with shared Yes/No weights.
ProjectresearchPythonResearch code using the Canopy-Jev decision model to route tokens to experts and extra recursion steps under explicit budgets.
ProjectresearchPythonExperiment generating chat replies character by character with Jev Choice over 98 next-character continuations.
ProjectresearchJavaScriptText generation with Jev via cascaded Choice questions: word type, WordNet category, embedding cluster, then the word itself.
ProjectresearchPythonWord-level language model whose output layer is Jev: next-word choices, Noul-verified drafted chunks and bits-per-token evaluation.
ProjectresearchTypeScriptCharacter-level language model built from Jev Choice over 28 options, where each option is the full hypothesis text.
ProjectresearchPythonResearch replicating Jev-style typed decisions with open LLMs via logprobs; Qwen3.5-9B reached 94% with good calibration in ~1 s.
ProjectresearchPythonRunnable yardstick that tests Jev's three headline claims on a small local model: typed output, no hallucination, calibration.
ProjectresearchPythonJevNext: decodes numbers from Jev by walking a multiway decision tree of interval or digit Choice calls, without logits or training.
ProjectresearchPythonLocal reproduction of Jev-style inference that reads option-token logits from a small LLM in one pass, with an honest failure log.
ProjectresearchPythonExperiment that deliberately misuses Jev as a text generator by asking which symbol comes next and sampling from the returned distribution.
ProjectresearchPythonChat client that makes Jev write by asking Next word? over a 20,000-word dictionary in 255-word buckets plus a run-off.
ProjectresearchPythonAn LLM writes a task-specific Jev harness, improved with rewards and traces; a Pokemon harness rose from 25% to 75% wins.
ProjectresearchPythonExperimental engine that makes an existing LLM do Jev-like classification and scoring by reusing context and building JSON.
ProjectresearchPythonInference engine for Jev-style decision models using segmented forwards with prefix reuse, serving the Jev wire contract.
ProjectresearchPythonExperiment that uses Jev as a sampler: DeepSeek proposes top-k next tokens and Jev chooses which comes next and when to stop.
ProjectresearchPythonResearch fork of Laya that reads typed choice and yes/no decisions from an image plus optional text in one forward pass.
ProjectresearchPythonOpen decision models that derive calibrated confidence from recurrent looped-layer dynamics instead of RL, with early exit and a Jev API.
ProjectresearchPythonExperiment that makes Jev produce prose by asking one choice question per word over a routed domain vocabulary.
LibraryresearchJavaScriptExperiment testing whether a local Qwen read via label log-probabilities can replace Jev on synthetic AIOps alert decisions.
ProjectresearchPythonInference-time loop where a System One judge like Jev scores a model's thought paths and picks which reasoning branch to keep.
ProjectresearchPythonOpen Jev-class decision models on Qwen3.5 with candidate-logit readout; the 4B model reports 80.1% on JevBench's 231 items.
ProjectresearchPythonLocal Jev-style decision model on Qwen3.5-4B with four stress tests that show where one-pass decisions break.
ProjectresearchPythonLogitTrail (formerly Mini Jev): local workbench that reads typed Choice, Noul and Score decisions from a frozen LLM's logits.
ProjectresearchReads typed decisions from one forward pass of PrismML's 1.75-bit Bonsai 27B under llama.cpp, using the OpenJev/SemIf logit method.
ProjectresearchPythonJava (llama.cpp via FFM) and Python engines that fill boolean/enum JSON schemas in two forward passes with per-field confidence.
ProjectresearchJavaLaptop-scale reimplementation of RL for Calibrated Decisions: parallel constrained decoding trained with GRPO and a Brier reward.
ProjectresearchPython