Local runtimes and serving with decision models

Clojure System One engine on Jolt that routes typed questions to Laya encoders, a llama.cpp 'thinker', Clef or TinyDecide.

Reproduction of Jev's decision layer on any Qwen model: serves /v1/systemone by scoring option tokens, with no training or generation.

Offline System One server that answers Jev-format questions with small open models, wire-compatible with TypeSafe's official SDK.

Open MiniCPM5-2B decision model serving /v1/systemone: typed choice, noul and score probabilities in one forward pass.

spark-s1: local Jev-inspired decision models on Qwen3.5-4B for NVIDIA DGX Spark, trained on code- and solver-labelled decision rows.

Drop-in faster backend for Open-Jev-27B using custom CUDA kernels, a prefix tree and CUDA graphs: about 6x lower JevBench latency.

Research engine for local System One decisions via llama.cpp logits projection with Qwen, running sub-second on a 4 GB laptop GPU.

Hugging Face Space for parallel constrained decoding on Apple Silicon: fills multi-field JSON schemas in parallel with field confidence.

Phocinae Largha: 144.3M bilingual English/Chinese decision model on mmBERT-small with calibrated Choice, Score and Noul in one pass.

Open decision models fine-tuned from Qwen at 0.8B to 9B that return a choice and per-option probabilities for Choice, Noul and Score.

Paused C#/.NET 10 non-autoregressive decision engine running a Laya/mmBERT checkpoint locally, returning Choice, Score and Boolean answers.

Open System One model and MLX runtime returning calibrated choice, score and noul probabilities via a Jev-compatible API.

Gemma 4 12B with its LM head replaced by a small answer head, serving Jev-style noul, choice and score decisions with custom code.

Together AI's experimental Qwen3.5 fine-tunes (4B and 0.8B) that pick one lettered option from a state, question and option list.

Open Apache-2.0 4B decision model (Wald-Q4B) served via a Jev-compatible API, thinking only when unsure, with JevBench 210/231.

Apache-2.0 Gemma 4 12B fine-tune for local typed decisions, chat and image input, served via /v1/systemone and chat completions.

Static GGUF quantizations by mradermacher of SargeDev's JEV-27B-Uncensored, a Jev 1.13-distilled decision model.

Static GGUF quantizations by mradermacher of SargeDev's JEV-27B-VL-Uncensored vision decision model.

CUDA-native engine that serves open Qwen3.5 checkpoints behind a Jev-compatible API, reading option logits without decoding.

122M multilingual local decision model answering Choice, Noul and Score in milliseconds on CPU behind a /v1/systemone server.

Core ML and Neural Engine port of Laya for Apple Silicon, about 5 ms per short decision on an M3 Max with energy benchmarks.

Apple Silicon workbench running Laya, Decider, Kev and Jev side by side with accuracy, calibration, latency and memory benchmarks.

Runs jev-browser entirely on a local Jev-style engine (Qwen2.5 1.5B decisions, 0.5B typing) on an RTX 2060 SUPER, with no cloud API.

Local benchmark comparing Jev with Laya-MLX on classifying GitHub issues for beginner-friendliness, CV fit and difficulty.

Speed and accuracy benchmark of hosted Jev 1.13 versus local Laya 421M on 1,470 synthetic items across eight decision tasks.

Unofficial study reproducing Jev-style parallel typed decisions on small stock models on an Apple Silicon laptop, with benchmarks.

Benchmarks Jev against local open decision models on 480 general Persian questions, literary questions and a classical poetry pilot.

Jev-inspired technique scoring single-token labels with an LLM's head via vLLM to fill typed fields, with a fast Mario demo.

Tutorial to fine-tune Qwen3.5-4B into a Jev-like classifier with Unsloth on RunPod, serve via vLLM and benchmark against Jev.

Hugging Face blog on llama.cpp's /v1/systemone endpoint serving decision models locally in Jev's wire format.