Local runtimes and serving with decision models

Local Jev-compatible /v1/systemone server answering Noul, Choice and Score from open-weight models, usable with the official SDK.

Rust engine that answers noul, choice and score from any LLM in one prefill via logprobs, wire-compatible with /v1/systemone and MCP.

Open 0.8B and 2B Qwen3.5 decision models with a local systemone-compatible server, MCP tools, agent skills and a Claude Code guard.

Single-binary local cache that memoizes Jev-class decisions on model, schema and redacted state, for cheap repeats and CI replay.

Makes any logprob-capable model answer typed questions Jev-style in one pass, in Jev's API shape, with probes and scorecards.

Scores every allowed option of a typed schema from one MLX prefill on Apple Silicon and assembles schema-valid JSON with probabilities.

Small open decision models (0.8B and 4B, from Qwen3.5) with a server that speaks Jev's /v1/systemone format in one forward pass.

Semantic linter that evaluates files against plain-English JSON rule packs in one /v1/systemone pass, locally with Kev or remotely with Jev.

Node.js and TypeScript package that runs Laya through ONNX Runtime with typed answers matching the Python and Jev API shapes.

Runs Laya's typed-decisions checkpoint on Mac GPUs via PyTorch MPS, with a low-memory mode down to about 0.74 GiB.

Fork of Laya that runs its choice, score and yes/no decision checkpoints on Huawei Ascend 910B NPUs as well as CPU.

Independent MLX port of Laya for Apple Silicon: typed decisions in about 13 ms (7 ms multilingual) with no PyTorch or cloud API.

From-scratch Rust reimplementation of Laya on candle, including the encoder, decision head, calibration, RLCD training and a server.

CPU-first Rust runtime and HTTP server for Laya's multilingual model on ONNX Runtime, with portable builds and Chinese and English docs.

Pure-Rust Laya inference on candle for CPU, Metal or CUDA, with a CLI and a local web console showing close calls.

Self-hosted Docker service and web console that serves Laya's multilingual model on Jev's /v1/systemone format behind API keys.

Zero-training toolkit that turns local LLMs and multimodal models into Jev-style decision services via prefill-only scoring.

HTTP server for Mica, a 4B open decision model with 32k context serving yes/no, choice and score in TypeSafe's /v1/systemone format.

TokenRhythm's NeoHorse repo: open 4B/9B agent models plus NeoHorse-Jev-4B, a prefill-only Choice/Noul/Score decision model.

Hugging Face card for NeoHorse-Jev-4B: Apache-2.0 4B decision model for text or image-plus-text, served at /v1/systemone.

Serves the Jev request shape from any OpenAI-compatible endpoint by reading single-letter option probabilities from logprobs.

Ollama-style runtime that pulls System One decision models from Hugging Face and serves them locally behind /v1/systemone.

Open-Jev: open typed-decision models (2B, 9B, 27B v1.1) returning candidate probabilities without generation, with a no-code workbench.

Open calibrated decision models from 400M to 80B with Jev-compatible server, MCP server and clients, benchmarked against Jev.

OpenJev 1.7B-8B: open decision models distilled for general decisions and browser-agent steps, served behind /v1/systemone.

Jev- and OpenAI-Decisions-compatible System One server on DiffusionGemma 26B-A4B, also serving Laya, Clef and other open models.

Local Jev-compatible API on a Mac: Qwen via llama.cpp/Metal reads one output token per question for text and image decisions.

Native Swift port of OpenJev: a Jev-compatible /v1/systemone server on Apple Silicon Macs and libraries for on-device iPhone decisions.

Family of open decision models from 153M to 31B that pick one option per question with calibrated probabilities in the /v1/systemone shape.

GGUF-native Rust and CUDA engine tuned for cold starts, with a system1 command that scores candidate answers in one forward pass.