Local runtimes and serving with decision models

Toy local Jev-shaped decision API on a 0.5B model that answers yes/no, choice and score questions by scoring option tokens.

Experimental language where questions and methods are composable values, with a Rust runtime that speaks /v1/systemone and replays runs.

Toolkit for reading Choice, Score and Noul decisions out of embedding models, with data, fine-tuning, benchmarks and a server.

Experimental Jev wire-compatible engine that claims to produce typed decisions from Mandelbrot fractal dynamics rather than a trained model.

Archived Jev-compatible HTTP server for Laya, superseded by upstream laya[serve]; includes a migration table.

Fastino's 340M Apache-2.0 decision classifier that scores caller-defined labels in one forward pass for routing, intent and scoring.

Multilingual non-autoregressive decision engine answering choice, score and yes/no questions in one ~33 ms pass, with a checkpoint router.

Family of small Jev-like decision models you can train and run yourself, with a server compatible with TypeSafe's SDK.

Open-source Jev-compatible decision model served by one native binary on a laptop CPU, returning probabilities in 28 to 130 ms.

Rust daemon and CLI that pulls open decision models like Laya and serves them locally behind a TypeSafe-compatible /v1/systemone.

AWS Strands Labs' 2B decision model: Qwen3.5-2B with a pointer head scoring options and calibrated confidence, plus a CLI.

Featherless AI server that turns compatible open Hugging Face models into a /v1/systemone classifier by reading next-token logits.

Native vLLM serving for Jev-style decision models on Linux and Apple Silicon, including image and video questions for Valen.

Proxy that distils a repeated Jev classification task into a local model on the fly and answers most requests itself once it agrees.

Python library that gets typed, calibrated decisions from any open-weights LLM in one forward pass, with packed shared-state questions.

Drop-in local replacement for Jev that serves /v1/systemone from open weights, including questions about images.

Native C++ (llama.cpp-based) CPU inference for Dohnuts and other small decision models behind a /v1/systemone server.

Serving layer that runs typed-decision models like Laya on your GPU or Mac behind a Jev-compatible /v1/systemone API.

Library and MCP server that scores a fixed set of choices with a model you already run (llama.cpp, Ollama, OpenRouter).

Open family of System One-style models fine-tuned from Qwen3.5 and Gemma that return typed decision probabilities in one pass.

Self-hostable inference server for open decision models implementing the TypeSafe /v1/systemone API, one Docker image per engine.

Open multilingual System 1 decision engine built on Laya checkpoints with a router that picks the best checkpoint per request.

Nace.AI's open Drex decision models (v2.0 MoE, v1.5 9B, diffusion DLM) serving /v1/systemone locally via Python, llama.cpp or Ollama.

Self-hosted open Jev implementation: SDK and System One API for choice, boolean and score on pinned open models across many runtimes.

Python library for one-line judgment calls (likely, classify, rate) returning YES, NO or UNSURE, built for Jev and other small models.

Apache-2.0 local decision model (0.8B Qwen fine-tune on llama.cpp) behind the Jev request shape, calibrated and CPU-only.

0.8B open System One model with task adapters that makes millisecond decisions in front of a larger local model like Qwen3.8-27B.

Self-hosted drop-in replacement for Jev's System One API, powered by the 400M-parameter GLiFormer model.

Local /v1/systemone server in Japanese docs with LFM, Sarashina and fine-tuned ModernBERT-Ja backends, including image input.

AutoTrust's Apache-2.0 student of Jev 1.13 on Qwen3.8-27B, serving typed decisions and ordinary generation from one vLLM engine.