Local runtimes and serving with decision models

Native C++ Laya inference on ggml with CUDA, Vulkan and Core ML, plus a Jev-compatible HTTP server with automatic batching.

Turns any chat model on SGLang, vLLM, transformers or MLX into a Jev-compatible service with one prefill and one label token per question.

Docker recipes and ARM64 images for serving ten native decision checkpoints, such as Cloudflare Clef, behind /v1/systemone on DGX Spark.

Self-hosted podcast ad remover that transcribes episodes and uses an LLM or System One to detect and cut ad segments.

OpenAI-compatible chat cache proxy that asks Jev or a local System One model whether a new question has the same intent as a cached one.

NoulXP: open standard and reference engine for packaging calibrated System One decision models so one runtime can run them all.

Local-first desktop AI workbench for llama.cpp, vLLM and SGLang that includes a JEV typed-decision page and /v1/systemone gateway.

Go gateway that puts local and hosted System One models behind one TypeSafe API, with a local Laya router choosing Laya or Jev.

PAVE skill and CLI for typed Choice, Score and Noul decisions via local Laya, any /v1/systemone server, TypeSafe Jev or an EPM gateway.

Local FastAPI server for the Phocinae 144M decision model implementing the System One /v1/systemone contract on 127.0.0.1.

macOS menu bar screen-time app that asks Kev or Jev whether each screen breaks your rules and steps in with a pop-up.

Local Rust gateway that exposes Codex, Grok, Kiro or Vercel AI Gateway credentials as OpenAI/Anthropic APIs, including Jev evaluations.

Claude Code plugin where a local Decider model on your Mac picks the model and effort level for each subagent task.

Japanese System One decision model on ModernBERT-ja (314.6M) returning typed choice, score and bool distributions with no generation.

Zero-dependency Node proxy that shadows Jev with local decision models and reports whether you can safely swap, per question and policy.

Provider-neutral TypeScript runtime: write choice, noul and score once and run them on Jev, Reflex or any System One endpoint.

Self-hosted Jev-compatible System One server that sits in front of llama-server and reads option probabilities from any GGUF model.

OpenAI-compatible local server pairing a small llama.cpp model for generation with Jev for the closed decisions.

OpenCode V2 port of fast-jev-compaction that asks Jev or a local Jev-style model which old tool outputs still matter.

CPU-only local Jev-style decision service plus an oh-my-pi extension that retargets the agent's judge provider to it.

Cloudflare app that labels a YouTube creator's Shorts with Laya or Jev to find which hooks drive views and score new hooks.

Game agent claiming to combine local Laya reflexes with Jev strategy to play PC and Android games via screen capture and real inputs.

Python CLI that shows which OpenAI model Jev would route a query to, independently reviewed by a local Ollama model.

Python library that imitates Jev-style typed decisions (choice, score, yes/no) on local LLMs via Ollama, vLLM or llama.cpp.

MLX library that turns an existing local model into a decision engine by reading candidate logits, with no fine-tuning, on Apple Silicon.

Selector-free pytest UI tests for saucedemo using a jev-ultrafast-style agent run fully locally with laya-browser and a small Ollama model.

Python batching proxy that asks the same Jev questions about many states and streams answers back as Apache Arrow tables.

Experiment running a trained jevlike option scorer as ESP-IDF firmware on an ESP32 microcontroller.

Enhancement pack for MiniMax Code CLI on local DGX Spark hardware, including a Jev-style local decision browser agent and context patches.

Early Rust runtime that answers Jev and Laya typed questions, currently serving Laya checkpoints on CPU, CUDA and Apple GPUs.