Skip to content

daf-jev

Composable Python toolkit for Jev: question builders, confidence gates, batch evaluator, calibration, CLI, MCP server and agent skill.

MCP serverbetaMIT

Overview

daf-jev is a modular Python client and decision toolkit for TypeSafe's System One API. It provides noul, choice and score builders grouped into a QuestionSet, sync and async clients with retries on rate limits and typed errors, and pure-logic composition patterns on top of the answers such as confidence gates. It also includes a concurrent batch evaluation harness, an MCP server, a CLI, an agent skill, and a reproducible manuscript and figure pipeline.

One wire contract supports several backends: hosted Jev plus self-hosted alternatives and OpenRouter decision candidates, through a provider registry. An explicit benchmark backend interface adds local priors and classifiers with prepared datasets, durable attempt receipts and separate quality and cost evidence. There is also a decision-point decider and a pipeline from Jev outputs into RxInfer.jl graphical models. It suits researchers and engineers who want more structure than a bare SDK.

What the decision model decides

TypeQuestionAnswers
Yes / noIs this about a billing problem?yes · no
ChoiceWhat is the tone?calm · frustrated
ScoreHow severe?minor · noticeable · blocking

How it works

  1. Build questions with noul()/choice()/score()
  2. Call JevClient.ask with a state string
  3. Apply confidence gates or composition patterns
  4. Batch-evaluate a corpus and calibrate thresholds

Strengths

  • Retries, error mapping and usage accounting built in
  • Multiple backends behind one contract
  • Evaluation and calibration tooling
  • MCP server and CLI

Caveats

  • Large surface area for a client library
  • Hosted backend requires a key

Getting started

uv sync, export JEV_API_KEY (or TYPESAFE_API_KEY), then use JevClient().ask(state, {...}).

At a glance

Type
MCP server
Status
beta
Language
Python
Runtime
library, CLI, MCP server
Has code
yes
Has tests
yes
License
MIT

Use cases and integrations

How curated lists describe it

Frequently asked questions

How is it different from the official SDK?

It adds composition patterns, batch evaluation, calibration, multiple providers, a CLI and an MCP server.

Can it use local models?

Yes, its provider registry includes self-hosted backends alongside hosted Jev.

How do I authenticate?

Set JEV_API_KEY or TYPESAFE_API_KEY, or use a .env file.

Related projects

  • Rust CLI for Jev: ask yes/no, choice and rubric questions about text and branch on exit codes, JSON or MCP tools.

    MCP serverbetaRust
  • Go MCP server giving any client typed Jev decisions via OpenRouter or TypeSafe, with validated answers and no paid retries.

    MCP serverproductionGo
  • Unofficial hosted or local Jev MCP server giving agents a quick second opinion: it picks yes/no, scale or choice and returns probabilities.

    MCP serverbetaTypeScript
  • Rust CLI and library that asks Jev typed questions via OpenRouter and combines the probabilities with fuzzy-logic rules into decisions.

    CLIbetaRust
  • Unofficial standard-library Go client for Jev with generic typed Choice values and local confidence thresholds.

    ProjectbetaGo
  • pip-installable Jev kit: a CLI for verify, screen, classify, extract, route and rerank, plus an MCP server for the primitives.

    MCP serverbetaPython