JevGPT
ChatGPT-style web chat where every word of every reply is a Jev multiple-choice decision over a ~1,800-word vocabulary plus END.
Overview
JevGPT (idlivada) flips the usual pattern of using text-generating models for multiple-choice problems: it uses Jev, a model built for choices, to write. In a ChatGPT-style chat app, every word of every reply is a multiple-choice question. JevGPT sends Jev the conversation and the reply so far and asks which word comes next; Jev returns a probability for every word in a fixed vocabulary of about 1,800 words plus a special END option; JevGPT samples a word, streams it to the screen and appends it; and the loop repeats until END is chosen.
The author presents it playfully as returning the favour after years of pointing generative models at problems that are really multiple choice. A live demo is available with your own TypeSafe key, and the code can be run locally. It is an experiment rather than a practical chatbot.
What the decision model decides
| Type | Question | Answers |
|---|---|---|
| Choice | Which word comes next (from ~1,800 words plus END)? | — |
How it works
- Send conversation and partial reply
- Jev returns probabilities over the vocabulary plus END
- Sample and stream the next word
- Repeat until END
Strengths
- Simple illustration of autoregressive sampling from a decision model
- Live demo
Caveats
- Limited vocabulary and quality
- Many API calls per reply
At a glance
- Type
- Project
- Status
- prototype
- Language
- TypeScript
- Runtime
- Web app
- Has code
- yes
Use cases and integrations
How curated lists describe it
A ChatGPT-style chat that generates replies one word at a time with TypeSafe's Jev System One model.
hellogumbo/awesome-jev
Frequently asked questions
How does it write text?
By asking Jev to choose the next word from a fixed vocabulary, one word at a time.
How big is the vocabulary?
About 1,800 words plus an END option.
Can I try it?
Yes, there is a live demo that requires your TypeSafe key.
Related projects
Experiment that deliberately misuses Jev as a text generator by asking which symbol comes next and sampling from the returned distribution.
ProjectresearchPythonChat client that makes Jev write by asking Next word? over a 20,000-word dictionary in 255-word buckets plus a run-off.
ProjectresearchPythonSteve Krouse's post launching Jev Typewriter, a playable demo built on 16 Jev judgments, with a video.
DiscussiondiscussionShow HN thread for jev-bisect, a pip package that finds answers with Jev by bisection search over options or ranges.
DiscussiondiscussionPythonToy chat that makes Jev talk by repeatedly choosing its next word from a tiny caveman vocabulary.
ProjectprototypeTypeScriptLocal browser app that turns Jev's per-pixel colour probability distributions into textured paintings.
Browser extensionprototypeJavaScript