Jev's bias analyzer
Experiment site testing with data whether Jev's judgment about a person changes when their profile changes.
This summary is based on how curated lists describe the project; its README was not available to review.
Overview
Jev's bias analyzer is a web article that sets out to answer, with experimental data, whether Jev would change its mind about you if your profile changed. This kind of counterfactual test varies attributes in a profile while keeping the relevant evidence fixed, and checks whether the model's decision moves.
No README or detailed results were captured, so the attributes tested, decision tasks and findings are unknown. It is relevant for anyone using decision models in people-facing screening.
What the decision model decides
| Type | Question | Answers |
|---|---|---|
| Yes / no | Does Jev's decision change when profile attributes change?(inferred) | yes · no |
How it works
- Define a decision task about a person
- Vary profile attributes while holding evidence fixed
- Compare Jev's answers across variants
Strengths
- Addresses fairness concerns with data
Caveats
- Details and results not captured here
At a glance
- Type
- Article
- Status
- research
- Runtime
- Web article
Use cases and integrations
How curated lists describe it
Answers this question with actual experimental data: Would JEV change its mind about you if your profile changed?
hellogumbo/awesome-jev
Frequently asked questions
What does it test?
Whether Jev's judgment about a person changes when their profile changes.
Where can I read it?
At jev-bias-analysis.stupidlabs.lol.
What were the results?
Not captured in the listing.
Related projects
Auto-updated bilingual leaderboard of Jev ecosystem projects, tutorials and discussions, discovered daily and sorted by GitHub stars.
ProjectproductionChatGPT-style web chat where every word of every reply is a Jev multiple-choice decision over a ~1,800-word vocabulary plus END.
ProjectprototypeTypeScriptExperiment that deliberately misuses Jev as a text generator by asking which symbol comes next and sampling from the returned distribution.
ProjectresearchPythonChat client that makes Jev write by asking Next word? over a 20,000-word dictionary in 255-word buckets plus a run-off.
ProjectresearchPythonIssue in the Orcha multi-agent orchestration project proposing to move judgment calls onto Jev to cut model cost.
ProjectdiscussionPythonAuto-generated write-up of a Reddit post claiming an open RLCD-trained Jev model; content is generic and largely inaccurate.
ProjectPython