Skip to content
Metatext Decide — typed decisions for your agents, with a probability on every answerGet early access
Metatext
Sign Up

第 9 份独立评测：@juanmacias《Testing TypeSafe's Jev - Legal Corpus》

X article by @juanmacias testing Jev on a legal corpus, listed as the 9th independent evaluation.

Discussionresearch
Open source ↗

This summary is based on how curated lists describe the project; its README was not available to review.

Overview

An X article titled "Testing TypeSafe's Jev - Legal Corpus" by @juanmacias, listed as the ninth independent evaluation of Jev. From the title, it tests Jev's typed decisions on legal documents.

No further detail was available in the listing, so methods and results are not described here.

What the decision model decides

TypeQuestionAnswers
OtherHow well does Jev classify legal text?(inferred)—

How it works

  1. Assemble a legal corpus
  2. Ask Jev typed questions about the documents
  3. Report results

Strengths

  • Independent test in a specialist domain

Caveats

  • Listing gives almost no detail
  • Results not verified here

At a glance

Type
Discussion
Status
research

Use cases and integrations

How curated lists describe it

Frequently asked questions

What is tested?

Jev on a legal document corpus, per the title.

Who wrote it?

@juanmacias on X.

Where is it?

https://x.com/i/article/2100463318209048850

Related projects

  • Jev × LexGLUE

    Zero-shot run of Jev 1.13 on all seven LexGLUE legal tasks (23,607 examples) versus GPT-5.6 Luna, open models and fine-tuned BERT.

    ProjectresearchPython
  • jev-anotacao-sentencas

    FGV Direito SP experiment comparing Jev with Gemini 3.8 Flash and GPT-5.6 Luna for annotating 12 variables in 120 TJSP court rulings.

    ProjectresearchPython
  • jevextract

    Grounded extraction where code proposes spans with exact offsets and Jev only classifies each one; a LangExtract alternative.

    LibrarybetaPython
  • LegalForecast-MTD

    Benchmark asking models to forecast federal motion-to-dismiss rulings from the judge's record, scored with claim-defendant Brier metrics.

    BenchmarkresearchPython
  • Chinese-Jev

    Paper introducing an encoder-only System One model for Chinese with domain fine-tunes and the CJ-Bench benchmark.

    Paperresearch
  • Vals AI's independent evaluation of Jev

    Vals AI's independent benchmark of Jev: matched a frontier model on claim verification at a fraction of cost, but ranked last on LegalBench.

    Discussiondiscussion