jev-curate
Rust streaming filter that keeps or rejects JSONL and Parquet dataset rows using Jev Noul checks and confidence scores.
This summary is based on how curated lists describe the project; its README was not available to review.
Overview
jev-curate is described in list summaries as a Rust dataset-filtering tool for synthetic training data. It streams JSONL and Parquet rows, asks Jev Noul questions about each record, and uses the calibrated confidence to decide whether to keep or reject the row, writing passed records and rejections straight to disk.
It targets people preparing training datasets who want a fast automated quality pass. No README was available, so details on the specific checks, thresholds, configuration and installation are unknown; one summary calls it an experiment.
What the decision model decides
| Type | Question | Answers |
|---|---|---|
| Yes / no | Does this record pass the quality check?(inferred) | — |
How it works
- Stream rows from JSONL or Parquet
- Ask Jev Noul questions per record
- Keep or reject based on confidence
- Write passed and rejected rows to separate outputs
Strengths
- Streaming design suited to large files
- Rejections kept on disk for review
Caveats
- No README collected; configuration and accuracy unknown
- Described as an experiment
At a glance
- Type
- Project
- Status
- prototype
- Language
- Rust
- Runtime
- CLI
- Has code
- yes
- License
- MIT
Use cases and integrations
How curated lists describe it
Dataset engineering: sifts synthetic JSONL and Parquet rows using Jev Noul checks and calibrated confidence scores, streaming passed records and rejections straight to disk.
yibie/awesome-jevA Rust dataset-filtering experiment using Jev scores to keep or reject text records.
logicrw/awesome-jev-projectsStreaming filter and scorer for Parquet and JSONL datasets.
cobanov/awesome-jev
Frequently asked questions
What does Jev decide?
Whether each dataset record passes a yes/no quality check.
Which formats are supported?
JSONL and Parquet, according to the list summaries.
Is it production ready?
Unknown; one summary calls it an experiment.
Related projects
dbt package whose macros run Jev Choice, Noul and Score over SQL values in DuckDB and ClickHouse models.
ProjectbetaSQL (Jinja)DuckDB extension that asks Jev about every row in SQL and returns answers as ENUM, DOUBLE or STRUCT columns.
PluginbetaC++Polars library for parallel LLM inference that also asks Jev per-row Noul, Choice and Score questions through a native Rust layer.
LibrarybetaPythonTabular classifier that learns which slices of labeled rows and columns to send Jev or LAYA, stopping when it has enough.
ProjectresearchPythonSutro's active-learning CLI that finds rows Jev is least sure about, asks you to label them, and uses GEPA to improve the definition.
CLIbetaPythonCLI that scans tabular, structured and text files or databases and asks Jev which fields look anomalous, building a review queue.
CLIbetaPython