Community · E2 · artifact verified

Review pull requests with calibrated bug risk

A single-file local pull-request reviewer: deterministic code does the plumbing while Jev judges each hunk with a real-issue Noul, scores severity, and returns a PR-level risk with a needs-human probability - no agent loop, no prompts to tune.

01 · Role in the system

What Jev does here

The tool diffs a branch or commit range, clusters changed hunks, and asks Jev one call per cluster: a Noul gates whether each suspected issue is real at all, Score questions rate severity, and the PR level gets an overall risk score plus a needs_human_review Noul - the sample run reports 2.1/3 risk with needs-human at 0.93. Every run appends raw scores to a metrics JSONL so judgments can be tracked over time, and a --golden mode checks the judge against labelled cases before you trust it. Output is advisory and labelled as such: findings carry their own is_real probability next to the hunk, so a reviewer can see how sure the judge was. Because the model only returns typed answers, the plumbing - git, thresholds at 0.50, report formatting - stays deterministic Python in one file.

02 · Control boundary

Where Jev sits

Jev as the judgment layer of a deterministic review pipeline: code clusters hunks and formats reports, one call per cluster returns real-issue Nouls, severity Scores and a needs-human probability, and a metrics log plus golden evals keep the judge accountable.

Code owns the loop, permissions, thresholds, validation, and side effects. Jev owns only the bounded judgments described above.

03 · Known limits

What this evidence does not prove

  • Self-described experimental and advisory only; findings are suggestions, not verdicts.
  • Single-maintainer tool with no hosted service; run locally with your own API key.
  • The 0.50 real-issue threshold is a fixed author choice; no benchmark against human reviewers yet.

04 · Attribution

Public sources

This is a Community record: the project was published by a third-party community author.