werkrevisor 0.44.0: Jev asks for each change whether the PR document requires it #116

Merged
ai-reviewer merged 6 commits from claude-code/doc-change-coverage into main 2026-10-17 12:38:51 +02:00
Collaborator

Measures one Jev question per summarized change: does the PR document require it?
See the PR document.

🤖 Generated with Claude Code

Measures one Jev question per summarized change: does the PR document require it? See the PR document. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
claude-code added 1 commit 2026-10-17 11:00:12 +02:00
PR document: does the PR document require each change?
werkator build succeeded after 00:47
werkator/werkrevisor-statistics build succeeded after 01:00
2f9a1f6a6b
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code added 1 commit 2026-10-17 11:00:18 +02:00
PR document: PR#116
werkator build succeeded after 00:08
werkator/werkrevisor-statistics build succeeded after 00:26
d8e705b91a
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code added 1 commit 2026-10-17 11:06:14 +02:00
PR document: measurement of one question per summarized change
werkator build succeeded after 00:11
werkator/werkrevisor-statistics build succeeded after 00:31
2fda970f1f
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code added 1 commit 2026-10-17 11:08:31 +02:00
Jev asks for each summarized change whether the PR document requires it
werkator build succeeded after 00:11
werkator/werkrevisor-statistics build succeeded after 00:29
c2df448426
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code added 1 commit 2026-10-17 11:09:12 +02:00
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code added 1 commit 2026-10-17 11:09:31 +02:00
PR document: sections in the order of the README
ai-review/codex Codex review failed; a human approved the head
werkator/werkrevisor-statistics build succeeded after 00:37
werkator build succeeded after 00:09
ai-review/assessment human review required; a human approval unlocks the merge; review requested from mi; merge scheduled for when the checks succeed
ai-review/gate build succeeded after 01:29
b5b9c1efe5
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
claude-code changed title from WIP: werkrevisor: does the PR document require each change? to werkrevisor 0.44.0: Jev asks for each change whether the PR document requires it 2026-10-17 11:10:37 +02:00
Collaborator

🟡 werkrevisor: YELLOW / HUMAN_REVIEW

Change kind: mixed.

Reasons

  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Non-Goals' hard_to_understand (0.52 > yellow_above = 0.5)
  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.02 hard_to_read (0.70 > yellow_above = 0.5)
  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.03 hard_to_read (0.63 > yellow_above = 0.5)
  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Solution' hard_to_understand (0.56 > yellow_above = 0.5)
  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Open Questions' hard_to_understand (0.63 > yellow_above = 0.5)
  • YELLOW spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Follow-up PRs' hard_to_understand (0.61 > yellow_above = 0.5)
  • hint 6 changed file(s) that neither weaken the checks, touch security nor show a risk category of the repository config according to Jev
  • hint 1 build change(s) of low risk according to Jev: statistics/build.gradle.kts (weakens checks 0.02, risk 0.00, security 0.02)
  • hint 12 section(s) of the PR document agree with the change summary of openrouter/minimax/minimax-m3 according to Jev
  • hint 1 changed file was given to the AI as excerpt of the selected lines and 5 lines around each changed line, not in full (each larger than [review] max_full_file_chars = 80000): werkrevisor/cli.py

Classifier

Unit Question Problem Confidence Verdict
docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Non-Goals' hard_to_understand 0.52 0.53 YELLOW
docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.02 hard_to_read 0.70 0.57 YELLOW
docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.03 hard_to_read 0.63 0.68 YELLOW
docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Solution' hard_to_understand 0.56 0.58 YELLOW
docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Open Questions' hard_to_understand 0.63 0.70 YELLOW
docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Follow-up PRs' hard_to_understand 0.61 0.65 YELLOW

6 of 12 units passed all questions (1 PR document(s)).
3 answers ignored because of a confidence below [classifier] min_confidence.

Usage: model `openrouter/minimax/minimax-m3`, LLM done, tokens counted before the call 53909, calls 1, tokens in 51928 / out 11402 (reasoning included in out), duration 88.1 s, cost 0.0292 USD (reported), classifier `jev-1.13.0` calls 12, tokens in 10161, cost 0.0004 USD, excerpt selection `openrouter/openai/gpt-6-luna` calls 1, tokens in 22619 / out 316, cost 0.0030 USD (reported), change summary `openrouter/minimax/minimax-m3` via Minimax calls 1, tokens in 6459 / out 1576, cost 0.0038 USD (reported), PR document check `jev-1.13.0` calls 12, tokens in 24162, cost 0.0010 USD, build file judge `jev-1.13.0` calls 7, tokens in 8453, cost 0.0004 USD, phases: path_judge 0.6 s, classifier 0.7 s, change_summary 11.0 s, doc_check 0.7 s, context 4.8 s, model_review 69.8 s, config: defaults + host + repository (.werkrevisor.toml at main b19bf27).
Reviewed head `b5b9c1efe572a600009d5cf3ce1682e4adf28ee7` against base `b19bf276ca28c670262c0c569e8358ea46c2efaf`, werkrevisor 0.43.2.
<!-- werkrevisor:b5b9c1efe572a600009d5cf3ce1682e4adf28ee7 --> <!-- werkrevisor-verdict:YELLOW --> <!-- werkrevisor-blocks:7e90b1625c4547c0f7880f25337c2203,f8641a3d519f71eb1dd276a4f5b529eb,c766e3ad49d97df4865fae58d46f7812,9fb3d4869bdc15775bd712e2becd8d90,dff104e06a5ed40ab2b604a98f4d6ce5,add51d6582a3b05ace6e777ea44412e8,ca24c8287aaeff23ea594e37d9e73df9,baf95bedec4b84d2c25410d195b578e6,6cfe6a7d588cb209482ff461095a443b,3588d9c77a1b4de3335a1cf28d8011ba,af8f1c95515a93987c2c4ebc1cd71d21,10fc5cdd6d253ed0377b69731dc9b6fe,cea1bef3ad82b1bbadf58980fac837f0,832ac599cfcafd931d17be9b64b2e5ce,89f86c4e4b225b27850a730d6a74c663,c73a49bba004eb0732891a2e35ccc156,b226185d7e47d08b1445ea9ff8e54db3,8b12c6a46c25410a6fd141d934d145c7,f00fb9e3eb467efcdce18f1f70d226f8,3b1d13dc1258020d70e31a3e7f6cd5bc,82bdd5304d1206e1f019326334bc2a80,887d38e974cd97f3c4bef9006b49ff1b,0679c576e4969c3f74a8c0fa02892391,c0524f77a65df60fa6a766a2395316ec,27ed631fdf80c6a6eb99032359710674,dab604ae5c62011d02d3e3db0095c607,c76925e7cb78734ca320741a81b940c7,9eb95c9584e329fab50b83d57b31e3cf,a31f5f2dcd68bd2af9ec0d900a1c0c30,f2e9d5a14a244c13dd7d1e4eb34813e4,5e805871a07e6be9f01328325f35409b,239b3f6f2b13cdb35f60ed1b34a3d91f,28af5438cd61b3e52a4a77343b3c5a0f,8c17f89cba8b0175e2122447bdbff2b9,81e3d11b629cfff3530b660e2cf8da4a,9a1312faf6dbaa07fb32518aa1a69029,97f03690b404d0964de94f915bbc6ca5,9202717b40415ac0805a8fbc8070e5ad,f5c4f25c143c801392b03521e4883499 --> ## 🟡 werkrevisor: YELLOW / HUMAN_REVIEW Change kind: `mixed`. ### Reasons - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Non-Goals' hard_to_understand (0.52 > yellow_above = 0.5) - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.02 hard_to_read (0.70 > yellow_above = 0.5) - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.03 hard_to_read (0.63 > yellow_above = 0.5) - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Solution' hard_to_understand (0.56 > yellow_above = 0.5) - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Open Questions' hard_to_understand (0.63 > yellow_above = 0.5) - **YELLOW** spec: docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Follow-up PRs' hard_to_understand (0.61 > yellow_above = 0.5) - **hint** 6 changed file(s) that neither weaken the checks, touch security nor show a risk category of the repository config according to Jev - **hint** 1 build change(s) of low risk according to Jev: statistics/build.gradle.kts (weakens checks 0.02, risk 0.00, security 0.02) - **hint** 12 section(s) of the PR document agree with the change summary of openrouter/minimax/minimax-m3 according to Jev - **hint** 1 changed file was given to the AI as excerpt of the selected lines and 5 lines around each changed line, not in full (each larger than [review] max_full_file_chars = 80000): werkrevisor/cli.py ### Classifier | Unit | Question | Problem | Confidence | Verdict | |---|---|---|---|---| | docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Non-Goals' | hard_to_understand | 0.52 | 0.53 | YELLOW | | docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.02 | hard_to_read | 0.70 | 0.57 | YELLOW | | docs/prs/2026-10-17-PR#116-doc-change-coverage.md Scenario#116.03 | hard_to_read | 0.63 | 0.68 | YELLOW | | docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Solution' | hard_to_understand | 0.56 | 0.58 | YELLOW | | docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Open Questions' | hard_to_understand | 0.63 | 0.70 | YELLOW | | docs/prs/2026-10-17-PR#116-doc-change-coverage.md section 'Follow-up PRs' | hard_to_understand | 0.61 | 0.65 | YELLOW | 6 of 12 units passed all questions (1 PR document(s)). 3 answers ignored because of a confidence below [classifier] min_confidence. <sub> Usage: model `openrouter/minimax/minimax-m3`, LLM done, tokens counted before the call 53909, calls 1, tokens in 51928 / out 11402 (reasoning included in out), duration 88.1 s, cost 0.0292 USD (reported), classifier `jev-1.13.0` calls 12, tokens in 10161, cost 0.0004 USD, excerpt selection `openrouter/openai/gpt-6-luna` calls 1, tokens in 22619 / out 316, cost 0.0030 USD (reported), change summary `openrouter/minimax/minimax-m3` via Minimax calls 1, tokens in 6459 / out 1576, cost 0.0038 USD (reported), PR document check `jev-1.13.0` calls 12, tokens in 24162, cost 0.0010 USD, build file judge `jev-1.13.0` calls 7, tokens in 8453, cost 0.0004 USD, phases: path_judge 0.6 s, classifier 0.7 s, change_summary 11.0 s, doc_check 0.7 s, context 4.8 s, model_review 69.8 s, config: defaults + host + repository (.werkrevisor.toml at main b19bf27).<br> Reviewed head `b5b9c1efe572a600009d5cf3ce1682e4adf28ee7` against base `b19bf276ca28c670262c0c569e8358ea46c2efaf`, werkrevisor 0.43.2. </sub>
ai-reviewer scheduled this pull request to auto merge when all checks succeed 2026-10-17 11:12:14 +02:00
ai-reviewer requested review from mi 2026-10-17 11:12:14 +02:00
Collaborator

Codex review failed

3 attempts for head b5b9c1efe572a600009d5cf3ce1682e4adf28ee7 failed; the last cause:

bwrap: setting up uid map: Permission denied

<!-- werkrevisor-codex-error:b5b9c1efe572a600009d5cf3ce1682e4adf28ee7 --> <!-- werkrevisor-codex --> ## Codex review failed 3 attempts for head `b5b9c1efe572a600009d5cf3ce1682e4adf28ee7` failed; the last cause: ``` bwrap: setting up uid map: Permission denied ```
mi approved these changes 2026-10-17 12:35:16 +02:00
ai-reviewer merged commit f34da2710d into main 2026-10-17 12:38:51 +02:00
ai-reviewer deleted branch claude-code/doc-change-coverage 2026-10-17 12:38:51 +02:00
Sign in to join this conversation.
No Reviewers
No labels
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mi/werkrevisor#116