DNA News

Act on this, mostly facts

Trail of Bits ships agent plugins for patching and regression hunting

What to do

Try the patching and regression-hunt plugins on merged patches before trusting an agent's fix.

Why

Review of Patch the Planet patches found 21 regressions in over 130 PRs, and regression-hunt cut false positives 25 percent.

Read the source at blog.trailofbits.com Discussion

What the research found

Trail of Bits released patching-bugs and regression-hunt agent plugins; their review of merged Patch the Planet patches found 21 regressions in over 130 PRs, none breaking a security protection, and regression-hunt cut false positives 25% versus a baseline Codex prompt.

Claims and how well the evidence supports them

  1. Trail of Bits published patching-bugs and regression-hunt plugins for agent-driven patching 98%
  2. Review found 21 regressions from over 130 merged PRs: 16 functional, one performance, four build/test 99%
  3. regression-hunt produces 25% fewer false positives than baseline Codex prompt 98%
  4. No confirmed regressions broke a security protection 98%

Evidence

Actionability rated medium.