The Quality Gap — Katalon

The quality gap: AI vs. human-written code

AI-generated pull requests contain significantly more issues across every category measured.

All issues per PR with AI code

1.7×

approx. 10.83 compared to 6.45 for human code

More critical issues in AI PRs

1.4×

More logic and correctness errors in AI PRs

1.75×

More I/O issues in AI PRs

8×

AI-generated PRs

Human-written PRs

Sources: CodeRabbit / The Register; Help Net Security.