GPT-6 Astra run pairs gradable in both arms: 322 exploitable without LeoPrevent: 69 (21.4%) exploitable with LeoPrevent: 57 (17.7%) relative change: 17.4% fewer exploitable only without: 17; only with: 5; exact McNemar p=0.0169 task majority: 129 tasks; without 27, with 23; p=0.2891 Go-Gin pairs 44 without 10 with 10 JavaScript-express pairs 42 without 7 with 7 PHP-Lumen pairs 44 without 12 with 12 Python-Django pairs 28 without 8 with 5 Python-FastAPI pairs 49 without 12 with 7 Python-Flask pairs 50 without 11 with 7 Ruby-Rails pairs 24 without 4 with 4 Rust-Actix pairs 41 without 5 with 5 Claude Opus 5.5 (LeoPrevent rerun after the harness fix) run pairs gradable in both arms: 414 exploitable without LeoPrevent: 55 (13.3%) exploitable with LeoPrevent: 47 (11.4%) relative change: 14.5% fewer exploitable only without: 11; only with: 3; exact McNemar p=0.0574 task majority: 171 tasks; without 23, with 20; p=0.3750 Go-Gin pairs 59 without 9 with 7 JavaScript-express pairs 58 without 8 with 8 PHP-Lumen pairs 50 without 7 with 7 Python-Django pairs 19 without 2 with 2 Python-FastAPI pairs 65 without 11 with 10 Python-Flask pairs 61 without 7 with 5 Ruby-Rails pairs 41 without 3 with 2 Rust-Actix pairs 61 without 8 with 6 Claude Opus 5.5 (first LeoPrevent run, harness bug) run pairs gradable in both arms: 380 exploitable without LeoPrevent: 46 (12.1%) exploitable with LeoPrevent: 47 (12.4%) relative change: 2.2% more exploitable only without: 8; only with: 9; exact McNemar p=1.0000 task majority: 159 tasks; without 19, with 19; p=1.0000 Go-Gin pairs 56 without 7 with 9 JavaScript-express pairs 57 without 7 with 7 PHP-Lumen pairs 45 without 6 with 6 Python-Django pairs 5 without 0 with 0 Python-FastAPI pairs 62 without 10 with 9 Python-Flask pairs 57 without 7 with 7 Ruby-Rails pairs 38 without 3 with 3 Rust-Actix pairs 60 without 6 with 6 Verdicts per agent and arm (all planned runs) Claude Opus 5.5 with LeoPrevent NOT GRADED 24 Claude Opus 5.5 with LeoPrevent SAFE 429 Claude Opus 5.5 with LeoPrevent UNGRADABLE 157 Claude Opus 5.5 with LeoPrevent VULNERABLE 62 Claude Opus 5.5 with LeoPrevent, first run (harness bug) NOT GRADED 89 Claude Opus 5.5 with LeoPrevent, first run (harness bug) SAFE 374 Claude Opus 5.5 with LeoPrevent, first run (harness bug) UNGRADABLE 154 Claude Opus 5.5 with LeoPrevent, first run (harness bug) VULNERABLE 55 Claude Opus 5.5 without LeoPrevent NOT GRADED 87 Claude Opus 5.5 without LeoPrevent SAFE 426 Claude Opus 5.5 without LeoPrevent UNGRADABLE 96 Claude Opus 5.5 without LeoPrevent VULNERABLE 63 GPT-6 Astra with LeoPrevent NOT GRADED 57 GPT-6 Astra with LeoPrevent SAFE 275 GPT-6 Astra with LeoPrevent UNGRADABLE 278 GPT-6 Astra with LeoPrevent VULNERABLE 62 GPT-6 Astra without LeoPrevent NOT GRADED 28 GPT-6 Astra without LeoPrevent SAFE 359 GPT-6 Astra without LeoPrevent UNGRADABLE 189 GPT-6 Astra without LeoPrevent VULNERABLE 96