What happens
The tool-profile mutation scopes clear their floors by a margin that no longer protects anything. On #852's CI run, with timeoutMS: 20000 (#837) and load failures counted as kills (#851):
| Scope |
Score |
Floor |
| tools-claude |
94.5 |
92 |
| tools-cursor |
97.3 |
94 |
| tools-copilot |
95.8 |
93 |
The margin existed because scores moved with machine load: a slow run timed out and was scored as a kill. With a 20 s limit a slow run no longer crosses it, so the score is a property of the tests. A change that lost two or three points of detection on these profiles would pass unnoticed.
Expected
Each floor sits at the integer part of the score the scope reaches today: tools-claude 94, tools-cursor 97, tools-copilot 95. A test that stops detecting a mutant on these profiles fails the gate.
What happens
The tool-profile mutation scopes clear their floors by a margin that no longer protects anything. On #852's CI run, with
timeoutMS: 20000(#837) and load failures counted as kills (#851):The margin existed because scores moved with machine load: a slow run timed out and was scored as a kill. With a 20 s limit a slow run no longer crosses it, so the score is a property of the tests. A change that lost two or three points of detection on these profiles would pass unnoticed.
Expected
Each floor sits at the integer part of the score the scope reaches today: tools-claude 94, tools-cursor 97, tools-copilot 95. A test that stops detecting a mutant on these profiles fails the gate.