[SUREFIRE-2143] Disabled @ParametrizedTest is not counted as skipped one in M8 (worked in M7) (original) (raw)

I'm upgrading surefire plugin from 2.22.2 to 3.0.0-M8, but there are differences in numbers of skipped tests.

Follows https://issues.apache.org/jira/browse/SUREFIRE-1812 -> which is working correctly with M8 (not with M7)

But there is another issue, when disabled @ParametrizedTest is not counted towards skipped tests. This issue happens in M8, works in M7

I prepared simple reproducer - https://github.com/JiriOndrusek/surefire-reproducer-2

Result with 3.0.0-M8 is wrong

[INFO] Running reproducer.ReproducerTest [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 s - in reproducer.ReproducerTest [INFO]  [INFO] Results: [INFO]  [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1

Result with 3.0.0-M7 is correct:

[INFO] Running reproducer.ReproducerTest [WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.031 s - in reproducer.ReproducerTest [INFO] [INFO] Results: [INFO] [WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2