bpo-30776: reduce regrtest -R false positives by vstinner · Pull Request #2422 · python/cpython (original) (raw)
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service andprivacy statement. We’ll occasionally send you account related emails.
Already on GitHub?Sign in to your account
Conversation0 Commits1 Checks0 Files changed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.Learn more about bidirectional Unicode characters
[ Show hidden characters]({{ revealButtonHref }})
Change the regrtest --huntrleaks checker to decide if a test file
leaks or not. Require that each run leaks at least 1 reference.
Example of reference differences previously considered a failure
(leak) and now considered as success (success, no leak):
[3, 0, 0]
[0, 1, 0]
[8, -8, 1]
- Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference.
- Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum.
- Add an unit test for a reference leak.
Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak):
[3, 0, 0]
[0, 1, 0]
[8, -8, 1]vstinner added a commit that referenced this pull request
regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os
--list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules.
Add support._match_test() private function. (cherry picked from commit ace56d5)
bpo-30764: regrtest: change exit code on failure
Exit code 2 if failed tests ("bad")
Exit code 3 if interrupted
bpo-30764: regrtest: add --fail-env-changed option
If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it.
(cherry picked from commit 63f54c6)
Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference.
Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum.
Add an unit test for a reference leak.
Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak):
[3, 0, 0]
[0, 1, 0]
[8, -8, 1](cherry picked from commit 48b5c42)
vstinner added a commit that referenced this pull request
regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os
--list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules.
Add support._match_test() private function. (cherry picked from commit ace56d5)
bpo-30764: regrtest: change exit code on failure
Exit code 2 if failed tests ("bad")
Exit code 3 if interrupted
bpo-30764: regrtest: add --fail-env-changed option
If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it.
(cherry picked from commit 63f54c6)
Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference.
Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum.
Add an unit test for a reference leak.
Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak):
[3, 0, 0]
[0, 1, 0]
[8, -8, 1](cherry picked from commit 48b5c42)
vstinner added a commit that referenced this pull request
regrtest --list-cases now supports --match and --match-file options. Example: ./python -m test --list-cases -m FileTests test_os
--list-cases now also sets support.verbose to False to prevent messages to stdout when loading test modules.
Add support._match_test() private function. (cherry picked from commit ace56d5)
(cherry picked from commit 36946c0)
bpo-30764: regrtest: change exit code on failure
Exit code 2 if failed tests ("bad")
Exit code 3 if interrupted
bpo-30764: regrtest: add --fail-env-changed option
If the option is set, mark a test as failed if it alters the environment, for example if it creates a file without removing it.
(cherry picked from commit 63f54c6) (cherry picked from commit 1f33857)
Change the regrtest --huntrleaks checker to decide if a test file leaks or not. Require that each run leaks at least 1 reference.
Warmup runs are now completely ignored: ignored in the checker test and not used anymore to compute the sum.
Add an unit test for a reference leak.
Example of reference differences previously considered a failure (leak) and now considered as success (success, no leak):
[3, 0, 0]
[0, 1, 0]
[8, -8, 1](cherry picked from commit 48b5c42)
(cherry picked from commit e0f8b43)
2 participants
