Issue 22966: py_compile: foo.bar.py → pycache/foo.cpython-34.pyc (original) (raw)

Created on 2014-11-29 10:16 by piotr, last changed 2022-04-11 14:58 by admin. This issue is now closed.

Files
File name Uploaded Description Edit
22966.txt barry,2014-12-01 21:59 review
Messages (10)
msg231859 - (view) Author: Piotr Ożarowski (piotr) Date: 2014-11-29 10:16
when py_compile module is asked to create .pyc file for file with invalid name, it doesn't fail or ignore such request - it creates/overwrites .pyc file for sane file name (i.e. ignores everything after dot) $ touch foo.bar.py $ python3.4 -m py_compile foo.bar.py $ ls __pycache__ foo.cpython-34.pyc Even though foo.bar.py is not a valid file name, some programmers are using such names for plugins which leads to bugs similar to https://lists.debian.org/debian-python/2014/11/msg00061.html. I will update my scripts to not feed py_compile module with file names containing dot (and remove already generated .pyc files if such files are detected), but please do not generate them or generate .pyc files with invalid file names as well.
msg231866 - (view) Author: Piotr Ożarowski (piotr) Date: 2014-11-29 18:02
Python 3.2 generates foo.bar.cpython-32.pyc so it's a regression
msg231905 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2014-11-30 21:03
And, therefore, a missing test :(. This probably snuck in when we refactored the CLI.
msg231940 - (view) Author: Matthias Klose (doko) * (Python committer) Date: 2014-12-01 15:30
seen as well with 3.3
msg231944 - (view) Author: Matthias Klose (doko) * (Python committer) Date: 2014-12-01 16:06
proposed patch: diff -r 8dacb1a21793 Lib/importlib/_bootstrap.py --- a/Lib/importlib/_bootstrap.py Fri Nov 28 13:15:41 2014 +0100 +++ b/Lib/importlib/_bootstrap.py Mon Dec 01 17:05:00 2014 +0100 @@ -453,7 +453,7 @@ else: suffixes = OPTIMIZED_BYTECODE_SUFFIXES head, tail = _path_split(path) - base_filename, sep, _ = tail.partition('.') + base_filename, sep, _ = tail.rpartition('.') tag = sys.implementation.cache_tag if tag is None: raise NotImplementedError('sys.implementation.cache_tag is None')
msg231946 - (view) Author: Barry A. Warsaw (barry) * (Python committer) Date: 2014-12-01 16:31
I'll take this one. I think it should be easy to add a test case, which I'll do.
msg231956 - (view) Author: Barry A. Warsaw (barry) * (Python committer) Date: 2014-12-01 21:59
Not counting importlib.h, here's the diff I'm going to apply to 3.4. It passes all the existing tests and includes a new test for this behavior.
msg231963 - (view) Author: Roundup Robot (python-dev) (Python triager) Date: 2014-12-01 23:17
New changeset 269bf37a57a1 by Barry Warsaw in branch '3.4': - Issue #22966: Fix __pycache__ pyc file name clobber when pyc_compile is https://hg.python.org/cpython/rev/269bf37a57a1 New changeset 3b3ba38d503a by Barry Warsaw in branch '3.4': - Issue #22966: Fix __pycache__ pyc file name clobber when pyc_compile is https://hg.python.org/cpython/rev/3b3ba38d503a New changeset 25113281d543 by Barry Warsaw in branch 'default': - Issue #22966: Fix __pycache__ pyc file name clobber when pyc_compile is https://hg.python.org/cpython/rev/25113281d543
msg232010 - (view) Author: Brett Cannon (brett.cannon) * (Python committer) Date: 2014-12-02 16:08
Apparently this broke under Windows: http://buildbot.python.org/all/builders/x86%20Windows7%203.x/builds/8999/steps/test/logs/stdio
msg232027 - (view) Author: Barry A. Warsaw (barry) * (Python committer) Date: 2014-12-02 17:12
I already pushed a fix. http://buildbot.python.org/all/builders/AMD64%20Windows7%20SP1%203.4/builds/702/steps/test/logs/stdio (although asyncio is still failing there but that should be unrelated)
History
Date User Action Args
2022-04-11 14:58:10 admin set github: 67155
2014-12-02 17:12:20 barry set status: open -> closedmessages: +
2014-12-02 16:57:36 Arfrever set nosy: + Arfrever
2014-12-02 16:08:59 brett.cannon set status: closed -> openmessages: +
2014-12-02 02:06:46 berker.peksag set stage: patch review -> resolved
2014-12-01 23:19:48 barry set status: open -> closedresolution: fixed
2014-12-01 23:17:54 python-dev set nosy: + python-devmessages: +
2014-12-01 21:59:18 barry set files: + 22966.txtmessages: +
2014-12-01 16:32:50 barry set versions: + Python 3.5
2014-12-01 16:31:41 barry set assignee: barrymessages: +
2014-12-01 16:06:05 doko set messages: + stage: test needed -> patch review
2014-12-01 15:30:26 doko set keywords: + 3.3regression, 3.4regressionnosy: + dokomessages: +
2014-11-30 21:03:41 r.david.murray set nosy: + r.david.murraymessages: +
2014-11-29 18:02:01 piotr set messages: +
2014-11-29 17:22:30 barry set nosy: + barry
2014-11-29 14:33:31 brett.cannon set nosy: + brett.cannon
2014-11-29 14:33:15 brett.cannon set type: behaviorcomponents: + Library (Lib)stage: test needed
2014-11-29 10:16:42 piotr create