Issue 13637: binascii.a2b_* functions could accept unicode strings (original) (raw)

Created on 2011-12-19 16:30 by pitrou, last changed 2022-04-11 14:57 by admin. This issue is now closed.

Files
File name Uploaded Description Edit
binasciistr.patch pitrou,2011-12-20 08:57 review
fix_doc_binascii_unhexlify.patch vajrasky,2013-11-02 04:42 review
better_error_message_binascii.patch vajrasky,2013-11-02 13:43 review
fix_doc_binascii_unhexlify.v2.patch martin.panter,2015-02-08 04:43 review
fix_doc_binascii_unhexlify.v3.patch martin.panter,2015-02-14 00:12 review
Messages (20)
msg149876 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2011-12-19 16:30
a2b_hex and friends accept only byte strings: >>> binascii.a2b_hex(b'00') b'\x00' >>> binascii.a2b_hex('00') Traceback (most recent call last): File "", line 1, in TypeError: 'str' does not support the buffer interface But they could just as well accept ASCII-only unicode strings. Also, with PEP 393, accessing the 8-bit ASCII data doesn't even need a conversion.
msg149905 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2011-12-20 08:57
Here is a patch.
msg149911 - (view) Author: Roundup Robot (python-dev) (Python triager) Date: 2011-12-20 13:00
New changeset eb8d62706d5f by Antoine Pitrou in branch 'default': Issue #13637: "a2b" functions in the binascii module now accept ASCII-only unicode strings. http://hg.python.org/cpython/rev/eb8d62706d5f
msg149913 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2011-12-20 13:08
Committed now.
msg153829 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2012-02-21 01:11
I disagree with this feature. Reopening pending discussion on python-dev.
msg154265 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2012-02-25 15:40
Discussion resolved in favor of patch.
msg154964 - (view) Author: Luke-Jr (luke-jr) Date: 2012-03-05 17:19
Has this been fixed in 3.2 yet? Somehow it seems to have been "reclassified" as an enhancement when it's really a regression. str worked fine in these functions in 3.1.
msg155001 - (view) Author: Arfrever Frehtes Taifersar Arahesis (Arfrever) * (Python triager) Date: 2012-03-06 05:47
I confirm that it works in Python 3.1 and doesn't work in Python 3.2.
msg201963 - (view) Author: Vajrasky Kok (vajrasky) * Date: 2013-11-02 04:42
Antoine, I think you forgot to update the doc. http://docs.python.org/3.4/library/binascii.html#binascii.unhexlify Changed in version 3.2: Accept only bytestring or bytearray objects as input. Attached the patch to update the doc to reflect the changes in this ticket.
msg201972 - (view) Author: Vajrasky Kok (vajrasky) * Date: 2013-11-02 13:43
Here is another patch to better the error message. Right now, the error message when wrong input sent to unhexlify is a little bit funny. >>> import binascii >>> binascii.unhexlify(3) Traceback (most recent call last): File "", line 1, in TypeError: argument should be bytes, buffer or ASCII string, not <class 'int'> After patch: >>> import binascii >>> binascii.unhexlify(3) Traceback (most recent call last): File "", line 1, in TypeError: argument should be bytes, buffer or ASCII string, not int
msg202181 - (view) Author: Martin Panter (martin.panter) * (Python committer) Date: 2013-11-05 00:08
The a2b_qp() function also documents a byte string restriction for 3.2, and now 3.3 also seems to support ASCII-compatible text strings. Maybe the documentation should reflect this also?
msg235545 - (view) Author: Martin Panter (martin.panter) * (Python committer) Date: 2015-02-08 04:43
The error fix patch looks good. I updated the doc patch as fix_doc_binascii_unhexlify.v2.patch, which also clarifies a2b_qp(), and restores the description of Python 3.2 not allowing text strings.
msg235931 - (view) Author: Berker Peksag (berker.peksag) * (Python committer) Date: 2015-02-13 23:55
The binascii documentation already says ``a2b_*`` functions accept Unicode strings containing only ASCII characters. [...] .. versionchanged:: 3.3 ASCII-only unicode strings are now accepted by the ``a2b_*`` functions. I think we can just remove versionchanged directives in fix_doc_binascii_unhexlify.v2.patch.
msg235934 - (view) Author: Martin Panter (martin.panter) * (Python committer) Date: 2015-02-14 00:12
That’s another option. Someone might wonder why a2b_hex() and a2b_qp() actually accept text strings in Python 3.1 when the documentation says you need 3.3, but I guess that’s not such a big deal. Posting patch v3 which removes the 3.2 notices.
msg235996 - (view) Author: Roundup Robot (python-dev) (Python triager) Date: 2015-02-14 22:05
New changeset 8d32453dd0f7 by Berker Peksag in branch '3.4': Issue #13637: Remove outdated versionchanged directives. https://hg.python.org/cpython/rev/8d32453dd0f7 New changeset d3ca674cf716 by Berker Peksag in branch 'default': Issue #13637: Remove outdated versionchanged directives. https://hg.python.org/cpython/rev/d3ca674cf716
msg236000 - (view) Author: Roundup Robot (python-dev) (Python triager) Date: 2015-02-14 22:31
New changeset ad4a8176a71a by Berker Peksag in branch '3.4': Issue #13637: Improve exception message of a2b_* functions. https://hg.python.org/cpython/rev/ad4a8176a71a New changeset 55f5e960cc40 by Berker Peksag in branch 'default': Issue #13637: Improve exception message of a2b_* functions. https://hg.python.org/cpython/rev/55f5e960cc40
msg236001 - (view) Author: Berker Peksag (berker.peksag) * (Python committer) Date: 2015-02-14 22:33
Thank you to both Vajrasky and Martin.
msg236373 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2015-02-21 16:30
I think this doc change was incorrect. The current document is supposed to provide the correct historical information. So "changed in 3.3: accept ASCII input" (and just ignore the fact that 3.1 also accepted ascii, since we pretty much prefer to ignore the existence of 3.0 and 3.1 :) would be the better choice, IMO.
msg236390 - (view) Author: Martin Panter (martin.panter) * (Python committer) Date: 2015-02-21 21:38
If I understand what you are saying, you don’t mind not mentioning 3.1 behaviour, but want to mention 3.2 behaviour. Perhaps the existing “Note” box at the top of the page is good enough for you, as pointed out in <http://bugs.python.org/issue13637#msg235931>.
msg236395 - (view) Author: R. David Murray (r.david.murray) * (Python committer) Date: 2015-02-22 00:17
Ah, yes, I see. Sorry for the confusion, I misread that part of the discussion and did not look at that part of the docs. (I find that note confusing...it seems to imply that a2b only accepts ascii. But that's a different issue and I don't feel strongly enough about it to open one :)
History
Date User Action Args
2022-04-11 14:57:24 admin set github: 57846
2015-02-22 00:17:47 r.david.murray set messages: +
2015-02-21 21:38:31 martin.panter set messages: +
2015-02-21 16:30:26 r.david.murray set messages: +
2015-02-14 22:33:10 berker.peksag set status: open -> closedresolution: fixedmessages: + stage: resolved
2015-02-14 22:31:08 python-dev set messages: +
2015-02-14 22:05:39 python-dev set messages: +
2015-02-14 00:12:59 martin.panter set files: + fix_doc_binascii_unhexlify.v3.patchmessages: +
2015-02-13 23:55:31 berker.peksag set nosy: + berker.peksagmessages: +
2015-02-08 04:43:30 martin.panter set files: + fix_doc_binascii_unhexlify.v2.patchnosy: + docs@pythonmessages: + assignee: docs@pythoncomponents: + Documentation
2013-11-05 00:08:44 martin.panter set nosy: + martin.pantermessages: +
2013-11-02 13:43:42 vajrasky set files: + better_error_message_binascii.patchmessages: +
2013-11-02 04:42:35 vajrasky set files: + fix_doc_binascii_unhexlify.patchnosy: + vajraskymessages: +
2012-03-06 05:47:37 Arfrever set status: closed -> opentype: enhancement -> behaviornosy: + Arfrevermessages: + resolution: fixed -> (no value)stage: resolved -> (no value)
2012-03-05 17:19:25 luke-jr set nosy: + luke-jrmessages: +
2012-02-25 15:40:46 r.david.murray set status: open -> closedmessages: +
2012-02-21 01:11:27 r.david.murray set status: closed -> opennosy: + r.david.murraymessages: +
2011-12-20 13:09:24 pitrou set status: open -> closed
2011-12-20 13:08:10 pitrou set resolution: fixedmessages: + stage: patch review -> resolved
2011-12-20 13:00:54 python-dev set nosy: + python-devmessages: +
2011-12-20 08:57:35 pitrou set files: + binasciistr.patchkeywords: + patchmessages: + stage: needs patch -> patch review
2011-12-19 16:30:44 pitrou create