[Python-Dev] What does a double coding cookie mean? (original) (raw)

Serhiy Storchaka storchaka at gmail.com
Thu Mar 17 10:02:55 EDT 2016


On 17.03.16 15:14, M.-A. Lemburg wrote:

On 17.03.2016 01:29, Guido van Rossum wrote:

Should we recommend that everyone use tokenize.detectencoding()? I'd prefer a separate utility for this somewhere, since tokenize.detectencoding() is not available in Python 2. I've attached an example implementation with tests, which works in Python 2.7 and 3.

Sorry, but this code doesn't match the behaviour of Python interpreter, nor other tools. I suggest to backport tokenize.detect_encoding() (but be aware that the default encoding in Python 2 is ASCII, not UTF-8).



More information about the Python-Dev mailing list