Issue 18337: codecs: StremReader readline() breaks on undocumented characters (original) (raw)

Issue18337

➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

This issue has been migrated to GitHub: https://github.com/python/cpython/issues/62537

classification

process

Created on 2013-07-01 07:30 by guettli, last changed 2022-04-11 14:57 by admin. This issue is now closed.

Messages (2)
msg192112 - (view)	Author: Thomas Guettler (guettli) *	Date: 2013-07-01 07:30
The stream reader of codecs.open() breaks on undocumented characters: http://docs.python.org/2/library/codecs.html?highlight=codecs%20readline#codecs.StreamReader.readline import tempfile temp=tempfile.mktemp() fd=open(temp, 'wb') fd.write('abc\ndef\x85ghi') fd.close() import codecs fd=codecs.open(temp, 'rb', 'latin1') while True: line=fd.readline() if not line: break print repr(line) Result: u'abc\n' u'def\x85' u'ghi' Related: http://stackoverflow.com/questions/16227114/utf-8-files-read-in-python-will-line-break-at-character-x85
msg192117 - (view)	Author: Serhiy Storchaka (serhiy.storchaka) *	Date: 2013-07-01 09:36
Thank you for your report. This is a duplicate of .