Issue 1170272: [ast branch] unicode literal fixes (original) (raw)

Issue1170272

Created on 2005-03-25 00:19 by jpe, last changed 2022-04-11 14:56 by admin. This issue is now closed.

Files
File name Uploaded Description Edit
unicode.diff jpe,2005-03-25 00:19
Messages (2)
msg48051 - (view) Author: John Ehresman (jpe) * Date: 2005-03-25 00:19
Attached patch fixes test_eval by dealing with unicode input correctly. I'm also compiling tokenizer.c directly rather than tokenizer_pgen.c -- tokenizer_pgen.c simply defines PGEN and then includes tokenizer.c, which disables some of the unicode support. I don't think tokenizer_pgen.c is needed.
msg48052 - (view) Author: Neil Schemenauer (nascheme) * (Python committer) Date: 2005-04-02 19:00
Logged In: YES user_id=35752 Commited. Thanks for the patch.
History
Date User Action Args
2022-04-11 14:56:10 admin set github: 41753
2005-03-25 00:19:51 jpe create