[Python-Dev] Lib/email/header.py ecre regular expression (original) (raw)

Jan Malakhovski jan.malachowski at gmail.com
Fri Jan 16 00:05:50 CET 2009

Hello.

Welcome message to this mail list said that it's good to tell a few words about myself. So, my name is Jan Malakhovski aka OXIj, I'm living in St. Petersburg, Russia, student of ITMO University, 4th year of education.

I have dedicated mail server at home and it holds about 1G of mail. Most of mail is in non UTF-8 codepage, so today I wrote little script that should recode all letters to UTF. But I found that email.header.decode_header parses some headers wrong.

For example, header Content-Type: application/x-msword; name="2008 =?windows-1251?B?wu7v8O7x+w==?= 2 =?windows-1251?B?4+7kIDgwONUwMC5kb2M=?=" parsed as [('application/x-msword; name="2008', None), ('\xc2\xee\xef\xf0\xee\xf1\xfb', 'windows-1251'), ('2 =?windows-1251?B?4+7kIDgwONUwMC5kb2M=?="', None)] that is obviously wrong.

Now I'm playing with email/header.py file in python 2.5 debian package (but it's same in 2.6.1 version except that all <> changed to !=).

If it's patched with ==================BEGIN CUT================== --- oldheader.py 2009-01-16 01:47:32.553130030 +0300 +++ header.py 2009-01-16 01:47:16.783119846 +0300 @@ -39,7 +39,6 @@ ? # literal ? (?P.*?) # non-greedy up to the next ?= is the encoded string ?= # literal ?=

Field name regexp, including trailing colon, but not separating whitespace,

==================END CUT================== it works fine.

So I wonder if this (?=[ \t]|$) # whitespace or the end of the string really needed, after all if there is only whitespaces after encoded word, its just appended to the list by

parts = ecre.split(line)

-- Jan

More information about the Python-Dev mailing list