Issue 3761: urllib.request and urllib.response cannot handle HTTP1.1 chunked encoding (original) (raw)

Hi, fairly new to Python, so not sure if this is something you want as a behaviour or not:

urllib.response object when fetching an HTTP1.1 page does not transparently handle "Transfer-Encoding": "chunked", and I think it should.

You can view source code for addinfourl, AbstractHTTPHandler and HTTPHandler to verify this (sorry, I don't have line-numbers, I'm typing this at home).

I would suggest extending addinfourl to "addinfourlchunked", for example, to allow substitutes for fp.read(), readlines() and readline() to be specified during the construction of addinfourl.

This threw me initially, and seems like quite a glareing omission for newbies.

Cheers,

Chris