[Python-Dev] urllib performance issue on FreeBSD 4.x (original) (raw)

Fredrik Lundh fredrik@pythonware.com
Sun, 24 Nov 2002 13:49:02 +0100

Guido wrote:

> Without this patch, d/l a 4MB file from localhost gets a bit over 110kB/s, > with the patch gets 4-5.5MB/s on the same system > > - why is the socket.fp being set to unbuffered?

I can't make time for a full essay on the issue, but I believe that it must be unbuffered because some applications want to read until the end of the headers and then pass the file descriptor to a subprocess or to code that uses the socket directly.

sounds like it would be a good idea to provide a subclass (or option) for applications that don't need that feature.