[Python-Dev] CHUNKSIZE (original) (raw)

Michael Gilfix mgilfix@eecs.tufts.edu
Sat, 27 Apr 2002 13:12:13 -0400

This comment is more of a question.. Does the chunksize not have to do with how the filesystem stores blocks? I think it's better to retrieve in blocks that best match the size of the filesystem. So 8K would make sense since many FS's have 4K chunks and many have 16K chunks, etc... I'm probably totally wrong so someone please tell me why :)

On Sat, Apr 27 @ 10:07, Paul Prescod wrote:

xreadlines' default CHUNKSIZE is 8K. minidom defaults to double that.

Have those values been keeping up with machine RAM inflation and should they? I presume others have thought this through but my probably-naive impression is that getting data in such little bytes is a waste of time on machines with tens or hundreds of megabytes of RAM.

-- Michael Gilfix mgilfix@eecs.tufts.edu

For my gpg public key: http://www.eecs.tufts.edu/~mgilfix/contact.html