[Python-Dev] import too slow on NFS based systems (original) (raw)

Daniel Braniss danny at cs.huji.ac.il
Thu Jun 21 16:08:09 CEST 2012

On Thu, 21 Jun 2012 13:17:01 +0300 Daniel Braniss <danny at cs.huji.ac.il> wrote: > Hi, > when lib/python/site-packages/ is accessed via NFS, open/stat/access is very > expensive/slow. > > A simple solution is to use an in memory directory search/hash, so I was > wondering if this has been concidered in the past, if not, and I come > with a working solution for Unix (at least Linux/Freebsd) will it be > concidered.

There is such a thing in Python 3.3, although some stat() calls are still necessary to know whether the directory caches are fresh. Can you give it a try and provide some feedback?

WOW! with a sample python program:

in 2.7 there are: stats open 2736 9037 in 3.3 288 57

now I have to fix my 2.7 to work with 3.3 :-)

any chance that this can be backported to 2.7?

cheers, danny

More information about the Python-Dev mailing list