memory error when skipping rows · Issue #8681 · pandas-dev/pandas (original) (raw)
I have a file with over 100Million rows. When I do
pd.read_csv(filename, skiprows=100000000, iterator=True)
python crashes with a memory error. I have 32 gigs of memory and python eats up all that memory!!