df.info() incorrectly reports memory use for string data? · Issue #8578 · pandas-dev/pandas (original) (raw)

Skip to content

Navigation Menu

• • GitHub Copilot Write better code with AI
  • GitHub Advanced Security Find and fix vulnerabilities
  • Actions Automate any workflow
  • Codespaces Instant dev environments
  • Issues Plan and track work
  • Code Review Manage code changes
  • Discussions Collaborate outside of code
  • Code Search Find more, search less
• Explore
  • Learning Pathways
  • Events & Webinars
  • Ebooks & Whitepapers
  • Customer Stories
  • Partners
  • Executive Insights
• • GitHub Sponsors Fund open source developers
  • The ReadME Project GitHub community articles
• • Enterprise platform AI-powered developer platform
• Pricing

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sign up

Description

Doubling the string size does not change the reported memory use:

In [64]: d=pd.DataFrame(["%06d" %x for x in range(1000000)]) ...: d.info() <class 'pandas.core.frame.DataFrame'> Int64Index: 1000000 entries, 0 to 999999 Data columns (total 1 columns): 0 1000000 non-null object dtypes: object(1) memory usage: 15.3 MB

In [65]: d=pd.DataFrame(["%012d" %x for x in range(1000000)]) ...: d.info() <class 'pandas.core.frame.DataFrame'> Int64Index: 1000000 entries, 0 to 999999 Data columns (total 1 columns): 0 1000000 non-null object dtypes: object(1) memory usage: 15.3 MB