Add option for default_charset to sql.write_frame · Issue #5008 · pandas-dev/pandas (original) (raw)

Skip to content

Navigation Menu

• • GitHub Copilot Write better code with AI
  • GitHub Advanced Security Find and fix vulnerabilities
  • Actions Automate any workflow
  • Codespaces Instant dev environments
  • Issues Plan and track work
  • Code Review Manage code changes
  • Discussions Collaborate outside of code
  • Code Search Find more, search less
• Explore
  • Learning Pathways
  • Events & Webinars
  • Ebooks & Whitepapers
  • Customer Stories
  • Partners
  • Executive Insights
• • GitHub Sponsors Fund open source developers
  • The ReadME Project GitHub community articles
• • Enterprise platform AI-powered developer platform
• Pricing

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sign up

Appearance settings

Description

Hi everybody,

I worked today with a lot of unicode data and deeply missed the option to define a default_charset when writing a dataframe to a new sql table. I did not know that pandas uses "latin-1" as default and ran into various strange encoding problems such as "Data too long for column" when inserting my unicode data. The exception was raised despite the explicit definition of utf-8 in the connection object.

As a workaround I created the table myself and let pandas only append the DataFrame. However, it would be much better if pandas could create the tables itself.

Best regards

Andy