[NEW FEATURE] - Data Importer · Issue #6 · datawan-labs/pg (original) (raw)

Skip to content

Navigation Menu

• • GitHub Copilot Write better code with AI
  • GitHub Advanced Security Find and fix vulnerabilities
  • Actions Automate any workflow
  • Codespaces Instant dev environments
  • Issues Plan and track work
  • Code Review Manage code changes
  • Discussions Collaborate outside of code
  • Code Search Find more, search less
• Explore
  • Learning Pathways
  • Events & Webinars
  • Ebooks & Whitepapers
  • Customer Stories
  • Partners
  • Executive Insights
• • GitHub Sponsors Fund open source developers
  • The ReadME Project GitHub community articles
• • Enterprise platform AI-powered developer platform
• Pricing

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sign up

Description

we want to develop new feature to import raw data, like excel, csv, or maybe parquet to postgresql. and here the design that I think match to this project (if you have another approach, let me know).

1. first we need multi data source importer, this will import any data source like csv, excel, or another format to javascript object, the data and the column information. we can add more source as long we can import it to same format.
2. then with that data and column information, we can build simple DDL and DML to create query to create the table also insert all rows to new table.
3. run query

this just simple design, in the UI we can add features like raw data viewer, query and column editor before import the data.

reference

• https://www.convertcsv.com/csv-to-sql.htm