5,756 open-source and SaaS tools, with GitHub stats refreshed every day.

Pgloader

Open source

pgloader is a command-line data loading and migration tool for PostgreSQL that imports from MySQL, SQLite, SQL Server, CSV and other sources.

pgloader.io
Pgloader homepage screenshot
GitHub stars
6.5k
Last commit
18 days ago
Repository age
16 years
Version
v3.6.9
Licence
Custom
Self-hosted
Yes

About Pgloader

pgloader loads data into PostgreSQL using the COPY protocol while handling bad rows gracefully. A plain COPY aborts the whole table load when a single line is invalid. pgloader instead writes rejected records to a separate file and keeps loading the good ones, which makes large imports from messy data far less painful.

Beyond loading, it reformats data on the way in, for example converting MySQL zero dates into proper NULL values. It can read flat files such as CSV, IXF and dBase files, and it can read directly from other databases including MySQL, SQL Server and SQLite, so migrating a whole schema along with its data can be done with a single command. The tool is written in Common Lisp.

pgloader is open source, though its license shows as 'Other' in the repository metadata. It runs on your own machine or server as a command-line program, and there is no hosted version. It suits database administrators and developers moving to PostgreSQL or regularly importing external data.

Key features

  • Bulk loading into PostgreSQL via COPY
  • Rejected rows saved to a separate file
  • Data reformatting during load
  • Direct migration from MySQL, SQL Server and SQLite
  • CSV, IXF and dBase file imports
  • Single-command database migrations

Good fit for

  • →Migrating a MySQL database to PostgreSQL
  • →Importing large CSV files with dirty rows
  • →Moving SQLite data into Postgres
Tags
postgresql
migration
etl
mysql
sqlite
csv
cli

Open-source alternatives to Pgloader

See all

SaaS alternatives to Pgloader

See all