6,598 open-source and SaaS tools, with GitHub stats refreshed every day.

Mage AI

Open source

Mage is an open-source data pipeline tool for building, scheduling and debugging ETL and transformation jobs in Python, SQL or R through a notebook-style UI.

mage.ai
Mage AI homepage screenshot
GitHub stars
8.8k
Last commit
21 days ago
Repository age
4 years
Version
0.9.79
Licence
Apache-2.0
Self-hosted
Yes

About Mage AI

Mage, called Mage OSS in its README, is a self-hosted development environment for building data pipelines. It is meant for teams that automate ETL tasks, design data flows or orchestrate transformations, and it presents the work in a notebook-style interface made of modular blocks of code.

Pipelines are written block by block in Python, SQL or R. Jobs can be run manually or on a schedule, including cron expressions, and prebuilt connectors reach databases, APIs and cloud storage. Debugging is visual, with logs, live data previews and execution you can follow step by step, and dbt models can be built and run inside Mage. Topics on the repository also reference Spark, reverse ETL and machine learning workloads.

Mage OSS is licensed under Apache-2.0 and installs with Docker, pip or conda, with no cloud account required. For larger deployments the vendor offers Mage Pro, a commercial platform that adds enterprise orchestration, collaboration and AI-assisted workflows.

Key features

  • Modular pipelines in Python, SQL or R
  • Notebook-style interactive editor
  • Prebuilt connectors for databases, APIs and storage
  • Manual and cron-based scheduling
  • Visual debugging with logs and previews
  • dbt model support inside pipelines

Good fit for

  • →Building ETL pipelines locally
  • →Orchestrating data transformations
  • →Running dbt models on a schedule
Built with
Python
Tags
etl
data-pipelines
orchestration
python
dbt
data-engineering
self-hosted
sql

Open-source alternatives to Mage AI

See all

SaaS alternatives to Mage AI

See all