#1
An Apache workflow orchestration platform where data teams author, schedule and monitor pipelines as Python code, widely used for data engineering and ELT jobs.
- GitHub stars
- 47k
- Last commit
- today
- Latest release
- 3.4.0
- Licence
- Apache-2.0
- Self-hosted
- Yes
airflow.apache.org
Apache Airflow is a workflow platform where you write, schedule and watch over pipelines in code. Workflows are defined as Python code in the form of directed acyclic graphs, or DAGs, where each task and its dependencies are explicit, so pipelines can be versioned, tested and reviewed like any other software.
A scheduler runs tasks on a defined cadence and workers execute them, while a web interface shows the status of each run, lets you inspect logs and retry failures. Airflow is used heavily in data engineering, including data integration, ELT and ETL pipelines, data orchestration and machine learning workflows, and its topics cover data science and automation. It has a large ecosystem of providers and operators for connecting to databases, cloud services and other systems, and the 3.x line is the current series.
Airflow is an Apache Software Foundation project under the Apache-2.0 license and runs on your own infrastructure, from a single machine to Kubernetes. Several vendors offer managed Airflow services, but the project itself is self-hosted software. It suits data engineers who prefer code-first orchestration over drag-and-drop tools.
Key features
- Workflows defined as Python DAGs
- Scheduler for recurring and dependent tasks
- Web UI for monitoring runs and logs
- Retries and task dependency management
- Large provider ecosystem of integrations
- Runs on single machines or Kubernetes
Pricing: Free and open source under the Apache-2.0 license.
#2
Apache Kafka is an open-source platform for distributed event streaming, used in data pipelines, streaming analytics and data integration.
- GitHub stars
- 34k
- Last commit
- yesterday
- Licence
- Apache-2.0
- Self-hosted
- Yes
kafka.apache.org
Apache Kafka is a platform for distributed event streaming. Teams use it to move and process streams of events for data pipelines, streaming analytics, data integration and business-critical applications. The code lives in the Apache Software Foundation repository, is written mainly in Java with Scala for parts of the broker, and is released under the Apache-2.0 license.
Kafka is installed software that you run yourself. The project builds and tests against recent Java versions, supports Scala 2.13 only, and documents how to build a JAR and start a broker through its quickstart. The repository also contains client and streams modules, along with test tooling for unit and integration runs. Because Kafka is operated as infrastructure, adopters typically run clusters on their own servers or on Kubernetes, though managed services from other vendors exist.
Key features
- Distributed event streaming platform
- Durable publish and subscribe topics
- Client libraries and a streams module
- Suited to data pipelines and integration
- Runs on Java with Scala 2.13
- Quickstart for building and running a broker
Pricing: Free and open source under the Apache-2.0 license.
#3
A Python workflow orchestration framework for turning scripts into resilient, observable data pipelines with scheduling, retries, caching and event-driven automation.
- GitHub stars
- 24k
- Last commit
- today
- Latest release
- 3.9.2
- Licence
- Apache-2.0
- Self-hosted
- Yes
- Hosted version
- Available
prefect.io
Prefect is a Python framework for orchestrating workflows and building data pipelines. It aims to be the simplest way to lift an ordinary script into a production workflow: you add flow and task decorators, and Prefect adds the machinery that makes pipelines dependable and visible.
That machinery includes scheduling, caching, retries and event-based automations, and flows can express dependencies and complex branching logic. The goal is dynamic pipelines that react to changes in the world and recover from unexpected failures. Run activity is tracked, and you can monitor it from a self-hosted Prefect server or from the managed Prefect Cloud dashboard. Prefect requires Python 3.10 or newer, and the documentation covers installation, quickstart, building and deploying workflows and agent setup.
Prefect is licensed under Apache-2.0. Topics list data engineering, ML ops and observability among its uses. It is aimed at data teams who prefer to write workflows as plain Python code, and who want a choice between running the orchestrator themselves or using a hosted control plane.
Key features
- Flows and tasks defined with Python decorators
- Scheduling and event-based automations
- Automatic retries and caching
- Complex branching and dependencies
- Self-hosted server or Prefect Cloud monitoring
- Deployment of workflows to infrastructure
Pricing: Prefect Cloud's Hobby tier is free. Starter is $100 per month and Team $100 per user per month, both billed monthly; Enterprise is custom and billed annually.
#4
An open-source data movement platform with hundreds of connectors for ELT pipelines from APIs, databases and files into warehouses, lakes and AI applications.
- GitHub stars
- 22k
- Last commit
- today
- Latest release
- v2.0.0
- Self-hosted
- Yes
- Hosted version
- Available
airbyte.com
Airbyte is an open-source data movement platform for moving data from APIs, databases and files into data warehouses, data lakes and AI applications. Its premise is that only an open-source project can reach the long tail of data sources while letting engineers tailor existing connectors, with the aim of moving data from any source to any destination.
It offers a catalog of 600 or more connectors for APIs, databases, warehouses, lakes and AI applications, with warehouse destinations such as BigQuery, Redshift and Snowflake, and topics also mention change data capture. The README distinguishes products by job: Airbyte Open Source or Airbyte Cloud for ELT and ETL into warehouses, lakes or databases, and Airbyte Agents, a managed data and context layer, plus an open-source Agent SDK for giving AI agents and MCP clients real-time access to business data.
Airbyte is written in Python and Java, and its license is listed as 'Other' on GitHub because the project uses a mix of licenses, so review the terms for your use. It can be self-hosted or run as the managed Airbyte Cloud, and suits data teams that need many integrations without writing each pipeline by hand.
Key features
- 600+ source and destination connectors
- ELT pipelines into warehouses and lakes
- Change data capture support
- Customizable open-source connectors
- Agent SDK for AI agent data access
- Self-hosted or Airbyte Cloud
Pricing: The open-source Core edition is free to self-host. Managed cloud starts at $20 a month (Standard) or $189 a month for 40 credits (Plus); Pro and Enterprise Flex are custom. 30-day trial.
#5
A Python data orchestration platform for building, scheduling and observing data pipelines around the data assets they produce; Dagster is now part of Prefect.
- GitHub stars
- 16k
- Last commit
- today
- Latest release
- 1.13.30
- Licence
- Apache-2.0
- Self-hosted
- Yes
- Hosted version
- Available
dagster.io
Dagster is an orchestration platform for developing, running and observing data assets. Instead of thinking only in terms of tasks, teams define the tables, files and models their pipelines produce, and Dagster tracks how they are built, scheduled and monitored. It is written in Python and aimed at data engineering, analytics and machine learning workloads.
The product surface covers data orchestration, a data catalog, data quality checks, cost insights and many integrations, with an enterprise offering for larger organizations. Comparison pages on the website position it against Airflow, dbt Cloud, Azure Data Factory and AWS Step Functions, and topics include ETL, scheduling and MLOps. The homepage now announces that Dagster is part of Prefect, and points visitors looking for agentic orchestration or MCP support to Prefect.
The open-source core is Apache-2.0 licensed and can be self-hosted, while a managed cloud and enterprise plans are offered with pricing on the company site. Dagster University and documentation help with learning. It suits data teams that want a software-engineering-style approach to pipelines.
Key features
- Asset-centric data orchestration
- Scheduling and monitoring of pipelines
- Data catalog and data quality features
- Cost insights for pipelines
- Integrations with common data tools
- Pipelines developed in Python
Pricing: Dagster+ Solo is $10 and Starter $100 per month, each plus per-credit usage charges, with a 30-day free trial. Pro is quoted through sales.
#6
A data transformation framework that lets analysts and engineers build analytics models with software-engineering practices; v2.0 is a ground-up rewrite in Rust.
- GitHub stars
- 14k
- Last commit
- today
- Latest release
- v1.12.7
- Licence
- Apache-2.0
- Self-hosted
- Yes
- Hosted version
- Available
getdbt.com
dbt is a framework for transforming data in a warehouse using the same practices that software engineers apply to applications. Analysts and analytics engineers write models, and dbt parses, compiles and runs the project so that transformations are version-controlled and repeatable.
The repository now holds the Apache 2.0 source of dbt v2.0, a ground-up rewrite in Rust. According to its README, v2.0 parses and compiles projects much faster than v1, enforces a stricter language specification at parse time, produces Parquet artifacts alongside the existing JSON ones, and ships as one standalone executable, so no Python installation is needed. The local documentation experience was rebuilt around those artifacts to handle large projects.
The Apache 2.0 code is available to everyone, while the packaged dbt distribution adds dbt-specific customizations under a separate dbt product license. v2.0 supports macOS and Linux on x86-64 and ARM. The v1 Python implementation continues on the 1.latest branch. dbt Labs also offers dbt as a commercial cloud platform.
Key features
- Data transformation using software engineering practices
- Faster parsing and compiling in v2.0
- Strict language specification checks at parse time
- Parquet artifacts for querying project metadata
- Single binary without a Python runtime
- Rebuilt local documentation experience
Pricing: A single-seat Developer plan to start free. Starter costs $100 per user per month; Enterprise and Enterprise+ are custom. A trial is available and add-ons are billed on usage.
#7
An open-source change data capture platform that streams row-level database changes as events to Kafka and other consumers with low latency.
- GitHub stars
- 13k
- Last commit
- yesterday
- Licence
- Apache-2.0
- Self-hosted
- Yes
debezium.io
Debezium is an open-source platform for change data capture. You configure it to monitor your databases, and your applications then consume an event for each row-level change. Only committed changes are visible, so consumers do not need to deal with transactions that are rolled back.
It provides one consistent model for change events across different database systems, so applications are insulated from the details of each engine. Changes are recorded in durable, replicated logs, which means a consumer can be stopped and restarted and still receive every event it missed. This removes the need for database-specific triggers or ad hoc change-monitoring code, which the project describes as hard to get right when ordering and low impact on the database both matter.
Debezium is built with Java and Kafka Connect in mind, as the project topics show, and is licensed under Apache-2.0, with the ANTLR grammars in its DDL parser module under the MIT licence. It runs as part of your own data infrastructure and suits data engineers building event streaming pipelines, cache invalidation or data replication.
Key features
- Row-level change data capture from databases
- Single event model across database types
- Only committed changes are exposed
- Durable, replicated change logs
- Restartable consumers that catch up on missed events
- Kafka Connect based modules
Pricing: Free and open source under the Apache-2.0 licence.
#8
Apache Beam is an open-source programming model for batch and streaming data processing whose pipelines run on multiple execution engines.
- GitHub stars
- 8.7k
- Last commit
- yesterday
- Latest release
- v2.77.0
- Licence
- Apache-2.0
beam.apache.org
Apache Beam provides a single programming model for both batch and streaming data processing. Pipelines read from a range of supported sources, apply business logic, and write results to common data sinks. Quickstarts are offered for Java, Python and Go.
Beam pipelines can execute on multiple execution environments, called runners, which the project presents as a way to avoid lock-in. It is extensible, with projects such as TensorFlow Extended and Apache Hop built on top of it, and it supports multi-language pipelines. The Beam Playground lets people try transforms and examples without installing anything locally.
The project publishes case studies from several organisations. LinkedIn is described as running streaming infrastructure on Beam, OCTO used it to move a French grocery retailer to streaming processing of transactional data, HSBC used it as a computational platform and risk engine, and Booking.com uses it for global ad bidding. The site also invites other users to share their own story.
Key features
- One programming model for batch and streaming
- Pipelines run on several runners
- Reads from many sources on-prem or in the cloud
- Extended by projects such as TensorFlow Extended
- Interactive Beam Playground
#9
An open-source ETL and ELT platform built on DuckDB that you deploy yourself, with visual or SQL pipelines, dbt, CDC, data quality and an MCP server.
- GitHub stars
- 1.6k
- Last commit
- today
- Latest release
- v0.8.0
- Licence
- Apache-2.0
- Self-hosted
- Yes
duckle.org
Duckle is an open-source ETL and ELT platform for teams that want their data pipelines running on their own infrastructure. You build pipelines on a visual canvas, in Python or in SQL, then ship the same file to your own server or cloud account, where a headless runner executes it on a schedule.
Pipelines compile to SQL on DuckDB and use all the cores available, so a larger machine runs them faster. The platform lists support for a large catalog of components, dbt, change data capture, data quality checks, reverse ETL and lineage, along with a web console, roles, an audit trail and an MCP server so AI agents such as Claude or Cursor can work with it. Each pipeline is a single file that can live in git.
Duckle is written in Rust and licensed under Apache-2.0, and it runs headless in Docker or on a plain server, with Kubernetes among its topics. It states there is no vendor cloud and no per-row billing. It is an independent project by SlothFlowLabs and is not affiliated with DuckDB Labs or MotherDuck. It suits data engineers who want a self-hosted alternative to managed pipeline services.
Key features
- Visual canvas, Python, or SQL pipeline authoring
- Runs on DuckDB across all CPU cores
- dbt, CDC, and reverse ETL support
- Data quality checks and lineage
- Web console with roles and audit trail
- MCP server for AI agents
Pricing: Free and open source under the Apache-2.0 licence, with no vendor cloud or per-row billing according to the README.
#10
Mage is an open-source data pipeline tool for building, scheduling and debugging ETL and transformation jobs in Python, SQL or R through a notebook-style UI.
- GitHub stars
- 8.8k
- Last commit
- 20 days ago
- Latest release
- 0.9.80
- Licence
- Apache-2.0
- Self-hosted
- Yes
- Hosted version
- Available
mage.ai
Mage, called Mage OSS in its README, is a self-hosted development environment for building data pipelines. It is meant for teams that automate ETL tasks, design data flows or orchestrate transformations, and it presents the work in a notebook-style interface made of modular blocks of code.
Pipelines are written block by block in Python, SQL or R. Jobs can be run manually or on a schedule, including cron expressions, and prebuilt connectors reach databases, APIs and cloud storage. Debugging is visual, with logs, live data previews and execution you can follow step by step, and dbt models can be built and run inside Mage. Topics on the repository also reference Spark, reverse ETL and machine learning workloads.
Mage OSS is licensed under Apache-2.0 and installs with Docker, pip or conda, with no cloud account required. For larger deployments the vendor offers Mage Pro, a commercial platform that adds enterprise orchestration, collaboration and AI-assisted workflows.
Key features
- Modular pipelines in Python, SQL or R
- Notebook-style interactive editor
- Prebuilt connectors for databases, APIs and storage
- Manual and cron-based scheduling
- Visual debugging with logs and previews
- dbt model support inside pipelines
Pricing: Managed Mage starts at $29 per month (Starter) and $100 per month (Team), plus $0.50 per CPU-hour, with a 7-day free trial. Enterprise is by contract.
3 more Hevo Data alternatives
Hevo Data alternatives: questions
- What is the best open-source alternative to Hevo Data?
- Airflow is the top-ranked open-source alternative to Hevo Data on Enlisted: An Apache workflow orchestration platform where data teams author, schedule and monitor pipelines as Python code, widely used for data engineering and ELT jobs. Other strong options are Kafka, Prefect, Airbyte and Dagster.
- What are the best commercial alternatives to Hevo Data?
- Dataddo, Estuary, Keboola, Rivery and Stitch are among the hosted, closed-source alternatives to Hevo Data listed on Enlisted, which lists 23 in total. Compare their pricing and features on each tool page.
- Are these Hevo Data alternatives free?
- All 13 are open source, so the code is free to use under its licence, and all of them can be self-hosted on your own server or computer. 5 also offer a paid or managed cloud version if you'd rather not host it yourself.
- How is this list of Hevo Data alternatives ranked?
- By a score built from GitHub stars, star growth over the last 30 days and how recently the code changed. 12 of these projects shipped code in the last 30 days. Data is refreshed daily, and nobody can pay to move up.