Kafka
Apache Kafka is an open-source platform for distributed event streaming, used in data pipelines, streaming analytics and data integration.
- GitHub stars
- 34k
- Last commit
- today
- Licence
- Apache-2.0
- Self-hosted
- Yes
Apache Kafka is a platform for distributed event streaming. Teams use it to move and process streams of events for data pipelines, streaming analytics, data integration and business-critical applications. The code lives in the Apache Software Foundation repository, is written mainly in Java with Scala for parts of the broker, and is released under the Apache-2.0 license.
Kafka is installed software that you run yourself. The project builds and tests against recent Java versions, supports Scala 2.13 only, and documents how to build a JAR and start a broker through its quickstart. The repository also contains client and streams modules, along with test tooling for unit and integration runs. Because Kafka is operated as infrastructure, adopters typically run clusters on their own servers or on Kubernetes, though managed services from other vendors exist.
Key features
- Distributed event streaming platform
- Durable publish and subscribe topics
- Client libraries and a streams module
- Suited to data pipelines and integration
- Runs on Java with Scala 2.13
- Quickstart for building and running a broker
Pricing: Free and open source under the Apache-2.0 license.
