SnappyData

Open source

Distributed in-memory analytics database built inside Apache Spark, also called TIBCO ComputeDB, now kept for legacy users.

Open-source alternative to

GitHub stars
1k
Last 30 days
+0
Last commit
3 yr ago
Repository age
11 years
Version
v1.3.1
Licence
Custom
Self-hosted
Yes

About SnappyData

SnappyData, also known as TIBCO ComputeDB, is a distributed analytics database optimised for memory. It places an in-memory hybrid database inside Apache Spark, which gives it analytic query processing, mutability and transactions, access to many big data sources, and stream processing in a single cluster. The GitHub description names Apache Spark and Apache Geode as its base.

Data can be discovered and catalogued from SQL databases, Hadoop, NoSQL stores, file systems and cloud stores such as S3, with schemas inferred automatically. You decide which datasets are loaded into distributed memory and which stay at the source, and can store in-memory data as a compressed columnar form or a row store. The columnar store gets a skipping index automatically; the row store takes indexes added by the application.

The README positions it as a computational and caching cluster that augments traditional warehouses and data lakes, not as another enterprise data warehouse. Transformations can be written with Spark SQL functions or Spark jobs in SQL, Java, Scala or Python, and Spark ML functions help prepare data for machine learning. The repository is now provided for legacy users and information only.

Key features

  • Discover datasets across SQL, Hadoop, NoSQL and S3
  • Many data formats supported out of the box
  • Any store with a Spark connector is reachable
  • Choose what lives in memory or stays at source
  • Compressed columnar store for large scans
  • Row store for key and selective access
  • Custom logic in SQL, Java, Scala or Python

Good fit for

  • Interactive analytics over large datasets
  • Ad-hoc visual analytics without pre-aggregation
  • Preparing data for machine learning with Spark
Built with
Scala tools
Tags
analytics
database
in-memory
apache-spark
streaming
sql
legacy

SnappyData: questions and answers

What is SnappyData used for?
SnappyData is a distributed in-memory analytics database built inside Apache Spark, also called TIBCO ComputeDB, now kept for legacy users. It is a good fit for interactive analytics over large datasets, ad-hoc visual analytics without pre-aggregation and preparing data for machine learning with Spark.
Is SnappyData open source?
Yes. SnappyData is open source under a custom licence. Its source code is on GitHub at TIBCOSoftware/snappydata and is written mainly in Scala.
Is SnappyData free?
Yes. SnappyData is open source, so the software itself is free to use under the terms of its own licence.
Can I self-host SnappyData?
Yes. SnappyData can be self-hosted on your own server or infrastructure.
What is SnappyData an alternative to?
SnappyData is an open-source alternative to Databricks and Snowflake. Other open-source alternatives to Databricks include Apache Cloudberry, Dremio OSS and Apache Spark.
Is SnappyData actively maintained?
The most recent commit to SnappyData was on 21 November 2022, and the latest release is v1.3.1, published on 12 June 2022. The project has 1k stars on GitHub.

Open-source alternatives to SnappyData

See all

SaaS alternatives to SnappyData

See all