About SnappyData
SnappyData, also known as TIBCO ComputeDB, is a distributed analytics database optimised for memory. It places an in-memory hybrid database inside Apache Spark, which gives it analytic query processing, mutability and transactions, access to many big data sources, and stream processing in a single cluster. The GitHub description names Apache Spark and Apache Geode as its base.
Data can be discovered and catalogued from SQL databases, Hadoop, NoSQL stores, file systems and cloud stores such as S3, with schemas inferred automatically. You decide which datasets are loaded into distributed memory and which stay at the source, and can store in-memory data as a compressed columnar form or a row store. The columnar store gets a skipping index automatically; the row store takes indexes added by the application.
The README positions it as a computational and caching cluster that augments traditional warehouses and data lakes, not as another enterprise data warehouse. Transformations can be written with Spark SQL functions or Spark jobs in SQL, Java, Scala or Python, and Spark ML functions help prepare data for machine learning. The repository is now provided for legacy users and information only.
Key features
- Discover datasets across SQL, Hadoop, NoSQL and S3
- Many data formats supported out of the box
- Any store with a Spark connector is reachable
- Choose what lives in memory or stays at source
- Compressed columnar store for large scans
- Row store for key and selective access
- Custom logic in SQL, Java, Scala or Python
Good fit for
- Interactive analytics over large datasets
- Ad-hoc visual analytics without pre-aggregation
- Preparing data for machine learning with Spark
SnappyData: questions and answers
- What is SnappyData used for?
- SnappyData is a distributed in-memory analytics database built inside Apache Spark, also called TIBCO ComputeDB, now kept for legacy users. It is a good fit for interactive analytics over large datasets, ad-hoc visual analytics without pre-aggregation and preparing data for machine learning with Spark.
- Is SnappyData open source?
- Yes. SnappyData is open source under a custom licence. Its source code is on GitHub at TIBCOSoftware/snappydata and is written mainly in Scala.
- Is SnappyData free?
- Yes. SnappyData is open source, so the software itself is free to use under the terms of its own licence.
- Can I self-host SnappyData?
- Yes. SnappyData can be self-hosted on your own server or infrastructure.
- What is SnappyData an alternative to?
- SnappyData is an open-source alternative to Databricks and Snowflake. Other open-source alternatives to Databricks include Apache Cloudberry, Dremio OSS and Apache Spark.
- Is SnappyData actively maintained?
- The most recent commit to SnappyData was on 21 November 2022, and the latest release is v1.3.1, published on 12 June 2022. The project has 1k stars on GitHub.
Open-source alternatives to SnappyData
See all
Apache Cloudberry
Databases
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open sou
Apache-2.0vs Snowflake★ 1.4k
Dremio OSS
Data Pipelines & ETL
Dremio - the missing link in modern data
Apache-2.0vs Snowflake★ 1.5k
Apache Spark
Data Pipelines & ETL
Apache Spark - A unified analytics engine for large-scale data processing
Apache-2.0vs Databricks★ 44k
ClickHouse
Databases
ClickHouse is a fast open-source column-oriented database management system that allows ge
Apache-2.0vs Snowflake★ 51k
Apache Doris
Databases
Apache Doris is a real-time analytics and hybrid search database for AI agents.
Apache-2.0vs Snowflake★ 16k
EventQL
Databases
Distributed "massively parallel" SQL query engine
OSSvs Google BigQuery★ 1.2k
SaaS alternatives to SnappyData
See all
Databricks
Data Pipelines & ETL
Lakehouse platform for data engineering, analytics and machine learning
SaaS
Snowflake
Databases
Cloud data platform for warehousing, data sharing and analytics
SaaS
Amazon Athena
Databases
Serverless interactive query service for analyzing data in Amazon S3 with SQL
SaaS
Amazon Redshift
Databases
Managed cloud data warehouse on AWS for SQL analytics at scale
SaaS
Azure Data Explorer
Databases
Analytics service on Azure for exploring log, telemetry and time-series data with Kusto queries
SaaS
Azure Synapse Analytics
Databases
Microsoft analytics service combining data warehousing, big data and data integration
SaaS
