DBMS > Apache Phoenix vs. Spark SQL vs. SWC-DB vs. VoltDB vs. Weaviate

System Properties Comparison Apache Phoenix vs. Spark SQL vs. SWC-DB vs. VoltDB vs. Weaviate

Editorial information provided by DB-Engines

Name

Description

A scale-out RDBMS with evolutionary schema built on Apache HBase

Spark SQL is a component on top of 'Spark Core' for structured data processing

A high performance, scalable Wide Column DBMS

Distributed In-Memory NewSQL RDBMS

Used for OLTP applications with a high frequency of relatively simple transactions, that can hold all their data in memory

An AI-native realtime vector database engine that integrates scalable machine learning models.

Primary database model

Secondary database models

Time Series DBMS

DB-Engines Ranking measures the popularity of database management systems
Trend Chart

Score	2.06
Rank	#123	Overall
	#58	Relational DBMS

Score	18.04
Rank	#33	Overall
	#20	Relational DBMS

Score	0.08
Rank	#364	Overall
	#13	Wide column stores

Score	1.47
Rank	#157	Overall
	#73	Relational DBMS

Score	1.52
Rank	#153	Overall
	#5	Vector DBMS

Website

phoenix.apache.org

spark.apache.org/sql

github.com/kashirin-alex/swc-db
www.swcdb.org

www.voltdb.com

github.com/weaviate/weaviate
weaviate.io

Technical documentation

phoenix.apache.org

spark.apache.org/docs/latest/sql-programming-guide.html

docs.voltdb.com

weaviate.io/developers/weaviate

Developer

Apache Software Foundation

Alex Kashirin

VoltDB Inc.

Weaviate B.V.

Initial release

2014

2020

2010

2019

Current release

5.0-HBase2, July 2018 and 4.15-HBase1, December 2019

3.5.0 ( 2.13), September 2023

0.5, April 2021

11.3, April 2022

1.19, May 2023

License

Commercial or Open Source

Open Source

Apache Version 2.0

Open Source

Apache 2.0

Open Source

GPL V3

Open Source

AGPL for Community Edition, commercial license for Enterprise, AWS, and Pro Editions

Open Source

commercial license available with Weaviate Enterprise

Cloud-based only

Only available as a cloud service

DBaaS offerings (sponsored links)

Database as a Service

Providers of DBaaS offerings, please contact us to be listed.

Implementation language

Java

Scala

C++

Java, C++

Server operating systems

Linux
Unix
Windows

Linux
OS X
Windows

Linux

Linux
OS X

for development

Data scheme

yes

late-bound, schema-on-read capabilities

yes

schema-free

yes

yes, maps to GraphQL interface

Typing

predefined data types such as float or date

yes

string, int, float, geo point, date, cross reference, fuzzy references

XML support

Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.

Secondary indexes

yes

all data objects are indexed in a semantic vector space (the Contextionary), all primitive fields are indexed

SQL

Support of SQL

yes

SQL-like DML and DDL statements

SQL-like query language

yes

only a subset of SQL 99

GraphQL is used as query language

APIs and other access methods

JDBC

JDBC
ODBC

Proprietary protocol
Thrift

Java API
JDBC
RESTful HTTP/JSON API

GraphQL query language
RESTful HTTP/JSON API

Supported programming languages

C
C#
C++
Go
Groovy
Java
PHP
Python
Scala

Java
Python
R
Scala

C++

C#
C++
Erlang

not officially supported
Go
Java
JavaScript

Node.js
PHP
Python

JavaScript / TypeScript
Python

Server-side scripts

Stored procedures

user defined functions

Java

Triggers

Partitioning methods

Methods for storing different data on different nodes

Sharding

yes, utilizing Spark Core

Sharding

Replication methods

Methods for redundantly storing data on multiple nodes

Multi-source replication
Source-replica replication

none

Multi-source replication
Source-replica replication

yes

MapReduce

Offers an API for user-defined Map/Reduce methods

Hadoop integration

Consistency concepts

Methods to ensure consistency in a distributed system

Immediate Consistency or Eventual Consistency

Immediate Consistency

Eventual Consistency

Foreign keys

Referential integrity

FOREIGN KEY constraints are not supported

Transaction concepts

Support to ensure data integrity after non-atomic manipulations of data

ACID

Transactions are executed single-threaded within stored procedures

Concurrency

Support for concurrent manipulation of data

yes

Data access is serialized by the server

yes

Durability

Support for making data persistent

yes

Snapshots and command logging

yes

In-memory capabilities

Is there an option to define some or all structures to be held in-memory only.

yes

User concepts

Access control

Access Control Lists (using HBase ACL) for RBAC, integration with Apache Ranger for RBAC & ABAC, multi-tenancy

Users and roles with access to stored procedures

API Keys
OpenID Connect Discovery

More information provided by the system vendor

Specific characteristics

Weaviate is an open source vector database that is robust, scalable, cloud-native,...
» more

Competitive advantages

Flexible deployment - Free, open source or fully-managed cloud vector database service...
» more

Typical application scenarios

As a database supporting the development of generative AI and semantic search applications...
» more

Key customers

All companies that have data.
» more

Market metrics

As of mid 2023: Over 2 million open source downloads 3500+ Weaviate Slack community...
» more

Licensing and pricing models

Weaviate is open-source, and free to use. Weaviate is also available as a fully managed...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources

DB-Engines blog posts

Cloudera's HBase PaaS offering now supports Complex Transactions
11 August 2021, Krishna Maheshwari (sponsor)

show all

Weaviate, an ANN Database with CRUD support
2 February 2021, Etienne Dilocker, SeMI Technologies (sponsor)

show all

Recent citations in the news

Supercharge SQL on Your Data in Apache HBase with Apache Phoenix | Amazon Web Services
2 June 2016, AWS Blog

Bridge the SQL-NoSQL gap with Apache Phoenix
4 February 2016, InfoWorld

Apache Calcite, FreeMarker, Gora, Phoenix, and Solr updated
27 March 2017, SDTimes.com

Azure HDInsight Analytics Platform Now Supports Apache Hadoop 3.0
18 April 2019, eWeek

Deep dive into Azure HDInsight 4.0
25 September 2018, Microsoft

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performance Insights from Sigma Rule Detections in Spark Streaming
1 June 2024, Towards Data Science

Simba Technologies(R) Introduces New, Powerful JDBC Driver With SQL Connector for Apache Spark(TM)
17 March 2024, Yahoo Singapore News

provided by Google News

2022 All O-Zone Football Team
17 December 2022, Ozarks Sports Zone

provided by Google News

Unveiling Volt Active Data's game-changing approach to limitless app performance
16 October 2023, YourStory

VoltDB Launches Active(N) Lossless Cross Data Center Replication
31 August 2021, PR Newswire

VoltDB Turns to Real-Time Analytics with NewSQL Database
30 January 2014, Datanami

VoltDB Upgrades Power, Security of Its In-Memory Database
1 February 2017, eWeek

VoltDB Adds Geospatial Support, Cross-Site Replication
28 January 2016, The New Stack

provided by Google News

Build enterprise-ready generative AI solutions with Cohere foundation models in Amazon Bedrock and Weaviate vector ...
24 January 2024, AWS Blog

Weaviate Partners with Snowflake to Bring Secure GenAI to Snowpark Container Services
8 February 2024, Datanami

Weaviate Partners with Snowflake to Bring Secure GenAI to Snowpark Container Services
9 February 2024, AiThority

Foley Represents Cortical Ventures in $50M Series B Round for Weaviate
17 December 2023, Foley & Lardner LLP

Getting Started with Weaviate: A Beginner's Guide to Search with Vector Databases
18 July 2023, Towards Data Science

provided by Google News

Share this page