DBMS > Apache Spark (SQL) vs. OpenMLDB vs. PostgreSQL vs. XTDB

System Properties Comparison Apache Spark (SQL) vs. OpenMLDB vs. PostgreSQL vs. XTDB

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines

Name

Description

Apache Spark SQL is a component on top of 'Spark Core' for structured data processing

An open-source machine learning database that provides a feature platform for training and inference

Widely used open source RDBMS

Developed as objectoriented DBMS (Postgres), gradually enhanced with 'standards' like SQL

A general purpose database with bitemporal SQL and Datalog and graph queries

Primary database model

Relational DBMS

Time Series DBMS

Relational DBMS

with object oriented extensions, e.g.: user defined types/functions and inheritance. Handling of key/value pairs with hstore module.

Document store

Secondary database models

Relational DBMS

Document store
Graph DBMS

with Apache Age
Spatial DBMS
Vector DBMS

with pgvector extension

DB-Engines Ranking measures the popularity of database management systems
Trend Chart

Score	21.62
Rank	#29	Overall
	#18	Relational DBMS

Score	0.05
Rank	#358	Overall
	#38	Time Series DBMS

Score	674.32
Rank	#4	Overall
	#4	Relational DBMS

Score	0.20
Rank	#314	Overall
	#46	Document stores

Website

spark.apache.org/sql

openmldb.ai

www.postgresql.org

github.com/xtdb/xtdb
www.xtdb.com

Technical documentation

spark.apache.org/docs/latest/sql-programming-guide.html

openmldb.ai/docs/zh/main

www.postgresql.org/docs

www.xtdb.com/docs

Developer

Apache Software Foundation

4 Paradigm Inc.

PostgreSQL Global Development Group

www.postgresql.org/developer

Juxt Ltd.

Initial release

2014

2020

1989

1989: Postgres, 1996: PostgreSQL

2019

Current release

3.5.0 ( 2.13), September 2023

2024-2 February 2024

16.4, August 2024

1.19, September 2021

License

Commercial or Open Source

Open Source

Apache 2.0

Open Source

BSD

Open Source

MIT License

Cloud-based only

Only available as a cloud service

DBaaS offerings (sponsored links)

Database as a Service

Providers of DBaaS offerings, please contact us to be listed.

PostgreSQL Flex @ STACKIT offers managed PostgreSQL Instances with adjustable CPU, RAM, storage amount and speed and several extensions available, in enterprise grade to perfectly match all application requirements. All 100% GDPR-compliant.

Implementation language

Scala

C++, Java, Scala

Clojure

Server operating systems

Linux
OS X
Windows

Linux

FreeBSD
HP-UX
Linux
NetBSD
OpenBSD
OS X
Solaris
Unix
Windows

All OS with a Java 8 (and higher) VM
Linux

Data scheme

yes

Fixed schema

yes

schema-free

Typing

predefined data types such as float or date

yes

yes, extensible-data-notation format

XML support

Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.

yes

specific XML-type available, but no XML query functionality.

Secondary indexes

yes

SQL

Support of SQL

SQL-like DML and DDL statements

yes

standard with numerous extensions

limited SQL, making use of Apache Calcite

APIs and other access methods

JDBC
ODBC

JDBC
SQLAlchemy

ADO.NET
JDBC
native C library
ODBC
streaming API for large objects

HTTP REST
JDBC

Supported programming languages

Java
Python
R
Scala

C++
Go
Java
Python
Scala

.Net
C
C++
Delphi
Java

JDBC
JavaScript (Node.js)
Perl
PHP
Python
Tcl

Clojure
Java

Server-side scripts

Stored procedures

user defined functions

realized in proprietary language PL/pgSQL or with common languages like Perl, Python, Tcl etc.

Triggers

yes

Partitioning methods

Methods for storing different data on different nodes

yes, utilizing Spark Core

horizontal partitioning

partitioning by range, list and (since PostgreSQL 11) by hash

none

Replication methods

Methods for redundantly storing data on multiple nodes

none

Source-replica replication

other methods possible by using 3rd party extensions

yes, each node contains all data

MapReduce

Offers an API for user-defined Map/Reduce methods

Consistency concepts

Methods to ensure consistency in a distributed system

Immediate Consistency

Foreign keys

Referential integrity

yes

Transaction concepts

Support to ensure data integrity after non-atomic manipulations of data

ACID

Concurrency

Support for concurrent manipulation of data

yes

Durability

Support for making data persistent

yes

yes, flexibel persistency by using storage technologies like Apache Kafka, RocksDB or LMDB

In-memory capabilities

Is there an option to define some or all structures to be held in-memory only.

yes

User concepts

Access control

fine grained access rights according to SQL-standard

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.