DBMS > Spark SQL vs. SQL.JS vs. Tarantool vs. TiDB vs. Transbase

System Properties Comparison Spark SQL vs. SQL.JS vs. Tarantool vs. TiDB vs. Transbase

Editorial information provided by DB-Engines

Name

Description

Spark SQL is a component on top of 'Spark Core' for structured data processing

Port of SQLite to JavaScript

In-memory computing platform with a flexible data schema for efficiently building high-performance applications

TiDB is an open source distributed SQL database that supports Hybrid Transactional/Analytical Processing (HTAP) workloads. It is MySQL compatible and features horizontal scalability, strong consistency, and high availability.

A resource-optimized, high-performance, universally applicable RDBMS

Primary database model

Relational DBMS

Document store
Key-value store
Relational DBMS

Relational DBMS

Secondary database models

Spatial DBMS

with Tarantool/GIS extension

Document store

DB-Engines Ranking measures the popularity of database management systems
Trend Chart

Score	18.04
Rank	#33	Overall
	#20	Relational DBMS

Score	0.63
Rank	#241	Overall
	#112	Relational DBMS

Score	1.67
Rank	#143	Overall
	#25	Document stores
	#25	Key-value stores
	#65	Relational DBMS

Score	4.25
Rank	#74	Overall
	#40	Relational DBMS

Score	0.17
Rank	#334	Overall
	#148	Relational DBMS

Website

www.transaction.de/en/products/transbase.html

Technical documentation

spark.apache.org/docs/latest/sql-programming-guide.html

sql.js.org/documentation/index.html

www.tarantool.io/en/doc

docs.pingcap.com/tidb/stable

www.transaction.de/en/products/transbase/features.html

Developer

Apache Software Foundation

Alon Zakai

enhancements implemented by others

PingCAP, Inc.

Transaction Software GmbH

Initial release

2014

2012

2008

2016

1987

Current release

3.5.0 ( 2.13), September 2023

2.10.0, May 2022

8.1.0, May 2024

Transbase 8.3, 2022

License

Commercial or Open Source

Open Source

Apache 2.0

Open Source

BSD-2, source-available extensions (modules), commercial licenses for Tarantool Enterprise

Open Source

Apache 2.0

commercial

free development license

Cloud-based only

Only available as a cloud service

DBaaS offerings (sponsored links)

Database as a Service

Providers of DBaaS offerings, please contact us to be listed.

TiDB Cloud: Fully-managed TiDB Service. Bring everything great about TiDB to the cloud.

Implementation language

Scala

JavaScript

C and C++

Go, Rust

C and C++

Server operating systems

Linux
OS X
Windows

server-less, requires a JavaScript environment (browser, Node.js)

BSD
Linux
macOS

Linux

FreeBSD
Linux
macOS
Solaris
Windows

Data scheme

yes

Flexible data schema: relational definition for tables with ability to store json-like documents in columns

yes

Typing

predefined data types such as float or date

yes

string, double, decimal, uuid, integer, blob, boolean, datetime

yes

XML support

Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.

Secondary indexes

yes

SQL

Support of SQL

SQL-like DML and DDL statements

yes

SQL-92 is not fully supported

Full-featured ANSI SQL support

yes

APIs and other access methods

JDBC
ODBC

JavaScript API

Open binary protocol

GORM
JDBC
ODBC
Proprietary protocol
SQLAlchemy

ADO.NET
JDBC
ODBC
Proprietary native API

Supported programming languages

Java
Python
R
Scala

JavaScript

C
C#
C++
Erlang
Go
Java
JavaScript
Lua
Perl
PHP
Python
Rust

Ada
C
C#
C++
D
Delphi
Eiffel
Erlang
Haskell
Java
JavaScript (Node.js)
Objective-C
OCaml
Perl
PHP
Python
Ruby
Scheme
Tcl

C
C#
C++
Java
JavaScript
Kotlin
Objective-C
PHP
Python

Server-side scripts

Stored procedures

Lua, C and SQL stored procedures

yes

Triggers

yes, before/after data modification events, on replication events, client session events

yes

Partitioning methods

Methods for storing different data on different nodes

yes, utilizing Spark Core

none

Sharding, partitioned with virtual buckets by user defined affinity key. Live resharding for scale up and scale down without maintenance downtime.

horizontal partitioning (by key range)

Replication methods

Methods for redundantly storing data on multiple nodes

none

Asynchronous replication with multi-master option
Configurable replication topology (full-mesh, chain, star)
Synchronous quorum replication (with Raft)

Using Raft consensus algorithm to ensure data replication with strong consistency among multiple replicas.

Source-replica replication

MapReduce

Offers an API for user-defined Map/Reduce methods

yes

with TiSpark Connector

Consistency concepts

Methods to ensure consistency in a distributed system

none

Casual consistency across sharding partitions
Eventual consistency within replicaset partition

when using asyncronous replication
Immediate Consistency within single instance
Sequential consistency including linearizable read within replicaset partition

when using Raft

Immediate Consistency

Foreign keys

Referential integrity

yes

full support since version 6.6

yes

Transaction concepts

Support to ensure data integrity after non-atomic manipulations of data

ACID

ACID, with serializable isolation and linearizable read (within partition); Configurable MVCC (within partition); No cross-shard distributed transactions

ACID

yes

Concurrency

Support for concurrent manipulation of data

yes

yes, cooperative multitasking

yes

Durability

Support for making data persistent

yes

except by serializing a db to a file

yes, write ahead logging

yes

In-memory capabilities

Is there an option to define some or all structures to be held in-memory only.

yes

yes, full featured in-memory storage engine with persistence

User concepts

Access control

Access Control Lists
Mutual TLS authentication for Tarantol Enterprise
Password based authentication
Role-based access control (RBAC) and LDAP for Tarantol Enterprise
Users and Roles

Fine grained access rights according to SQL-standard

fine grained access rights according to SQL-standard

More information provided by the system vendor

Specific characteristics

TiDB is an advanced open-source, distributed SQL database for modern application...
» more

Competitive advantages

- HORIZONTAL SCALING : TiDB grants total transparency into your data workloads without...
» more

Typical application scenarios

TiDB is ideal for transactional applications that require extreme scalability and...
» more

Key customers

Block, Pinterest, Catalyst, Bolt, Flipkart, Capcom, Shopee (E-commerce), JD Cloud...
» more

Market metrics

34K+ GitHub stars 5K+ members in TiDB Community Slack 1K+ community contributors...
» more

Licensing and pricing models

TiDB Community : Free open source software (Apache 2.0) TiDB Self-Hosted : Enterprise...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources

DB-Engines blog posts

New kids on the block: database management systems implemented in JavaScript
1 December 2014, Matthias Gelbmann

show all

Data processing speed and reliability: in-memory synchronous replication
9 November 2021, Vladimir Perepelytsya, Tarantool (sponsor)

show all

Recent citations in the news

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performant IPv4 Range Spark Joins | by Jean-Claude Cote
24 January 2024, Towards Data Science

Simba Technologies(R) Introduces New, Powerful JDBC Driver With SQL Connector for Apache Spark(TM)
17 March 2024, Yahoo Singapore News

provided by Google News

9 Best JavaScript and TypeScript ORMs for 2024 — SitePoint
22 March 2023, SitePoint

Execute millions of SQL statements in milliseconds in the browser with WebAssembly and Web Workers.
14 January 2017, hackernoon.com

SQLite On The Web: Absurd-sql
24 August 2021, Hackaday

In Praise Of SQLite
28 July 2022, iProgrammer

10 Low-Code Rules for Serious Coders
21 November 2022, Embedded Computing Design

provided by Google News

Tarantool Announces New Enterprise Version With Enhanced Scaling and Monitoring Capabilities
18 May 2018, Newswire

Deploying Tarantool Cartridge applications with zero effort (Part 1)
16 December 2019, Хабр

VShard — horizontal scaling in Tarantool
7 March 2019, Хабр

Accelerating PHP connectors for Tarantool using Async, Swoole, and Parallel
18 December 2019, Хабр

provided by Google News

How PingCAP transformed TiDB into a serverless DBaaS using Amazon S3 and Amazon EBS | Amazon Web Services
14 November 2023, AWS Blog

PingCAP Launches TiDB 7.5, Enhancing Distributed SQL Database Tech
19 December 2023, Datanami

Google Cloud's C3D Instances Provide Strong Performance Value For PingCAP's TiDB
28 March 2024, Phoronix

TiDB by PingCAP Leads Data Management Revolution at GIDS 2024, Empowering India's Burgeoning Developer ...
25 April 2024, CXOToday.com

Navigating Modern Data Challenges: Ed Huang, CTO of PingCAP on the Future of Distributed SQL Databases
10 June 2024, DATAQUEST

provided by Google News

Share this page