DB-EnginesExtremeDB: the mission critical dbmsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Kdb vs. Spark SQL vs. TiDB

System Properties Comparison Kdb vs. Spark SQL vs. TiDB

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameKdb  Xexclude from comparisonSpark SQL  Xexclude from comparisonTiDB  Xexclude from comparison
DescriptionHigh performance Time Series DBMSSpark SQL is a component on top of 'Spark Core' for structured data processingTiDB is an open source distributed Hybrid Transactional/Analytical Processing (HTAP) database that supports MySQL and Spark SQL syntaxes.
Primary database modelTime Series DBMSRelational DBMSRelational DBMS
Secondary database modelsRelational DBMSDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score6.90
Rank#60  Overall
#2  Time Series DBMS
Score20.06
Rank#36  Overall
#22  Relational DBMS
Score3.44
Rank#102  Overall
#50  Relational DBMS
Websitekx.comspark.apache.org/­sqlpingcap.com
Technical documentationcode.kx.comspark.apache.org/­docs/­latest/­sql-programming-guide.htmldocs.pingcap.com/­tidb/­stable
DeveloperKx Systems, a division of First Derivatives plcApache Software FoundationPingCAP, Inc.
Initial release2000 infokdb was released 2000, kdb+ in 200320142016
Current release3.6, May 20183.3.0 ( 2.13), June 20226.5.0, December 2022
License infoCommercial or Open Sourcecommercial infofree 32-bit versionOpen Source infoApache 2.0Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
TiDB Cloud: Fully-managed TiDB Service. Bring everything great about TiDB to the cloud.
Implementation languageqScalaGo, Rust
Server operating systemsLinux
OS X
Solaris
Windows
Linux
OS X
Windows
Linux
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.yesnono
Secondary indexesyes infotable attribute 'grouped'noyes
SQL infoSupport of SQLSQL-like query language (q)SQL-like DML and DDL statementsyes
APIs and other access methodsHTTP API
JDBC
Jupyter
Kafka
ODBC
WebSocket
JDBC
ODBC
JDBC
ODBC
Proprietary protocol
Supported programming languagesC
C#
C++
Go
J
Java
JavaScript
Lua
MatLab
Perl
PHP
Python
R
Scala
Java
Python
R
Scala
Ada
C
C#
C++
D
Delphi
Eiffel
Erlang
Haskell
Java
JavaScript (Node.js)
Objective-C
OCaml
Perl
PHP
Python
Ruby
Scheme
Tcl
Server-side scripts infoStored proceduresuser defined functionsnono
Triggersyes infowith viewsnono
Partitioning methods infoMethods for storing different data on different nodeshorizontal partitioningyes, utilizing Spark Corehorizontal partitioning (by key range)
Replication methods infoMethods for redundantly storing data on multiple nodesSource-replica replicationnoneUsing Raft consensus algorithm to ensure data replication with strong consistency among multiple replicas.
MapReduce infoOffers an API for user-defined Map/Reduce methodsno infosimilar paradigm used for internal processingyes infowith TiSpark Connector
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate Consistency
Foreign keys infoReferential integrityyesnono infocurrently only supported in syntax
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonoACID
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesnono
User concepts infoAccess controlrights management via user accountsnoUsers with fine-grained authorization concept. No user groups or roles.
More information provided by the system vendor
KdbSpark SQLTiDB
Specific characteristicsIntegrated columnar database & programming system for streaming, real time and historical...
» more
TiDB is an open-source NewSQL database built by PingCAP. TiDB supports Hybrid Transactional...
» more
Competitive advantagesprovides seamless scalability; runs on industry standard server platforms; is top-ranked...
» more
In the current database landscape, infrastructure engineers often have to use one...
» more
Typical application scenariostick database streaming sensor data massive intelligence applications oil and gas...
» more
TiDB is designed to support both OLTP and OLAP scenarios. You can use TiDB , the...
» more
Key customersGoldman Sachs Morgan Stanley Merrill Lynch J.P. Morgan Deutsche Bank IEX Securities...
» more
Shopee (E-commerce) BookMyShow.com (E-commerce) Yiguo.com (E-commerce) JD Cloud &...
» more
Market metricskdb+ performance and reliability proven by our customers in critical infrastructure...
» more
25K+ GitHub Stars for TiDB, and 8K+ GitHub Stars for TiKV 1.6K+ members in TiDB Community...
» more
Licensing and pricing modelsupon request
» more
Open Source Apache 2.0 with either commercial licensing or fully-hosted DB-as-a-service...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
KdbSpark SQLTiDB
Recent citations in the news

John Hoffman Joins KX as Chief Revenue Officer
23 January 2023, PR Newswire

KX, EnterpriseWeb enable performance, efficiency for network ...
27 January 2023, VanillaPlus

KX AND ENTERPRISEWEB ENABLE UNPRECEDENTED PERFORMANCE AND EFFICIENCY FOR NETWORK SERVICES AT THE EDGE
17 January 2023, Yahoo Finance

Google's John Hoffman joins KX as chief revenue officer
23 January 2023, Finextra

Accelerate Speed Of Data And AI-Driven Business Value With Time Series Technology
13 January 2023, Forbes

provided by Google News

Apache® Kyuubi Becomes Top-Level Project
19 January 2023, GlobeNewswire

Data Engineer (Apache Airflow, Hive, Spark, SQL, AWS)
11 October 2022, EPAM

A Deep Dive into Custom Spark Transformers for ML Pipelines
27 July 2022, CrowdStrike

Accelerating SQL Queries on a Modern Real-Time Database
3 November 2022, The New Stack

Data chess game: Databricks vs. Snowflake, part 1
25 July 2022, VentureBeat

provided by Google News

PingCAP Announces TiDB Cloud Serverless Tier, Delivering ...
1 November 2022, GlobeNewswire

PingCAP’s Innovative TiDB Database – Techstrong.TV
20 October 2022, DevOps.com

Data management trends: Convergence and more money
19 January 2023, TechTarget

TiDB Cloud Launches in AWS Marketplace
10 February 2022, Datanami

PingCAP Named a Strong Performer among Translytical Data ...
6 December 2022, GlobeNewswire

provided by Google News

Job opportunities

Kdb+ Developer
FD Technologies, New York, NY

Senior Kdb+ Developer
FD Technologies, New York, NY

Scala/Spark Data Engineer
ITI Data, Remote

Entry Level Data Engineer with BigData - 1
I28 Technologies Corporation, Remote

Big Data Support Engineer (Spark, SQL)
Teamware Solutions, United States

AWS DATA ENGINEER_(Scala/Spark)
Sunixa Solutions, Remote

Data Operations Associate - DEL
BlackRock, Wilmington, DE

Staff Software Engineer, Distributed System
Zilliz, San Francisco, CA

Senior Demand Generation Marketing Manager
PingCAP, Sunnyvale, CA

Staff Software Engineer - Cash Cards
Cash App, New York, NY

Web Application Architect III
Bloomberg BNA, Arlington, VA

jobs by Indeed



Share this page

Featured Products

Redis logo

The world’s most loved real‑time data platform.
Try free

The definitive guide for Cassandra

Imagine What You Could Do if Scalability Wasn‘t a Problem!
Download the Cassandra e-book for free!

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Present your product here