DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL vs. TiDB

System Properties Comparison Spark SQL vs. TiDB

Please select another system to include it in the comparison.

Our visitors often compare Spark SQL and TiDB with Snowflake, MySQL and ClickHouse.

Editorial information provided by DB-Engines
NameSpark SQL  Xexclude from comparisonTiDB  Xexclude from comparison
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processingTiDB is an open source distributed Hybrid Transactional/Analytical Processing (HTAP) database that supports MySQL and Spark SQL syntaxes.
Primary database modelRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score22.94
Rank#34  Overall
#20  Relational DBMS
Score3.26
Rank#95  Overall
#51  Relational DBMS
Websitespark.apache.org/­sqlpingcap.com
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.htmldocs.pingcap.com/­tidb/­stable
DeveloperApache Software FoundationPingCAP, Inc.
Initial release20142016
Current release3.2.0, October 20215.0.1, April 2021
License infoCommercial or Open SourceOpen Source infoApache 2.0Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
TiDB Cloud: Fully-managed TiDB Service. Bring everything great about TiDB to the cloud.
Implementation languageScalaGo, Rust
Server operating systemsLinux
OS X
Windows
Linux
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesnoyes
SQL infoSupport of SQLSQL-like DML and DDL statementsyes
APIs and other access methodsJDBC
ODBC
JDBC
ODBC
Proprietary protocol
Supported programming languagesJava
Python
R
Scala
Ada
C
C#
C++
D
Delphi
Eiffel
Erlang
Haskell
Java
JavaScript (Node.js)
Objective-C
OCaml
Perl
PHP
Python
Ruby
Scheme
Tcl
Server-side scripts infoStored proceduresnono
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Corehorizontal partitioning (by key range)
Replication methods infoMethods for redundantly storing data on multiple nodesnoneUsing Raft consensus algorithm to ensure data replication with strong consistency among multiple replicas.
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infowith TiSpark Connector
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate Consistency
Foreign keys infoReferential integritynono infocurrently only supported in syntax
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanoACID
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlnoUsers with fine-grained authorization concept. No user groups or roles.
More information provided by the system vendor
Spark SQLTiDB
Specific characteristicsTiDB is an open-source NewSQL database built by PingCAP. TiDB supports Hybrid Transactional...
» more
Competitive advantagesIn the current database landscape, infrastructure engineers often have to use one...
» more
Typical application scenariosTiDB is designed to support both OLTP and OLAP scenarios. You can use TiDB , the...
» more
Key customersShopee (E-commerce) BookMyShow.com (E-commerce) Yiguo.com (E-commerce) JD Cloud &...
» more
Market metrics25K+ GitHub Stars for TiDB, and 8K+ GitHub Stars for TiKV 1.6K+ members in TiDB Community...
» more
Licensing and pricing modelsOpen Source Apache 2.0 with either commercial licensing or fully-hosted DB-as-a-service...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQLTiDB
Recent citations in the news

spark sql vs spark dataframe performance
8 April 2021, Newstime Africa

pyspark create dataframe from another dataframe
8 April 2021, Newstime Africa

Using Python for data engineering
14 January 2022, Technology Decisions

Top 10 Big Data Analytics Courses to Elevate Your Career in 2022
12 January 2022, Analytics Insight

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

provided by Google News

SD Times Open-Source Project of the Week: TiDB
5 November 2021, SDTimes.com

PingCAP announces Public Preview of TiDB Cloud USA - English
10 May 2021, PRNewswire

PingCAP Offers New Developer Tier for TiDB Cloud
30 November 2021, Database Trends and Applications

PingCAP Enhances Support for Data Intensive Applications with TiDB 5.3
7 December 2021, PRNewswire

PingCAP Introduces its New Developer Tier to Boost Application Innovation with TiDB Cloud
9 November 2021, PRNewswire

provided by Google News

Job opportunities

Data Scientist
Ford Motor Company, Dearborn, MI

Healthcare Data Analyst - MedInsight
Milliman, Brookfield, WI

Process Manager
Capital One - US, Richmond, VA

Associate Data Lake Consultant
Amazon Web Services, Inc., New York, NY

Data Scientist II – Hybrid remote work location for WI and IL residents
UW Health, Madison, WI

HR Generalist
PingCAP, Remote

Senior Product Manager, TiDB Cloud
PingCAP, Remote

Backend Engineer (US)
17LIVE, Los Angeles, CA

Senior Recruiter, North America Business
PingCAP, Remote

Sales Account Executive- Remote
PingCAP, Remote

jobs by Indeed



Share this page

Featured Products

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 80GB free.

Present your product here