DB-EnginesExtremeDB: the hard real time dbmsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL vs. Sphinx vs. XTDB

System Properties Comparison Spark SQL vs. Sphinx vs. XTDB

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameSpark SQL  Xexclude from comparisonSphinx  Xexclude from comparisonXTDB infoformerly named Crux  Xexclude from comparison
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processingOpen source search engine for searching in data from different sources, e.g. relational databasesA general purpose database with bitemporal SQL and Datalog and graph queries
Primary database modelRelational DBMSSearch engineDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score22.86
Rank#35  Overall
#21  Relational DBMS
Score6.72
Rank#63  Overall
#7  Search engines
Score0.00
Rank#354  Overall
#50  Document stores
Websitespark.apache.org/­sqlsphinxsearch.comgithub.com/­xtdb/­xtdb
xtdb.com
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.htmlsphinxsearch.com/­docsxtdb.com/­docs
DeveloperApache Software FoundationSphinx Technologies Inc.Juxt Ltd.
Initial release201420012019
Current release3.2.0, October 20213.4.1, July 20211.19, September 2021
License infoCommercial or Open SourceOpen Source infoApache 2.0Open Source infoGPL version 2, commercial licence availableOpen Source infoMIT License
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScalaC++Clojure
Server operating systemsLinux
OS X
Windows
FreeBSD
Linux
NetBSD
OS X
Solaris
Windows
All OS with a Java 8 (and higher) VM
Linux
Data schemeyesyesschema-free
Typing infopredefined data types such as float or dateyesnoyes, extensible-data-notation format
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesnoyes infofull-text index on all search fieldsyes
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like query language (SphinxQL)limited SQL, making use of Apache Calcite
APIs and other access methodsJDBC
ODBC
Proprietary protocolHTTP REST
JDBC
Supported programming languagesJava
Python
R
Scala
C++ infounofficial client library
Java
Perl infounofficial client library
PHP
Python
Ruby infounofficial client library
Clojure
Java
Server-side scripts infoStored proceduresnonono
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark CoreSharding infoPartitioning is done manually, search queries against distributed index is supportednone
Replication methods infoMethods for redundantly storing data on multiple nodesnonenoneyes, each node contains all data
MapReduce infoOffers an API for user-defined Map/Reduce methodsnono
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonoACID
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyes infoThe original contents of fields are not stored in the Sphinx index.yes, flexibel persistency by using storage technologies like Apache Kafka, RocksDB or LMDB
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlnono

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQLSphinxXTDB infoformerly named Crux
DB-Engines blog posts

The DB-Engines ranking includes now search engines
4 February 2013, Paul Andlinger

show all

Recent citations in the news

Top online courses to learn Apache Spark
5 May 2022, Analytics India Magazine

Inside the Modern Data Stack
23 May 2022, Datanami

Software Architectural Patterns in Data Engineering | by Kunal Sharma | Expedia Group Technology | May, 2022
24 May 2022, Medium

Application Architects: Degree in Comp. Sc/Eng related. MS (2 yr)
18 May 2022, New Jersey Hills

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

provided by Google News

How to Build 600+ Links in One Month
4 September 2020, Search Engine Journal

6 Top & Best Open source Search Engine Software for Enterprises
17 June 2019, H2S Media

provided by Google News

Job opportunities

Data Engineer - Spark SQL, Scala, AWS Data Lake
Nasdaq, Inc., Boston, MA

Spark scala developer
Ait, Delaware, OH

ETL Tester
Cool Minds LLC, Remote

Big Data Support Engineer (Spark, SQL)
Teamware Solutions, United States

Python/Spark/SQL Data Egnineer
Zettalogix, Iselin, NJ

Senior Business Intelligence Developer
IQuasar, Washington, DC

jobs by Indeed



Share this page

Featured Products

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 80GB free.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Redis logo

The world’s most loved real‑time data platform.
Try free

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

Present your product here