DB-EnginesExtremeDB for everyone with an RTOSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Druid vs. Hazelcast vs. OpenSearch vs. Spark SQL vs. Sphinx

System Properties Comparison Apache Druid vs. Hazelcast vs. OpenSearch vs. Spark SQL vs. Sphinx

Editorial information provided by DB-Engines
NameApache Druid  Xexclude from comparisonHazelcast  Xexclude from comparisonOpenSearch  Xexclude from comparisonSpark SQL  Xexclude from comparisonSphinx  Xexclude from comparison
DescriptionOpen-source analytics data store designed for sub-second OLAP queries on high dimensionality and high cardinality dataA widely adopted in-memory data gridA distributed, RESTful search and analytics engine forked from Elasticsearch and based on Apache LuceneSpark SQL is a component on top of 'Spark Core' for structured data processingOpen source search engine for searching in data from different sources, e.g. relational databases
Primary database modelRelational DBMS
Time Series DBMS
Key-value storeSearch engineRelational DBMSSearch engine
Secondary database modelsDocument store infoJSON support with IMDG 3.12Vector DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score3.25
Rank#90  Overall
#47  Relational DBMS
#7  Time Series DBMS
Score5.46
Rank#61  Overall
#7  Key-value stores
Score16.03
Rank#37  Overall
#4  Search engines
Score18.04
Rank#33  Overall
#20  Relational DBMS
Score5.95
Rank#55  Overall
#5  Search engines
Websitedruid.apache.orghazelcast.comgithub.com/­opensearch-project
opensearch.org
spark.apache.org/­sqlsphinxsearch.com
Technical documentationdruid.apache.org/­docs/­latest/­designhazelcast.org/­imdg/­docsopensearch.org/­docs/­latestspark.apache.org/­docs/­latest/­sql-programming-guide.htmlsphinxsearch.com/­docs
DeveloperApache Software Foundation and contributorsHazelcastAmazon Web ServicesApache Software FoundationSphinx Technologies Inc.
Initial release20122008202120142001
Current release29.0.1, April 20245.3.6, November 20232.5.0, January 20233.5.0 ( 2.13), September 20233.5.1, February 2023
License infoCommercial or Open SourceOpen Source infoApache license v2Open Source infoApache Version 2; commercial licenses availableOpen Source infoApache Version 2.0Open Source infoApache 2.0Open Source infoGPL version 2, commercial licence available
Cloud-based only infoOnly available as a cloud servicenonononono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
  • STACKIT OpenSearch offers OpenSearch in a managed version in enterprise grade, 100% GDPR-compliant, for a wide range of applications like analytics, website search, offering scalability and fast data access.
  • Aiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
Implementation languageJavaJavaJavaScalaC++
Server operating systemsLinux
OS X
Unix
All OS with a Java VMAll OS with a Java VMLinux
OS X
Windows
FreeBSD
Linux
NetBSD
OS X
Solaris
Windows
Data schemeyes infoschema-less columns are supportedschema-freeschema-free infoFlexible type definitions. Once a type is defined, it is persistentyesyes
Typing infopredefined data types such as float or dateyesyesyesyesno
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.noyes infothe object must implement a serialization strategyno
Secondary indexesyesyesyes infoAll search fields are automatically indexednoyes infofull-text index on all search fields
SQL infoSupport of SQLSQL for queryingSQL-like query languageSQL-like query languageSQL-like DML and DDL statementsSQL-like query language (SphinxQL)
APIs and other access methodsJDBC
RESTful HTTP/JSON API
JCache
JPA
Memcached protocol
RESTful HTTP API
Java API
RESTful HTTP/JSON API
JDBC
ODBC
Proprietary protocol
Supported programming languagesClojure
JavaScript
PHP
Python
R
Ruby
Scala
.Net
C#
C++
Clojure
Go
Java
JavaScript (Node.js)
Python
Scala
Go
Java
JavaScript (Node.js)
PHP
Python
Ruby infoElasticsearch client
Java
Python
R
Scala
C++ infounofficial client library
Java
Perl infounofficial client library
PHP
Python
Ruby infounofficial client library
Server-side scripts infoStored proceduresnoyes infoEvent Listeners, Executor Servicesyesnono
Triggersnoyes infoEventsyes infoby using the 'percolation' featurenono
Partitioning methods infoMethods for storing different data on different nodesSharding infomanual/auto, time-basedShardingShardingyes, utilizing Spark CoreSharding infoPartitioning is done manually, search queries against distributed index is supported
Replication methods infoMethods for redundantly storing data on multiple nodesyes, via HDFS, S3 or other storage enginesyes infoReplicated Mapyesnonenone
MapReduce infoOffers an API for user-defined Map/Reduce methodsnoyesno
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate Consistency or Eventual Consistency selectable by user infoRaft Consensus AlgorithmEventual Consistency infoSynchronous doc based replication. Get by ID may show delays up to 1 sec. Configurable write consistency: one, quorum, all
Foreign keys infoReferential integritynonononono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanoone or two-phase-commit; repeatable reads; read commitednonono
Concurrency infoSupport for concurrent manipulation of datayesyesyesyesyes
Durability infoSupport for making data persistentyesyesyesyesyes infoThe original contents of fields are not stored in the Sphinx index.
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noyesno
User concepts infoAccess controlRBAC using LDAP or Druid internals for users and groups for read/write by datasource and systemRole-based access controlnono
More information provided by the system vendor
Apache DruidHazelcastOpenSearchSpark SQLSphinx
Specific characteristicsOpenSearch is a highly scalable and extensible open-source software suite for search,...
» more
Competitive advantagesDistributed as fully open source under Apache License, Version 2.0 (ALv2), OpenSearch...
» more
Typical application scenariosThe OpenSearch platform is used across a broad range of search , analytics, and observability...
» more
Licensing and pricing modelsThe OpenSearch Project offers open source software licensed under Apache License...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesAiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache DruidHazelcastOpenSearchSpark SQLSphinx
DB-Engines blog posts

The DB-Engines ranking includes now search engines
4 February 2013, Paul Andlinger

show all

Recent citations in the news

Apache Druid Wins Best Big Data Product in the 2023 BigDATAwire Readers' Choice Awards
26 January 2024, Datanami

'Lucifer' Botnet Turns Up the Heat on Apache Hadoop Servers
21 February 2024, Dark Reading

New DDoS malware Attacking Apache big-data stack, Hadoop, & Druid Servers
26 February 2024, GBHackers

Apache Druid Takes Its Place In The Pantheon Of Databases
16 June 2022, The Next Platform

How to connect DataGrip to Apache Druid | by Zisis Flokas
18 October 2021, Towards Data Science

provided by Google News

Hazelcast Weaves Wider Logic Threads Through The Data Fabric
7 March 2024, Forbes

Hazelcast 5.4 real time data processing platform boosts AI and consistency
17 April 2024, VentureBeat

Hazelcast Showcases Real-Time Data Platform at 2024 Gartner Summit
15 May 2024, Datanami

Real-Time Data Platform Hazelcast Introduces New Chief Technology Officer Adrian Soars
7 November 2023, Finovate

Hazelcast Versus Redis: A Practical Comparison
4 January 2024, Database Trends and Applications

provided by Google News

Amazon OpenSearch Ingestion now supports ingesting streaming data from Amazon MSK Serverless - AWS
6 June 2024, AWS Blog

Behind the Scenes: Upgrading OpenSearch efficiency with OCI flexible vertical scaling
13 February 2024, Oracle

Amazon OpenSearch Service now supports OpenSearch version 2.13 - AWS
21 May 2024, AWS Blog

AWS announces Amazon DocumentDB zero-ETL integration with Amazon OpenSearch Service
16 May 2024, AWS Blog

Amazon OpenSearch Serverless now available in Europe (London) and Asia Pacific (Mumbai)
16 May 2024, AWS Blog

provided by Google News

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS | Amazon Web Services
18 October 2023, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Performance Insights from Sigma Rule Detections in Spark Streaming
1 June 2024, Towards Data Science

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News

Switching From Sphinx to MkDocs Documentation — What Did I Gain and Lose
2 February 2024, Towards Data Science

Manticore is a Faster Alternative to Elasticsearch in C++
25 July 2022, hackernoon.com

Czech billionaire 'very serious' about bid for Royal Mail
19 April 2024, The Telegraph

Perplexity AI: From Its Use To Operation, Everything You Need To Know About Google's Newest Challenger
11 January 2024, Free Press Journal

The Pirate Bay was recently down for over a week due to a DDoS attack
29 October 2019, The Hacker News

provided by Google News



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here