DB-EnginesExtremeDB: mitigate connectivity issues in a DBMSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Druid vs. Hive vs. Prometheus vs. Redis vs. Spark SQL

System Properties Comparison Apache Druid vs. Hive vs. Prometheus vs. Redis vs. Spark SQL

Editorial information provided by DB-Engines
NameApache Druid  Xexclude from comparisonHive  Xexclude from comparisonPrometheus  Xexclude from comparisonRedis  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionOpen-source analytics data store designed for sub-second OLAP queries on high dimensionality and high cardinality datadata warehouse software for querying and managing large distributed datasets, built on HadoopOpen-source Time Series DBMS and monitoring systemPopular in-memory data platform used as a cache, message broker, and database that can be deployed on-premises, across clouds, and hybrid environments infoRedis focuses on performance so most of its design decisions prioritize high performance and very low latencies.Spark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
Time Series DBMS
Relational DBMSTime Series DBMSKey-value store infoMultiple data types and a rich set of operations, as well as configurable data expiration, eviction and persistenceRelational DBMS
Secondary database modelsDocument store infowith RedisJSON
Graph DBMS infowith RedisGraph
Spatial DBMS
Search engine infowith RediSearch
Time Series DBMS infowith RedisTimeSeries
Vector DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score3.34
Rank#88  Overall
#48  Relational DBMS
#7  Time Series DBMS
Score61.17
Rank#18  Overall
#12  Relational DBMS
Score8.42
Rank#47  Overall
#2  Time Series DBMS
Score157.80
Rank#6  Overall
#1  Key-value stores
Score18.96
Rank#33  Overall
#20  Relational DBMS
Websitedruid.apache.orghive.apache.orgprometheus.ioredis.com
redis.io
spark.apache.org/­sql
Technical documentationdruid.apache.org/­docs/­latest/­designcwiki.apache.org/­confluence/­display/­Hive/­Homeprometheus.io/­docsdocs.redis.com/­latest/­index.html
redis.io/­docs
spark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation and contributorsApache Software Foundation infoinitially developed by FacebookRedis project core team, inspired by Salvatore Sanfilippo infoDevelopment sponsored by Redis Inc.Apache Software Foundation
Initial release20122012201520092014
Current release29.0.1, April 20243.1.3, April 20227.2.4, January 20243.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache license v2Open Source infoApache Version 2Open Source infoApache 2.0Open Source infosource-available extensions (modules), commercial licenses for Redis EnterpriseOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonononono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Aiven for Redis: Fully managed in-memory key-value store for all your caching and speedy lookup needs.
Implementation languageJavaJavaGoCScala
Server operating systemsLinux
OS X
Unix
All OS with a Java VMLinux
Windows
BSD
Linux
OS X
Windows infoported and maintained by Microsoft Open Technologies, Inc.
Linux
OS X
Windows
Data schemeyes infoschema-less columns are supportedyesyesschema-freeyes
Typing infopredefined data types such as float or dateyesyesNumeric data onlypartial infoSupported data types are strings, hashes, lists, sets and sorted sets, bit arrays, hyperloglogs and geospatial indexesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono infoImport of XML data possiblenono
Secondary indexesyesyesnoyes infowith RediSearch moduleno
SQL infoSupport of SQLSQL for queryingSQL-like DML and DDL statementsnowith RediSQL moduleSQL-like DML and DDL statements
APIs and other access methodsJDBC
RESTful HTTP/JSON API
JDBC
ODBC
Thrift
RESTful HTTP/JSON APIproprietary protocol infoRESP - REdis Serialization ProtocolJDBC
ODBC
Supported programming languagesClojure
JavaScript
PHP
Python
R
Ruby
Scala
C++
Java
PHP
Python
.Net
C++
Go
Haskell
Java
JavaScript (Node.js)
Python
Ruby
C
C#
C++
Clojure
Crystal
D
Dart
Elixir
Erlang
Fancy
Go
Haskell
Haxe
Java
JavaScript (Node.js)
Lisp
Lua
MatLab
Objective-C
OCaml
Pascal
Perl
PHP
Prolog
Pure Data
Python
R
Rebol
Ruby
Rust
Scala
Scheme
Smalltalk
Swift
Tcl
Visual Basic
Java
Python
R
Scala
Server-side scripts infoStored proceduresnoyes infouser defined functions and integration of map-reducenoLua; Redis Functions coming in Redis 7 (slides and Github)no
Triggersnononopublish/subscribe channels provide some trigger functionality; RedisGearsno
Partitioning methods infoMethods for storing different data on different nodesSharding infomanual/auto, time-basedShardingShardingSharding infoAutomatic hash-based sharding with support for hash-tags for manual shardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyes, via HDFS, S3 or other storage enginesselectable replication factoryes infoby FederationMulti-source replication infowith Redis Enterprise Pack
Source-replica replication infoChained replication is supported
none
MapReduce infoOffers an API for user-defined Map/Reduce methodsnoyes infoquery execution via MapReducenothrough RedisGears
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual ConsistencynoneEventual Consistency
Causal consistency can be enabled in Active-Active databases
Strong consistency with Redis Raft
Strong eventual consistency with Active-Active
Foreign keys infoReferential integritynonononono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanononoAtomic execution of command blocks and scripts and optimistic lockingno
Concurrency infoSupport for concurrent manipulation of datayesyesyesyes infoData access is serialized by the serveryes
Durability infoSupport for making data persistentyesyesyesyes infoConfigurable mechanisms for persistency via snapshots and/or operations logsyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nonoyesno
User concepts infoAccess controlRBAC using LDAP or Druid internals for users and groups for read/write by datasource and systemAccess rights for users, groups and rolesnoAccess Control Lists (ACLs): redis.io/­docs/­management/­security/­acl
LDAP and Role-Based Access Control (RBAC) for Redis Enterprise
Mutual TLS authentication: redis.io/­docs/­management/­security/­encryption
Password-based authentication
no

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesRedisson PRO: The ultra-fast Redis Java Client.
» more

CData: Connect to Big Data & NoSQL through standard Drivers.
» more

Aiven for Redis: Fully managed in-memory key-value store for all your caching and speedy lookup needs.
» more

Navicat for Redis: the award-winning Redis management tool with an intuitive and powerful graphical interface.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache DruidHivePrometheusRedisSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

PostgreSQL is the DBMS of the Year 2018
2 January 2019, Paul Andlinger, Matthias Gelbmann

MySQL, PostgreSQL and Redis are the winners of the March ranking
2 March 2016, Paul Andlinger

MongoDB is the DBMS of the year, defending the title from last year
7 January 2015, Paul Andlinger, Matthias Gelbmann

show all

Recent citations in the news

'Lucifer' Botnet Turns Up the Heat on Apache Hadoop Servers
21 February 2024, Dark Reading

Apache Druid Wins Best Big Data Product in the 2023 BigDATAwire Readers' Choice Awards
26 January 2024, Datanami

New DDoS malware Attacking Apache big-data stack, Hadoop, & Druid Servers
26 February 2024, GBHackers

Imply Data gives Apache Druid schema auto-discover capability
6 June 2023, SiliconANGLE News

Imply Announces Automatic Schema Discovery for Apache Druid, Reinforcing Druid's Leadership for Real-Time ...
6 June 2023, businesswire.com

provided by Google News

Apache Software Foundation Announces ApacheĀ® Hive 4.0
30 April 2024, GlobeNewswire

ASF Unveils the Next Evolution of Big Data Processing With the Launch of Hive 4.0
2 May 2024, Datanami

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS | Amazon Web Services
18 October 2023, AWS Blog

Apache Hive 4.0 Launches, Revolutionizing Data Management and Analysis
1 May 2024, MyChesCo

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News

VTEX scales to 150 million metrics using Amazon Managed Service for Prometheus | Amazon Web Services
10 March 2024, AWS Blog

VictoriaMetrics Offers Prometheus Replacement for Time Series Monitoring
17 July 2023, The New Stack

Linux System Monitoring with Prometheus, Grafana, and collectd
1 February 2024, Linux Journal

How to reduce Istio sidecar metric cardinality with Amazon Managed Service for Prometheus | Amazon Web Services
10 October 2023, AWS Blog

Consider Grafana vs. Prometheus for your time-series tools
18 October 2021, TechTarget

provided by Google News

Linux Foundation marshals support for open source alternative to Redis
3 April 2024, The Register

The Coolest Database System Companies Of The 2024 Big Data 100
22 April 2024, CRN

Redis switches licenses, acquires Speedb to go beyond its core in-memory database
21 March 2024, TechCrunch

Redis moves to source-available licenses
25 March 2024, InfoWorld

Redis acquires storage engine startup Speedb to enhance its open-source database
21 March 2024, SiliconANGLE News

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performant IPv4 Range Spark Joins | by Jean-Claude Cote
24 January 2024, Towards Data Science

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News



Share this page

Featured Products

RaimaDB logo

RaimaDB, embedded database for mission-critical applications. When performance, footprint and reliability matters.
Try RaimaDB for free.

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here