DB-EnginesExtremeDB: is hard real time possible with a dbms?English
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > etcd vs. Redis vs. Spark SQL

System Properties Comparison etcd vs. Redis vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
Nameetcd  Xexclude from comparisonRedis  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionA distributed reliable key-value storePopular in-memory data platform used as a cache, message broker, and database that can be deployed on-premises, across clouds, and hybrid environments infoRedis focuses on performance so most of its design decisions prioritize high performance and very low latencies.Spark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelKey-value storeKey-value store infoMultiple data types and a rich set of operations, as well as configurable data expiration, eviction and persistenceRelational DBMS
Secondary database modelsDocument store infowith RedisJSON
Graph DBMS infowith RedisGraph
Spatial DBMS
Search engine infowith RediSearch
Time Series DBMS infowith RedisTimeSeries
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score11.54
Rank#46  Overall
#5  Key-value stores
Score177.98
Rank#6  Overall
#1  Key-value stores
Score22.94
Rank#34  Overall
#20  Relational DBMS
Websiteetcd.io
github.com/­etcd-io/­etcd
redis.com
redis.io
spark.apache.org/­sql
Technical documentationetcd.io/­docs
github.com/­etcd-io/­etcd/­tree/­master/­Documentation
docs.redis.com/­latest/­index.html
redis.io/­documentation
spark.apache.org/­docs/­latest/­sql-programming-guide.html
Social network pagesFacebookLinkedInTwitterYouTubeDiscord
DeveloperRedis project core team, inspired by Salvatore Sanfilippo infoDevelopment sponsored by Redis Inc.Apache Software Foundation
Initial release20092014
Current release3.4, August 20196.2.6, October 20213.2.0, October 2021
License infoCommercial or Open SourceOpen Source infoApache Version 2.0Open Source infosource-available extensions (modules), commercial licenses for Redis EnterpriseOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
  • Redis Enterprise Cloud: Instantly scale and pay only for the resources you need - on any cloud - AWS, Azure or Google Cloud.
  • ScaleGrid for Redis: Fully managed hosting for Redis on AWS, Azure and DigitalOcean with high availability and SSH access on the #1 multi-cloud DBaaS.
Implementation languageGoCScala
Server operating systemsFreeBSD
Linux
Windows infoexperimental
BSD
Linux
OS X
Windows infoported and maintained by Microsoft Open Technologies, Inc.
Linux
OS X
Windows
Data schemeschema-freeschema-freeyes
Typing infopredefined data types such as float or datenopartial infoSupported data types are strings, hashes, lists, sets and sorted sets, bit arrays, hyperloglogs and geospatial indexesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesnoyes infowith RediSearch moduleno
SQL infoSupport of SQLnonoSQL-like DML and DDL statements
APIs and other access methodsgRPC
JSON over HTTP
proprietary protocol infoRESP - REdis Serialization ProtocolJDBC
ODBC
Supported programming languages.Net
C
C++
Clojure
Erlang
Go
Haskell
Java
JavaScript (Node.js)
Perl
PHP
Python
R
Ruby
Rust
Scala
Tcl
C
C#
C++
Clojure
Crystal
D
Dart
Elixir
Erlang
Fancy
Go
Haskell
Haxe
Java
JavaScript (Node.js)
Lisp
Lua
MatLab
Objective-C
OCaml
Pascal
Perl
PHP
Prolog
Pure Data
Python
R
Rebol
Ruby
Rust
Scala
Scheme
Smalltalk
Swift
Tcl
Visual Basic
Java
Python
R
Scala
Server-side scripts infoStored proceduresnoLua; Redis Functions coming in Redis 7 (slides and Github)no
Triggersyes, watching key changespublish/subscribe channels provide some trigger functionality; RedisGearsno
Partitioning methods infoMethods for storing different data on different nodesSharding infoAutomatic hash-based sharding with support for hash-tags for manual shardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesUsing Raft consensus algorithm to ensure data replication with strong consistency among multiple replicas.Multi-source replication infowith Redis Enterprise Pack
Source-replica replication infoChained replication is supported
none
MapReduce infoOffers an API for user-defined Map/Reduce methodsnothrough RedisGears
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual Consistency
Causal consistency can be enabled in Active-Active databases
Strong consistency with Redis Raft
Strong eventual consistency with Active-Active
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanoAtomic execution of command blocks and scripts and optimistic lockingno
Concurrency infoSupport for concurrent manipulation of datayesyes infoData access is serialized by the serveryes
Durability infoSupport for making data persistentyesyes infoConfigurable mechanisms for persistency via snapshots and/or operations logsyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noyesno
User concepts infoAccess controlnoAccess Control Lists (ACLs): redis.io/­topics/­acl
LDAP and Role-Based Access Control (RBAC) for Redis Enterprise
Mutual TLS authentication: redis.io/­topics/­encryption
Password-based authentication
no
More information provided by the system vendor
etcdRedisSpark SQL
Specific characteristicsThe Redis real-time data platform builds upon the unmatched simplicity and speed...
» more
Competitive advantagesRedis Enterprise is a robust in-memory database platform built by the people who...
» more
Typical application scenariosRedis Enterprise is used by large enterprise, startup, and government organizations...
» more
Key customersVerizon, Vodafone, Atlassian, Trip Advisor, Jet.com, Nokia, Samsung, HTC, Docker,...
» more
Market metricsMost launched Docker container per day according to Docker Hub (7.2M launches per...
» more
Licensing and pricing modelsRedis Enterprise Cloud lets users scale up and down instantly, and pay only for the...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesRead the Redis NoSQL benchmark report.
» more

Redisson PRO: The ultra-fast Redis Java Client.
» more

CData: Connect to Big Data & NoSQL through standard Drivers.
» more
SQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
etcdRedisSpark SQL
DB-Engines blog posts

PostgreSQL is the DBMS of the Year 2018
2 January 2019, Paul Andlinger, Matthias Gelbmann

MySQL, PostgreSQL and Redis are the winners of the March ranking
2 March 2016, Paul Andlinger

MongoDB is the DBMS of the year, defending the title from last year
7 January 2015, Paul Andlinger, Matthias Gelbmann

show all

Recent citations in the news

Securing Kubernetes at the Infrastructure Level
27 January 2022, Container Journal

How to restore a Kubernetes cluster from an etcd snapshot
16 December 2021, TechTarget

All about performance: etcd 3.5 looks to make Kubernetes users happy • DEVCLASS
17 June 2021, DevClass

How to invest in silver with minimal hassle and diversify your portfolio
14 January 2022, Mint

Distributed Key-Value Store etcd Graduates at CNCF
29 November 2020, InfoQ.com

provided by Google News

Five risks of moving your database to the cloud
25 January 2022, MIT Technology Review

Global Key Value Database Market 2021 Business Dynamics by Players – The Apache Software Foundation, Redis Labs, Aerospike, Couchbase – The Oxford Spokesman
28 January 2022, The Oxford Spokesman

Redis Welcomes Proven Leaders to Board of Directors with Alexy and Dor Appointments
12 January 2022, Business Wire

Redis Pub/Sub vs. Apache Kafka – The New Stack
10 January 2022, thenewstack.io

Confluent Releases New Features to Make Data Streaming Simple
19 January 2022, Database Trends and Applications

provided by Google News

Databricks' TPC-DS benchmarks fuel analytics platform wars
24 January 2022, ZDNet

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

Exploring the use of the Python programming language for data engineers
5 January 2022, Dataconomy

Top 10 Big Data Analytics Courses to Elevate Your Career in 2022
12 January 2022, Analytics Insight

Databricks SQL Now GA, Bringing Traditional BI to the Lakehouse
16 December 2021, Datanami

provided by Google News

Job opportunities

Software Engineer
Braintree, San Jose, CA

Agriculture and Education Coordinator - Chugiak, Alaska - Native Village of Eklutna
Alaska Native Tribal Health Consortium, Chugiak, AK

Software Development Engineer, EKS , EKS Scalability
Amazon.com Services LLC, Seattle, WA

Software Development Engineer, EKS , Amazon EKS
Amazon.com Services LLC, Seattle, WA

Platform Engineer – SysAdmin
Grant Street Group, Remote

Database Administrator
Indiana University, Bloomington, IN

Senior Database Engineer - NoSQL (Redis)
MasterCard, O'Fallon, MO

Database Reliability Engineer, SRE
Etsy, Brooklyn, NY

Database Administrator
Intel, Santa Clara, CA

Senior SQL Server Database Administrator
Garmin, Scottsdale, AZ

SPARK/JAVA
Codvo.ai, Dallas, TX

Hadoop/Spark Developer
Codvo.ai, Dallas, TX

Backline Spark TSE
Databricks, Remote

Machine Learning Engineer
7-Eleven, Inc., Irving, TX

Data Warehouse Architect
J.Crew, New York, NY

jobs by Indeed



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 80GB free.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Present your product here