DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Elasticsearch vs. FoundationDB vs. Impala vs. Spark SQL

System Properties Comparison Elasticsearch vs. FoundationDB vs. Impala vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameElasticsearch  Xexclude from comparisonFoundationDB  Xexclude from comparisonImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
Created as commercial project in 2013, FoundationDB has been acquired by Apple in March 2015 and was withdrawn from the market. As a consequence, the product was removed from the DB-Engines ranking. In April 2018, Apple open-sourced FoundationDB and it therefore reappears in the ranking.
DescriptionA distributed, RESTful modern search and analytics engine based on Apache Lucene infoElasticsearch lets you perform and combine many types of searches such as structured, unstructured, geo, and metricOrdered key-value store. Core features are complimented by layers.Analytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelSearch engineDocument store infosupported via specific layer
Key-value store
Relational DBMS infosupported via specific SQL-layer
Relational DBMSRelational DBMS
Secondary database modelsDocument store
Spatial DBMS
Document store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score150.32
Rank#7  Overall
#1  Search engines
Score1.78
Rank#144  Overall
#25  Document stores
#27  Key-value stores
#70  Relational DBMS
Score17.92
Rank#39  Overall
#24  Relational DBMS
Score21.90
Rank#36  Overall
#22  Relational DBMS
Websitewww.elastic.co/­elasticsearchwww.foundationdb.orgwww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationwww.elastic.co/­guide/­en/­elasticsearch/­reference/­current/­index.htmlapple.github.io/­foundationdbdocs.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperElasticFoundationDBClouderaApache Software Foundation
Initial release2010201320132014
Current release7.8.0, June 20206.2.28, November 20204.1.0, June 20223.3.0 ( 2.13), June 2022
License infoCommercial or Open SourceOpen Source infoElastic LicenseOpen Source infoApache 2.0Open Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenononono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaC++C++Scala
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
LinuxLinux
OS X
Windows
Data schemeschema-free infoFlexible type definitions. Once a type is defined, it is persistentschema-free infosome layers support schemasyesyes
Typing infopredefined data types such as float or dateyesno infosome layers support typingyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesyes infoAll search fields are automatically indexednoyesno
SQL infoSupport of SQLSQL-like query languagesupported in specific SQL layer onlySQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJava API
RESTful HTTP/JSON API
JDBC
ODBC
JDBC
ODBC
Supported programming languages.Net
Groovy
Community Contributed Clients
Java
JavaScript
Perl
PHP
Python
Ruby
.Net
C
C++
Go
Java
JavaScript infoNode.js
PHP
Python
Ruby
Swift
All languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyesin SQL-layer onlyyes infouser defined functions and integration of map-reduceno
Triggersyes infoby using the 'percolation' featurenonono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyesyesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsES-Hadoop Connectornoyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency infoSynchronous doc based replication. Get by ID may show delays up to 1 sec. Configurable write consistency: one, quorum, allLinearizable consistencyEventual Consistency
Foreign keys infoReferential integritynoin SQL-layer onlynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanoACIDnono
Concurrency infoSupport for concurrent manipulation of datayesyesyesyes
Durability infoSupport for making data persistentyesyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.Memcached and Redis integrationnono
User concepts infoAccess controlnoAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
ElasticsearchFoundationDBImpalaSpark SQL
DB-Engines blog posts

PostgreSQL is the DBMS of the Year 2017
2 January 2018, Paul Andlinger, Matthias Gelbmann

Elasticsearch moved into the top 10 most popular database management systems
3 July 2017, Matthias Gelbmann

MySQL, PostgreSQL and Redis are the winners of the March ranking
2 March 2016, Paul Andlinger

show all

Recent citations in the news

Searching for search: UK Gov wants to dump GOV.UK Elasticsearch
17 November 2022, The Stack

Uber Reduces Logging Costs by 169x Using Compressed Log Processor (CLP)
28 November 2022, InfoQ.com

IronCore Labs Launches Advanced Searchable Encryption Features
15 November 2022, PR Newswire

Leaked Amazon Prime Video Server Exposed Users Viewing Habits
1 November 2022, HackRead

Configuring rsyslog to send data to your LogScale repository
31 October 2022, CrowdStrike

provided by Google News

IBM Cloudant pulls plan to fund new foundational layer for CouchDB
15 March 2022, The Register

Apple Acquires Durable Database Company FoundationDB
24 March 2015, TechCrunch

Apple Open Sources FoundationDB
19 April 2018, MacRumors

Apple open-sources FoundationDB database to build open development community
20 April 2018, Daily Host News

Apple's FoundationDB takes new Record Layer open source, confirms tech underpins CloudKit
14 January 2019, AppleInsider

provided by Google News

Cloudera's Impala brings Hadoop to SQL and BI
25 October 2012, ZDNet

Cloudera Boosts Hadoop App Development On Impala
10 November 2014, InformationWeek

Cloudera aims to bring real-time queries to Hadoop, big data
24 October 2012, ZDNet

Apache Impala 4 Supports Operator Multi-Threading
29 July 2021, iProgrammer

Man Busts Out of Google, Rebuilds Top-Secret Query Machine
24 October 2012, WIRED

provided by Google News

Mobilize.Net Announces PySpark (Spark Python) to Snowpark Code Conversion Tool
16 November 2022, PR Newswire

Accelerating SQL Queries on a Modern Real-Time Database
3 November 2022, thenewstack.io

Senior Big Data Engineer - Remote - Remote Position with EPAM - Apply Today!
11 November 2022, EPAM

Tellius Announces Latest Version of Its Decision Intelligence Platform
9 November 2022, Datanami

Job Update: Computer Science Graduates, Postgraduates Vacancy at Salesforce
24 November 2022, StudyCafe

provided by Google News

Job opportunities

Elasticsearch Developer
mamsys consulting services, Dallas, TX

Kubernetes Engineers
Volto Consulting, Remote

Kubernetes Engineers
Volto, Remote

Mid-Level Java / Elasticsearch Developer (Remote)
cloudteam, Jacksonville, FL

Elasticsearch Engineer/Developer
Open Systems Technologies Corporation, Chantilly, VA

Software Engineer Specialist
Humanity, Cincinnati, OH

Sr. ETL Test Lead
Bank of America, Charlotte, NC

Federal - ETL Developer
Accenture, St. Louis, MO

Federal - Data Engineer
Accenture, Raleigh, NC

Software Engineer Specialist
FIS Global, Cincinnati, OH

Spark, SQL
Kaizen Technologies, Columbus, OH

ETL Developer
HealthVerity, Remote

Machine Learning Scientist
PayPal, Austin, TX

Applied Data Scientist III
R1 RCM, Inc., Remote

Machine Learning Scientist
PayPal, Delaware

jobs by Indeed



Share this page

Featured Products

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Redis logo

The world’s most loved real‑time data platform.
Try free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

The definitive guide for Cassandra

Imagine What You Could Do if Scalability Wasn‘t a Problem!
Download the Cassandra e-book for free!

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Present your product here