DB-EnginesCrateDB bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Ignite vs. Impala vs. Spark SQL

System Properties Comparison Ignite vs. Impala vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameIgnite  Xexclude from comparisonImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionApache Ignite is a memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads, delivering in-memory speeds at petabyte scale.Analytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelKey-value store
Relational DBMS
Relational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score4.45
Rank#68  Overall
#11  Key-value stores
#37  Relational DBMS
Score14.57
Rank#37  Overall
#23  Relational DBMS
Score16.10
Rank#35  Overall
#21  Relational DBMS
Websiteignite.apache.orgwww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationapacheignite.readme.io/­docswww.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software FoundationClouderaApache Software Foundation
Initial release201520132014
Current releaseApache Ignite 2.63.3.0, August 2019v2.4.4, September 2019
License infoCommercial or Open SourceOpen Source infoApache 2.0Open Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageC++, Java, .NetC++Scala
Server operating systemsLinux
OS X
Solaris
Windows
LinuxLinux
OS X
Windows
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.yesnono
Secondary indexesyesyesno
SQL infoSupport of SQLANSI-99 for query and DML statements, subset of DDLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsHDFS API
Hibernate
JCache
Proprietary protocol
RESTful HTTP API
Spring Data
JDBC
ODBC
JDBC
ODBC
JDBC
ODBC
Supported programming languagesC#
C++
Java
PHP
Python
Ruby
Scala
All languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes (compute grid and cache interceptors can be used instead)yes infouser defined functions and integration of map-reduceno
Triggersyes (cache interceptors and events)nono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyes (replicated cache)selectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes (compute grid and hadoop accelerator)yes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual Consistency
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDnono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesnono
User concepts infoAccess controlSecurity Hooks for custom implementationsAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
IgniteImpalaSpark SQL
Conferences and events

Spark Summit Europe 2019
Amsterdam, Netherlands, 15-17 October 2019

Recent citations in the news

Denis Magda on Continuous Deep Learning with Apache Ignite
16 September 2019, InfoQ.com

GridGain Unveils Full Breakout Session Schedule for Fifth Annual In-Memory Computing Summit North America
26 September 2019, Yahoo Finance

High Performance Storage Enables Digital Transformation
27 September 2019, Forbes

The Apache® Software Foundation Announces Program Highlights for ApacheCon™ Europe
23 September 2019, Yahoo Finance

GridGain Expands Support for Apache Ignite
8 February 2019, Datanami

provided by Google News

Cloudera Boosts Hadoop App Development On Impala
10 November 2014, InformationWeek

Cloudera's a data warehouse player now
28 August 2018, ZDNet

Cloudera says Impala is faster than Hive, which isn't saying much
13 January 2014, GigaOM

Apache Impala gets top-level status as open source Hadoop tool
1 December 2017, TechTarget

Cloudera’s Impala brings Hadoop to SQL and BI
25 October 2012, ZDNet

provided by Google News

Axiomatics Launches SmartGuard® for Data - Spark SQL Edition
17 September 2019, Yahoo Finance

DataRobot launches AI Catalog to enable enterprise team collaboration
30 September 2019, VentureBeat

Spark vs Hadoop: Which Big Data Framework Will Elevate Your Business?
23 September 2019, Appinventiv

Introducing Weld, a runtime written in Rust and LLVM for cross-library optimizations
24 September 2019, Packt Hub

Product Cost Data Scientist - Cloudflare
20 September 2019, Built In Austin

provided by Google News

Job opportunities

ETL / Spark Software Engineer
IBM, Research Triangle Park, NC

Java/J2EE Technical Architect with Apache Ignite and Hadoop
Capgemini, North Dakota

Data Engineer
SPR, Chicago, IL

Loans Servicing - Loans Servicing Technology
Goldman Sachs, New York, NY

Software Engineer
KLA-Tencor, Milpitas, CA

Cloud Admin
Avani Technology Solutions Inc, Orange, CA

Big Data Lead
Brillio, Santa Clara, CA

Google Cloud Data Architect
Pythian, United States

Business Intelligence Developer
Early Warning Services, Scottsdale, AZ

Big Data Architect - Cloudera, Impala
ITL USA, Richardson, TX

Big Data ETL Developer
N&R Consulting, Bethesda, MD

Database Software Developer
CGG, Houston, TX

Software Developer, Data Engineering
BECU, Tukwila, WA

Data Developer
Moody's Analytics, New York, NY

Big Data developer
Capgemini, New York, NY

jobs by Indeed




Share this page

Featured Products

RavenDB logo

Setup a fully managed RavenDB Cloud Database in minutes. Enjoy hosting, management, backups all in one place.
Grab a Free Instance

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Redis logo

Hosted, serverless DBaaS
in 3 steps.

30MB Free!
Start now.

Neo4j logo

Get your free copy of the new O'Reilly book Graph Algorithms with 20+ examples for
machine learning, graph analytics and more.

Present your product here