DB-EnginesExtremeDB Active Replication featuresEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Impala vs. Spark SQL

System Properties Comparison Impala vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Impala and Spark SQL with Hive, HBase and ClickHouse.

Editorial information provided by DB-Engines
NameImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score15.36
Rank#38  Overall
#23  Relational DBMS
Score18.74
Rank#34  Overall
#21  Relational DBMS
Websitewww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationdocs.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperClouderaApache Software Foundation
Initial release20132014
Current release3.3.0, August 20193.0.1, October 2020
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageC++Scala
Server operating systemsLinuxLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
JDBC
ODBC
Supported programming languagesAll languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
ImpalaSpark SQL
Recent citations in the news

Cloudera’s Impala brings Hadoop to SQL and BI
25 October 2012, ZDNet

Cloudera says Impala is faster than Hive, which isn't saying much
13 January 2014, GigaOM

Cloudera's a data warehouse player now
28 August 2018, ZDNet

Shark: Real-time queries and analytics for big data
26 November 2012, O'Reilly Radar

Man Busts Out of Google, Rebuilds Top-Secret Query Machine
24 October 2012, Wired

provided by Google News

The 6 Best Apache Spark Courses on Udemy to Consider for 2021
21 January 2021, Solutions Review

Synapse Analytics and .NET for Apache Spark Example 3 – CTE() from Blog Posts – SQLServerCentral
19 January 2021, Packt Hub

Synapse Analytics Spark Example 1 – Group By from Blog Posts – SQLServerCentral
19 January 2021, Packt Hub

Synapse Analytics Spark Example 2 – ROW_NUMBER() from Blog Posts – SQLServerCentral
19 January 2021, Packt Hub

The 15 Best Big Data Courses on Udemy to Consider for 2021
14 January 2021, Solutions Review

provided by Google News

Job opportunities

39878
Zachary Piper Solutions LLC, Remote

Intermediate Reporting Data Developer Ocean/Olympus
Citi, Tampa, FL

Federal - ETL Developer Engineer
Accenture, San Antonio, TX

Spark/Big Data Engineer
GEICO, Chevy Chase, MD

Research Staff Member: 2021
IBM, United States

(PB)Senior Data Engineer-AWS
Innovyt, Cedar Rapids, IA

Software and Data Engineer Intern
ViaSat, Carlsbad, CA

Data Engineer
INTOLON, Detroit, MI

jobs by Indeed




Share this page

Featured Products

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 5 GB free..

Vertica logo

The fastest unified analytical warehouse at extreme scale with in-database Machine Learning. Try Vertica for free with no time limit.

Neo4j logo

Get your free copy of the new O'Reilly book Graph Algorithms with 20+ examples for
machine learning, graph analytics and more.

Present your product here