DB-EnginesCrateDB bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Impala vs. Spark SQL

System Properties Comparison Impala vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Impala and Spark SQL with Hive, HBase and Cassandra.

Editorial information provided by DB-Engines
NameImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score14.82
Rank#36  Overall
#22  Relational DBMS
Score16.31
Rank#34  Overall
#21  Relational DBMS
Websitewww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationwww.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperClouderaApache Software Foundation
Initial release20132014
Current release3.0.0, May 2018v2.4.0, November 2018
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageC++Scala
Server operating systemsLinuxLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
JDBC
ODBC
Supported programming languagesAll languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
ImpalaSpark SQL
Conferences and events

Spark + AI Summit
San Francisco, California, 23-25 April 2019

Recent citations in the news

Cloudera's a data warehouse player now
28 August 2018, ZDNet

Apache Impala Adds ODBC Scalar Functions
17 May 2018, iProgrammer

Apache Impala gets top-level status as open source Hadoop tool
1 December 2017, TechTarget

Cloudera Boosts Hadoop App Development On Impala
10 November 2014, InformationWeek

Cloudera, MapR, AtScale announce new releases at Strata
6 March 2018, ZDNet

provided by Google News

A Decade Later, Apache Spark Still Going Strong
8 March 2019, Datanami

Researchers Scrutinize Optane Memory Performance
18 March 2019, The Next Platform

The Data Scientist Job and the Future
8 March 2019, Analytics Insight

How Apache Spark Became A Dominant Force In Analytics
12 February 2019, Analytics India Magazine

Introduction to Apache Spark: Big Data Analytics Simplified
4 September 2018, Business 2 Community

provided by Google News

Job opportunities

Senior Data Scientist
Concho, Houston, TX

Data Analyst
Brillio, Georgia

Java/J2EE/Python Developer, AVP
State Street, Quincy, MA

Database Architect
Wunderman, Houston, TX

Data Engineer 3
Choice Hotels, Phoenix, AZ

Data Engineer - Solution Design - Security TS/SCI - Bethesda
MapR, Bethesda, MD

Hadoop Developer
Bank of America, Plano, TX

116 – Senior AWS Big Data Engineer
Northbay, United States

Database Software Developer
CGG, Houston, TX

Research Data Analyst (AgIT)
Purdue University, West Lafayette, IN

jobs by Indeed




Share this page

Featured Products

Neo4j logo

Get your step-by-step guide comparing RDBMS to graph databases, including data models, query languages, and deployment strategies.

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

RavenDB logo

Runs on Windows, Linux, Raspberry Pi. Easy to Operate, Fast Performance.
APIs for JS, .NET, Python.
Take a Free Download

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Present your product here