DB-EnginesInfluxDB download bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Impala vs. Spark SQL

System Properties Comparison Hive vs. Impala vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score74.71
Rank#15  Overall
#10  Relational DBMS
Score14.52
Rank#36  Overall
#22  Relational DBMS
Score17.19
Rank#35  Overall
#21  Relational DBMS
Websitehive.apache.orgwww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homewww.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoinitially developed by FacebookClouderaApache Software Foundation
Initial release201220132014
Current release2.3.0, July 20173.0.0, May 2018v2.4.0, November 2018
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaC++Scala
Server operating systemsAll OS with a Java VMLinuxLinux
OS X
Windows
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
All languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceyes infouser defined functions and integration of map-reduceno
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factorselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduceyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual ConsistencyEventual Consistency
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and rolesAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesDremio is like magic for Hive accelerating your analytical queries up to 1,000x.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveImpalaSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Conferences and events

Spark + AI Summit
San Francisco, California, 23-25 April 2019

Recent citations in the news

A standard for storing big data? Apache Spark creators release open-source Delta Lake
24 April 2019, ZDNet

Azure HDInsight Analytics Platform Now Supports Apache Hadoop 3.0
18 April 2019, eWeek

Microsoft Expands Hadoop on Azure
16 April 2019, Datanami

Apache Spark Is Great, But It's Not Perfect
3 April 2019, Datanami

10 Books To Learn Hadoop From Scratch
1 April 2019, Analytics India Magazine

provided by Google News

Cloudera's a data warehouse player now
28 August 2018, ZDNet

Apache Impala Adds ODBC Scalar Functions
17 May 2018, iProgrammer

Apache Impala gets top-level status as open source Hadoop tool
1 December 2017, TechTarget

Cloudera says Impala is faster than Hive, which isn't saying much
13 January 2014, GigaOM

Cloudera’s Impala brings Hadoop to SQL and BI
25 October 2012, ZDNet

provided by Google News

Delta Lake gives Apache Spark data sets new powers
24 April 2019, InfoWorld

Top 10 Books For Learning Apache Spark
29 March 2019, Analytics India Magazine

Apache Spark Is Great, But It's Not Perfect
3 April 2019, Datanami

Using Spark and Jenkins to Deploy Code into Hadoop Clusters
26 March 2019, DevOps.com

How Databricks Keeps Data Quality High with Delta
8 April 2019, Datanami

provided by Google News

Job opportunities

Associate, Data Engineer
Morgan Stanley, New York, NY

Cloud Data Engineer, Revenue Science
Twitter, New York, NY

Cloud Data Engineer, Revenue Science
Twitter, San Francisco, CA

Data Engineer
Tredence, Sunnyvale, CA

Data Engineer I
Conde Nast, New York, NY

Business Analyst
Priceline.com, Norwalk, CT

Senior Data Scientist
Concho, Houston, TX

Database Architect
Wunderman, Houston, TX

Architecte Principal, Information
Canadian National Railway, California

Data Engineer 3
Choice Hotels, Phoenix, AZ

Senior Software Development Engineer - Distributed Database Engine - Spark Platform (Spark + AI Summit)
Workday, San Mateo, CA

Big Data Engineer # JN -112018-43124
SSI, Westlake, TX

Big Data Engineer
Bethesda Softworks, Austin, TX

Big Data Engineer
Oportun, San Carlos, CA

Big Data Engineer
Customer Value Partners, Fairfax, VA

jobs by Indeed




Share this page

Featured Products

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Neo4j logo

New to the world of graph databases? Become an expert today with your copy of the Graph Databases for Beginners ebook.

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

RavenDB logo

Runs on Windows, Linux, Raspberry Pi. Easy to Operate, Fast Performance.
APIs for JS, .NET, Python.
Take a Free Download

Present your product here