DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Impala vs. Spark SQL

System Properties Comparison Hive vs. Impala vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score80.60
Rank#17  Overall
#11  Relational DBMS
Score17.68
Rank#40  Overall
#25  Relational DBMS
Score22.58
Rank#36  Overall
#22  Relational DBMS
Websitehive.apache.orgwww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homedocs.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoinitially developed by FacebookClouderaApache Software Foundation
Initial release201220132014
Current release3.1.3, April 20224.1.0, June 20223.3.0 ( 2.13), June 2022
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaC++Scala
Server operating systemsAll OS with a Java VMLinuxLinux
OS X
Windows
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
All languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceyes infouser defined functions and integration of map-reduceno
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factorselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduceyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual ConsistencyEventual Consistency
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and rolesAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveImpalaSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Is Apache Iceberg the Future of Cloud Data Workload?
8 September 2022, Analytics Insight

Bluesky built cost guardrails to help cut Snowflake data spend
14 September 2022, TechCrunch

Top Big Data Tools For Data Science And Machine Learning Projects in 2022
7 September 2022, MarkTechPost

Dremio Cloud review: A fast and flexible data lakehouse on AWS
7 September 2022, InfoWorld

Open-Source Database Software Market Size, Share | Global Report with Key Players Analysis - Titan, SQLite, Re
27 September 2022, openPR

provided by Google News

Apache Impala 4 Supports Operator Multi-Threading
29 July 2021, iProgrammer

Pentaho adds Amazon Redshift, Cloudera Impala to stable of data sources
17 February 2015, SiliconANGLE News

Man Busts Out of Google, Rebuilds Top-Secret Query Machine
24 October 2012, WIRED

Harnessing Data In Motion - High-Performance Computing News Analysis | insideHPC
10 January 2022, insideHPC

Cloudera's Analytic Database Enables Unrivaled Elastic
22 September 2016, GlobeNewswire

provided by Google News

Power BI vs. Tibco Spotfire: Software Comparison 2022 | eWEEK
20 September 2022, eWeek

Aerospike Database 6.1 Release Introduces Additional Secondary Index Features and Support for Complex Queries
6 September 2022, Database Trends and Applications

Top Big Data Tools For Data Science And Machine Learning Projects in 2022
7 September 2022, MarkTechPost

A Complete Guide to PySpark Data Frames
12 July 2022, Built In

Everything You Need to Know About Data Lakehouses
8 September 2022, KDnuggets

provided by Google News

Job opportunities

Staff Data Scientist, Customer Experience
Salesforce, Remote

Python Hive Developer
Cognizant, Hartford, CT

Data Modeler/Analyst
Object Technology Solution, Overland Park, KS

Consultant
Virtusa, Jersey City, NJ

Senior Data Engineer - Remote (Europe)
Perpetua Labs, Remote

Sr. ETL Test Lead
Bank of America, Addison, TX

Sr Planning Engineer
Lumen, Remote

Software Engineer Specialist
FIS Global, Cincinnati, OH

Director, Commercial Data Science and Decision Analytics
SAGE Therapeutics, Massachusetts

Federal - ETL Developer
Accenture, St. Louis, MO

Associate Data & ML Engineer, A2C ProServe
Amazon Web Services, Inc., Remote

Sr. Data & ML Engineer
Amazon Web Services, Inc., North Dakota

Associate Data Lake Consultant, A2C ProServe
Amazon Web Services, Inc., Remote

Associate Data & ML Engineer, AWS SDT ProServe A2C
Amazon Web Services, Inc., Remote

Data Egineer
Career Soft Solutions, Seattle, WA

jobs by Indeed



Share this page

Featured Products

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Neo4j logo

Neo4j NODES 2022
Free online conference for developers and data scientists.
November 16/17 2022.
Register now for free!

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 80GB free.

Redis logo

The world’s most loved real‑time data platform.
Try free

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Present your product here