DB-EnginesExtremeDB: white paper about the mission critical dbmsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Spark SQL

System Properties Comparison Hive vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Hive and Spark SQL with Trino, Impala and PostgreSQL.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonSpark SQL  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score69.41
Rank#18  Overall
#12  Relational DBMS
Score18.87
Rank#36  Overall
#22  Relational DBMS
Websitehive.apache.orgspark.apache.org/­sql
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homespark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoinitially developed by FacebookApache Software Foundation
Initial release20122014
Current release3.1.3, April 20223.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaScala
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
Java
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlAccess rights for users, groups and rolesno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Google Releases Hive-BigQuery Open-Source Connector
22 July 2023, InfoQ.com

Apache Iceberg Changes Everything: What's Underneath?
28 August 2023, Spiceworks News and Insights

What Is Apache Hive? (Definition, Benefits, Challenges)
19 December 2022, Built In

Using Apache Iceberg for Developing Modern Data Tables
3 October 2023, Open Source For You

What Is Hadoop? Components of Hadoop and How Does It Work [Updated]
30 January 2023, Simplilearn

provided by Google News

What is Apache Spark? The big data platform that crushed Hadoop
30 March 2023, InfoWorld

Cluster computing goes local with Spark Connect | by Ajay Gupta | Medium
28 June 2023, Medium

Databricks Spark Plans: Big Data Q&A - Databricks Spark Plans: Big Data Q&A
22 September 2023, InformationWeek

Apache Kyuubi 1.8 Adds Web UI
20 November 2023, iProgrammer

Introducing Velox: An open source unified execution engine
9 March 2023, Facebook Engineering

provided by Google News

Job opportunities

Tech Lead, Data Engine
TikTok, San Jose, CA

Data Scientist (L5) - Infrastructure Experimentation
Netflix, Remote

Machine Learning Associate, 2024 Graduate U.S.
Atlassian, San Francisco, CA

Senior Backline Engineer - Spark
Databricks, United States

Python/Spark/SQL Data Egnineer
Zettalogix, Iselin, NJ

jobs by Indeed



Share this page

Featured Products

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Redis logo

The world’s most loved real‑time data platform.
Try free

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Present your product here