DB-EnginesExtremeDB: the mission critical dbmsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Spark SQL

System Properties Comparison Hive vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Hive and Spark SQL with PostgreSQL, Impala and HBase.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonSpark SQL  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score78.66
Rank#17  Overall
#11  Relational DBMS
Score23.72
Rank#35  Overall
#21  Relational DBMS
Websitehive.apache.orgspark.apache.org/­sql
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homespark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoinitially developed by FacebookApache Software Foundation
Initial release20122014
Current release3.1.2, August 20193.3.0, June 2022
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaScala
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
Java
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlAccess rights for users, groups and rolesno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more
SQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Top 10 Hadoop Analytics Tools Used in Big Data Projects in 2022
31 July 2022, Analytics Insight

Cloudera And Apache Iceberg – Collaborating On The Same Data
14 July 2022, Forbes

StarRocks Brings Speedy OLAP Database to the Cloud
14 July 2022, Datanami

How companies can support employees amidst political unrest
8 August 2022, Open Access Government

Data Lake Strategy Options: From Self-Service to Full-Service
8 August 2022, IT Business Edge

provided by Google News

Data chess game: Databricks vs. Snowflake, part 1
25 July 2022, VentureBeat

A Complete Guide to PySpark Data Frames
13 July 2022, Built In

Top 10 Big Data Architect Jobs to Apply for in August 2022
2 August 2022, Analytics Insight

Post-recovery COVID-19 and incident heart failure in the National COVID Cohort Collaborative (N3C) study
15 July 2022, Nature.com

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

provided by Google News

Job opportunities

Sr. Data Engineers
GSPANN Technologie, Portland, OR

Sr. Data Architect, Data Lake & Analytics - Nationwide Opportunities
Amazon Web Services, Inc., West Virginia

Data Engineer
Amazon.com Services LLC, Remote

Bigdata with Pyspark
Virtusa, Irving, TX

Data Engineer
Wizeline, Remote

Data Engineer
Rangam Consultants Inc., Remote

Data Analyst
Harvey Nash, Remote

Data Engineer - 100% Remote
HealthFirst, New York, NY

Quality Assurance Consultant
Pyramid IT consultancy, Charlotte, NC

Statistician Programmer (HYBRID)
Healthcare Risk Advisors, New York, NY

jobs by Indeed



Share this page

Featured Products

Neo4j logo

The right graph database.
Not a graph add-on.
Free forever.
Start solving today

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Redis logo

The world’s most loved real‑time data platform.
Try free

The definitive guide for Cassandra

Imagine What You Could Do if Scalability Wasn‘t a Problem!
Download the Cassandra e-book for free!

Present your product here