DB-EnginesInfluxDB download bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Spark SQL

System Properties Comparison Hive vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Hive and Spark SQL with Impala, MongoDB and Cassandra.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonSpark SQL  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score77.90
Rank#14  Overall
#9  Relational DBMS
Score16.28
Rank#36  Overall
#22  Relational DBMS
Websitehive.apache.orgspark.apache.org/­sql
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homespark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoinitially developed by FacebookApache Software Foundation
Initial release20122014
Current release2.3.5, May 2019v2.4.2, April 2019
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaScala
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
Java
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlAccess rights for users, groups and rolesno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesDremio is like magic for Hive accelerating your analytical queries up to 1,000x.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveSpark SQL
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Hive v/s Pig: Comparing The Two Principal Components Of Hadoop Ecosystem
7 May 2019, Analytics India Magazine

The main picks for Hadoop distributions on the market
23 May 2019, TechTarget

What's Behind Lyft's Choices in Big Data Tech
10 May 2019, Datanami

Google, Informatica deepen ties around big data in the cloud
22 May 2019, TechTarget

SENIOR DATA SCIENTIST - DECISION SCIENCES PERSONAL VALUATION TEAM - Conversant
16 May 2019, Built In Chicago

provided by Google News

Real-Time Data Processing Using Redis Streams and Apache Spark Structured Streaming
13 May 2019, InfoQ.com

Microsoft Releases High-Performance C# and F# Support for Apache Spark
30 April 2019, InfoQ.com

DataStax details road to Apache Cassandra future - Open Source Insider
23 May 2019, ComputerWeekly.com

Apache Spark Is Great, But It's Not Perfect
3 April 2019, Datanami

A Decade Later, Apache Spark Still Going Strong
8 March 2019, Datanami

provided by Google News

Job opportunities

Quant Analytics Associate
JP Morgan Chase, Plano, TX

Quant Analytics Associate
JP Morgan Chase, Chicago, IL

Quant Analytics Associate
JP Morgan Chase, Columbus, OH

CSE I Big Data
Amazon Web Services, Inc., Herndon, VA

Hadoop Subject Matter Specialist
Booz Allen Hamilton, Washington, DC

Senior Data Engineer, Growth
Netflix, Los Gatos, CA

Data & ML Engineer
Amazon Web Services, Inc., United States

Data & ML Engineer - Nationwide Opportunities
Amazon Web Services, Inc., United States

Senior Data Warehouse Engineer
2U, New York, NY

Senior Data Engineer - VideoAmp platform
VideoAmp, Santa Monica, CA

jobs by Indeed




Share this page

Featured Products

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

Neo4j logo

Get your free copy of the new O'Reilly book Graph Algorithms with 20+ examples for
machine learning, graph analytics and more.

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

RavenDB logo

Runs on Windows, Linux, Raspberry Pi. Easy to Operate, Fast Performance.
APIs for JS, .NET, Python.
Take a Free Download

Present your product here