DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Hive vs. Spark SQL vs. Trafodion

System Properties Comparison Hive vs. Spark SQL vs. Trafodion

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameHive  Xexclude from comparisonSpark SQL  Xexclude from comparisonTrafodion  Xexclude from comparison
Descriptiondata warehouse software for querying and managing large distributed datasets, built on HadoopSpark SQL is a component on top of 'Spark Core' for structured data processingTransactional SQL-on-Hadoop DBMS
Primary database modelRelational DBMSRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score85.58
Rank#14  Overall
#9  Relational DBMS
Score21.87
Rank#34  Overall
#20  Relational DBMS
Score0.53
Rank#232  Overall
#112  Relational DBMS
Websitehive.apache.orgspark.apache.org/­sqltrafodion.apache.org
Technical documentationcwiki.apache.org/­confluence/­display/­Hive/­Homespark.apache.org/­docs/­latest/­sql-programming-guide.htmltrafodion.apache.org
DeveloperApache Software Foundation infoinitially developed by FacebookApache Software FoundationApache Software Foundation, originally developed by HP
Initial release201220142014
Current release3.1.2, August 20193.1.1, March 20212.3.0, February 2019
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaScalaC++, Java
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
Linux
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesnoyes
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statementsyes
APIs and other access methodsJDBC
ODBC
Thrift
JDBC
ODBC
ADO.NET
JDBC
ODBC
Supported programming languagesC++
Java
PHP
Python
Java
Python
R
Scala
All languages supporting JDBC/ODBC/ADO.Net
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reducenoJava Stored Procedures
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark CoreSharding
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornoneyes, via HBase
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduceyes infovia user defined functions and HBase
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual ConsistencyImmediate Consistency
Foreign keys infoReferential integritynonoyes
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonoACID
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and rolesnofine grained access rights according to SQL-standard

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more
SQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
HiveSpark SQLTrafodion
DB-Engines blog posts

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Open-Source Database Software Market Size, Growth And Analysis By Leading Keyplayers – MySQL, Redis, Couchbase, Apache Hive – Stillwater Current
15 September 2021, Stillwater Current

What is Apache Hadoop? Understanding Hadoop Ecosystem & Architecture | ITBE
9 September 2021, IT Business Edge

Tabular Seeks to Remake Cloud Data Lakes in Iceberg's Image
7 September 2021, Datanami

The Apache Drill Project Announces Apache® Drill(TM) v1.19
30 August 2021, GlobeNewswire

A glimpse into the future of open data architecture
20 August 2021, Illinoisnewstoday.com

provided by Google News

Databricks raises $1.6B more to boost data lakehouse
31 August 2021, TechTarget

Beginner's Guide To Machine Learning With Apache Spark
16 July 2021, Analytics India Magazine

Hadoop vs. Spark: Comparing the two big data frameworks
7 May 2021, TechTarget

Databricks launches SQL Analytics
12 November 2020, ZDNet

Evolution of Azure Synapse: Apache Spark 3.0, GPU Acceleration, Delta Lake, Dataverse Support
29 May 2021, InfoQ.com

provided by Google News

The Apache® Software Foundation Announces Annual Report for
31 August 2021, GlobeNewswire

How Facebook Accelerates SQL at Extreme Scale
31 August 2020, Datanami

Apache HBase Is Everywhere
21 June 2016, DZone News

What's the Difference Between SQL, NoSQL, and NewSQL?
28 July 2016, Electronic Design

provided by Google News

Job opportunities

Senior Big data developer
CA-One Tech Cloud Inc, Sunnyvale, CA

Data Engineer
Skechers, Manhattan Beach, CA

Lead II – Software Engineering, Data and Content
S&P Global, Boulder, CO

Spark Scala Developer / Apache Hive
Atlantisitgroup, Phoenix, AZ

Director, Data Analytics and Insights
Fidelity Investments, Boston, MA

Associate Data Lake Consultant
Amazon Web Services, Inc., Remote

Senior Data Engineer - Scala/Spark/SQL
Hewlett Packard Enterprise, San Jose, CA

Jr Data Engineer
Procter & Gamble, Cincinnati, OH

Data Analyst
Lenovo, Morrisville, NC

AWS Data Lake Big Data Engineer - Spark SQL, Data Steward, Scala, Terraform, Data Bricks
Nasdaq, Inc., Rockville, MD

jobs by Indeed



Share this page

Featured Products

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 5 GB free..

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here