DB-EngineseXtremeDB: 5 9's high availability databaseEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Amazon Redshift vs. Hive vs. Spark SQL

System Properties Comparison Amazon Redshift vs. Hive vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameAmazon Redshift  Xexclude from comparisonHive  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionLarge scale data warehouse service for use with business intelligence toolsdata warehouse software for querying and managing large distributed datasets, built on HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score22.41
Rank#29  Overall
#17  Relational DBMS
Score76.42
Rank#14  Overall
#9  Relational DBMS
Score18.40
Rank#34  Overall
#21  Relational DBMS
Websiteaws.amazon.com/­redshifthive.apache.orgspark.apache.org/­sql
Technical documentationdocs.aws.amazon.com/­redshiftcwiki.apache.org/­confluence/­display/­Hive/­Homespark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperAmazon (based on PostgreSQL)Apache Software Foundation infoinitially developed by FacebookApache Software Foundation
Initial release201220122014
Current release3.1.2, August 20193.0.0, June 2020
License infoCommercial or Open SourcecommercialOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceyesnono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageCJavaScala
Server operating systemshostedAll OS with a Java VMLinux
OS X
Windows
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesrestrictedyesno
SQL infoSupport of SQLyes infodoes not fully support an SQL-standardSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
JDBC
ODBC
Thrift
JDBC
ODBC
Supported programming languagesAll languages supporting JDBC/ODBCC++
Java
PHP
Python
Java
Python
R
Scala
Server-side scripts infoStored proceduresuser defined functions infoin Pythonyes infouser defined functions and integration of map-reduceno
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsnoyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual Consistency
Foreign keys infoReferential integrityyes infoinformational only, not enforced by the systemnono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDnono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesno
User concepts infoAccess controlfine grained access rights according to SQL-standardAccess rights for users, groups and rolesno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesCData: Connect to Big Data & NoSQL through standard Drivers.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Amazon RedshiftHiveSpark SQL
DB-Engines blog posts

Cloud-based DBMS's popularity grows at high rates
12 December 2019, Paul Andlinger

The popularity of cloud-based DBMSs has increased tenfold in four years
7 February 2017, Matthias Gelbmann

Increased popularity for consuming DBMS services out of the cloud
2 October 2015, Paul Andlinger

show all

Why is Hadoop not listed in the DB-Engines Ranking?
13 May 2013, Paul Andlinger

show all

Recent citations in the news

Restrict Amazon Redshift Spectrum external table access to Amazon Redshift IAM users and groups using role chaining
6 July 2020, idk.dev

The fundamental issues with Amazon Redshift
30 June 2020, ITProPortal

Moovit embraces data lake architecture by extending their Amazon Redshift cluster to analyze billions of data points every day
24 June 2020, idk.dev

Best practices for Amazon Redshift Federated Query
16 June 2020, idk.dev

Infoworks DataFoundry Adds Amazon Redshift Support
18 June 2020, Business Wire

provided by Google News

Introducing Amazon EMR Managed Scaling – Automatically Resize Clusters to Lower Cost
8 July 2020, idk.dev

Will the Presto Community Ever Be United Again?
7 July 2020, Datanami

How Facebook's open source factory gave rise to Presto
30 June 2020, TechRepublic

Cloudera aims to fulfill its vision of an enterprise data cloud
11 June 2020, SiliconANGLE

Apache Hudi Achieves Top Level Status
29 June 2020, iProgrammer

provided by Google News

Spark 3.0 Brings Big SQL Speed-Up, Better Python Hooks
25 June 2020, Datanami

Spark 3 Improves Python and SQL Support
22 June 2020, iProgrammer

Spark 3.0 changes gears with adaptive query execution and GPU help
23 June 2020, DevClass

Databricks Cranks Delta Lake Performance, Nabs Redash for SQL Viz
24 June 2020, Datanami

news digest: Apache Spark 3.0 released, OpenAPI 3.1.0 RC0, Pinpoint Agile ceremonies - SD Times
19 June 2020, SDTimes.com

provided by Google News

Job opportunities

Amazon Redshift Development Manager
Amazon.com Services LLC, East Palo Alto, CA

Data Analyst 3
Nordstrom, Seattle, WA

Director, Engineering Redshift
Amazon Web Services, Inc., Remote

Database Administrator
SnapAV, Draper, UT

082: Redshift ETL Engineer
Dataspace, Detroit, MI

Business Analyst
Cognizant Technology Solutions, Sunnyvale, CA

Spark Developer
Accenture, Newark, DE

Hadoop Solr Consultant
Frontend Arts, Salt Lake, UT

Associate
Cognizant Technology Solutions, Plano, TX

Systems Engineer
Credit Sesame, Toronto, OH

Data Engineers - Hadoop
State Street, Redwood City, CA

Data Engineer
Talking Rain Beverage Company, Preston, WA

Data Engineers - Hadoop
State Street, New York, NY

Python/Spark/SQL Data Egnineer
Zettalogix, Iselin, NJ

Microsoft Analytics Consultant
IBM, United States

jobs by Indeed




Share this page

Featured Products

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Neo4j logo

Get your free copy of the new O'Reilly book Graph Algorithms with 20+ examples for
machine learning, graph analytics and more.

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Datastax Astra logo

Cassandra made easy in the cloud. Build cloud-native applications faster with CQL, REST and GraphQL APIs.
Try for Free.

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Present your product here