DB-Engines English
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Hive, Impala and HBase.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Database modelRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score10.65
Rank#37  Overall
#24  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current releasev2.1.1, May 2017
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based infoOnly available as a cloud serviceno
Implementation languageScala, Java,Python, R
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of (almost entire) SQL standard (DML, DDL and DCL statements)no infoQueries similar to SQL syntax
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

3rd party products and services

We invite representatives of 3rd party vendors to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

Apache Spark With Structured Streaming
21 July 2017, iProgrammer

Which Spark Machine Learning API Should You Use?
14 July 2017, Linux.com (blog)

Will serverless functions beat DevOps in race to democratize analytics?
21 July 2017, SiliconANGLE News (blog)

Flare Gives Spark SQL a Performance Boost
5 April 2017, The Next Platform

选择Spark机器学习API的四大机器学习算法,你掌握了多少?
25 July 2017, 搜狐

provided by Google News

Job opportunities

Hadoop Developer
almIT Services Inc, Richmond, VA

Data Scientist
InMobi, San Francisco, CA

Technology - GIR Technology - Data Engineer - Analyst - New York
Goldman Sachs, New York, NY

Research Analyst
InMobi, San Francisco, CA

Technology - GIR Technology - Data Engineer - Associate - New York
Goldman Sachs, New York, NY

jobs by Indeed




Share this page

Featured Products

Datastax delivers Apache Cassandra as part of a database platform purpose built for IOT, Web and Mobile Apps. Download now.

Get your step-by-step guide comparing RDBMS to graph databases, including data models, query languages, and deployment strategies.

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

.NET & Linux,
try the next level in performance with RavenDB 4.0 where Speed meets ACID.
Free download.

Present your product here