DB-EnginesInstaclustr banner English
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Hive, Impala and HBase.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
Additional database modelsKey-value store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score11.34
Rank#35  Overall
#22  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current releasev2.2.1, December 2017
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based infoOnly available as a cloud serviceno
Implementation languageScala, Java,Python, R
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of SQLSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

3rd party products and services
Progress DataDirect: Data connectivity across standard SQL and REST

We connect data for 350+ technology partners around the globe including 8 of the top 9 Business Intelligence and Analytics platforms. We co-founded the ODBC specification and serve on the JDBC Expert Group, OData Technical Committee for REST APIs and ANSI SQL Committee.

We invite representatives of 3rd party vendors to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

Data Engineer
16 January 2018, Technical.ly

53% Of Companies Are Adopting Big Data Analytics
25 December 2017, Forbes

Hadoop, Sparkその他分散処理フレームワークの2018年を占う
4 January 2018, Gihyo Jp

Flare Gives Spark SQL a Performance Boost
5 April 2017, The Next Platform

TPC-H Benchmarks Show Memory1 Improves Spark SQL Performance By As Much As 289% While Lowering Costs By ...
17 May 2017, PR Newswire (press release)

provided by Google News

Job opportunities

Data Engineer
GEICO, Chevy Chase, MD

Big Data / ETL Software Engineer
JP Morgan Chase, Plano, TX

Sr. Hadoop Developer
Cardinal Technology Solutions, New York, NY

Big Data / ETL Software Engineer
JP Morgan Chase, Dallas, TX

Data Engineer
Kaplan, New York, NY

jobs by Indeed




Share this page

Featured Products

Datastax logo

Datastax delivers Apache Cassandra as part of a database platform purpose built for IOT, Web and Mobile Apps. Download now.

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

RavenDB logo

.NET & Linux,
try the next level in performance with RavenDB 4.0 where Speed meets ACID.
Free download.

Neo4j logo

Not sure which graph database is best for your needs?
Get Forrester Research's new vendor-neutral report and find out how they compare.

Present your product here