DB-EnginesInfluxDB download bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Hive, Impala and Snowflake.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score16.10
Rank#35  Overall
#21  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current releasev2.4.4, September 2019
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceno
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScala
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of SQLSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

Databricks introduces MLflow Model Registry, brings Delta Lake to Linux Foundation
16 October 2019, ZDNet

Delta Lake Project Raises Linux Foundation Flag
17 October 2019, SDxCentral

Spark vs Hadoop: Which Big Data Framework Will Elevate Your Business?
23 September 2019, Appinventiv

DataRobot launches AI Catalog to enable enterprise team collaboration
30 September 2019, VentureBeat

Introducing Weld, a runtime written in Rust and LLVM for cross-library optimizations
24 September 2019, Packt Hub

provided by Google News

Job opportunities

Data Analytics Engineer - Artificial Intelligence
Travelers, Hartford, CT

Software Engineer, Data
Warner Bros Careers, Burbank, CA

Data Engineer
eHealth, Santa Clara, CA

Senior Data Engineer
Customer Value Partners, Fairfax, VA

Data Engineer
Amazon.com Services, Inc., Seattle, WA

jobs by Indeed




Share this page

Featured Products


Datastax logo

Build data-driven applications that set the standard for performance, availability,
& scale with DataStax.
Learn more.

Redis logo

Hosted, serverless DBaaS
in 3 steps.

30MB Free!
Start now.

RavenDB logo

Setup a fully managed RavenDB Cloud Database in minutes. Enjoy hosting, management, backups all in one place.
Grab a Free Instance

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Neo4j logo

Get your free copy of the new O'Reilly book Graph Algorithms with 20+ examples for
machine learning, graph analytics and more.

Present your product here