DB-EnginesGraphDB bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
Secondary database modelsKey-value store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score16.39
Rank#34  Overall
#21  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current releasev2.4.0, November 2018
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceno
Implementation languageScala
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of SQLSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
Progress DataDirect: Data connectivity across standard SQL and REST

We connect data for 350+ technology partners around the globe including 8 of the top 9 Business Intelligence and Analytics platforms. We co-founded the ODBC specification and serve on the JDBC Expert Group, OData Technical Committee for REST APIs and ANSI SQL Committee.

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQL
Conferences and events

Spark + AI Summit
San Francisco, California, 23-25 April 2019

Recent citations in the news

On-Demand Webinar: Scaling Big Data Pipelines in Apache Spark, No Coding Required
13 December 2018, Database Trends and Applications

Big Data Governance - Metadata Is the Key
29 November 2018, InformationWeek

The big data odyssey of SQL Server 2019, and more data and AI news from Microsoft Ignite
24 September 2018, ZDNet

MapR Offers Free, On-Demand Apache Spark Courses and Discounted Spark Certification Exam
5 September 2018, DevOps

Introduction to Apache Spark: Big Data Analytics Simplified
4 September 2018, Business 2 Community

provided by Google News

Job opportunities

Data Architect, Big Data
Amazon.com, Kentucky

Data Analyst, Information Engineer
CCC Information Services Inc., Chicago, IL

Senior Database Analyst
DiscoverOrg, Vancouver, WA

Data Engineer
Aetna, New York, NY

Data Engineer - Solution Design - Bay Area
MapR, Santa Clara, CA

jobs by Indeed




Share this page

Featured Products

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

Neo4j logo

New to the world of graph databases? Become an expert today with your copy of the Graph Databases for Beginners ebook.

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Present your product here