DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Hive, Microsoft SQL Server and Impala.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score22.86
Rank#35  Overall
#21  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current release3.2.0, October 2021
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceno
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScala
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of SQLSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
SQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

Top online courses to learn Apache Spark
5 May 2022, Analytics India Magazine

Application Architects: Degree in Comp. Sc/Eng related. MS (2 yr)
18 May 2022, New Jersey Hills

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

Top 10 Business Intelligence Jobs in MNCs to Apply for in May
6 May 2022, Analytics Insight

Databricks SQL Now GA, Bringing Traditional BI to the Lakehouse
16 December 2021, Datanami

provided by Google News

Job opportunities

ETL Tester
Cool Minds LLC, Remote

Big Data Support Engineer (Spark, SQL)
Teamware Solutions, United States

Data Engineer - Spark SQL, Scala, AWS Data Lake
Nasdaq, Inc., Boston, MA

Big Data Engineer
VIR Consultant, Santa Clara, CA

Data Analyst
DataDog, New York, NY

jobs by Indeed



Share this page

Featured Products

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

Redis logo

The world’s most loved real‑time data platform.
Try free

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

The definitive guide for Cassandra

Imagine What You Could Do if Scalability Wasn‘t a Problem!
Download the Cassandra e-book for free!

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here