DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Trino, Hive and DuckDB.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score19.56
Rank#34  Overall
#21  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current release3.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceno
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScala
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing infopredefined data types such as float or dateyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL infoSupport of SQLSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts infoStored proceduresno
Triggersno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
Foreign keys infoReferential integrityno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano
Concurrency infoSupport for concurrent manipulation of datayes
Durability infoSupport for making data persistentyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

Run Spark SQL on Amazon Athena Spark
23 October 2023, AWS Blog

Apache Spark Architecture: A Detailed Guide
27 February 2024, Simplilearn

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

Seamless Data Analytics Workflow: From Dockerized JupyterLab and MinIO to Insights with Spark SQL
21 December 2023, Towards Data Science

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News



Share this page

Featured Products

SingleStore logo

Database for your real-time AI and Analytics Apps.
Try it today.

Milvus logo

The open source vector database for GenAI.
Try Managed Milvus Free

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Ontotext logo

GraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs. Get it free.

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here