English
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL

Spark SQL System Properties

Please select another system to compare it with Spark SQL.

Our visitors often compare Spark SQL with Hive, Impala and HBase.

Editorial information provided by DB-Engines
NameSpark SQL
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processing
Database modelRelational DBMS
DB-Engines Ranking measures the popularity of database management systems
Trend Chart
Score10.37
Rank#36  Overall
#23  Relational DBMS
Websitespark.apache.org/­sql
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation
Initial release2014
Current releasev2.1.1, May 2017
License Commercial or Open SourceOpen Source Apache 2.0
Cloud-based Only available as a cloud serviceno
Implementation languageScala, Java,Python, R
Server operating systemsLinux
OS X
Windows
Data schemeyes
Typing predefined data types such as float or dateyes
XML support Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesno
SQL Support of (almost entire) SQL standard (DML, DDL and DCL statements)no Queries similar to SQL syntax
APIs and other access methodsJDBC
ODBC
Supported programming languagesJava
Python
R
Scala
Server-side scripts Stored proceduresno
Triggersno
Partitioning methods Methods for storing different data on different nodesyes, utilizing Spark Core
Replication methods Methods for redundantly storing data on multiple nodesnone
Foreign keys Referential integrityno
Transaction concepts Support to ensure data integrity after non-atomic manipulations of datano
Concurrency Support for concurrent manipulation of datayes
Durability Support for making data persistentyes
In-memory capabilities Is there an option to define some or all structures to be held in-memory only.no
User concepts Access controlno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

3rd party products and services

We invite representatives of 3rd party vendors to contact us for presenting information about their offerings here.

More resources
Spark SQL
Recent citations in the news

TPC-H Benchmarks Show Memory1 Improves Spark SQL Performance By As Much As 289% While Lowering Costs By ...
17 May 2017, PR Newswire (press release)

使用HAProxy代理控制Spark SQL Thrift Server服务的最大连接数
25 May 2017, 搜狐

Flare Gives Spark SQL a Performance Boost
5 April 2017, The Next Platform

What's Driving Apache Spark Growth? SQL, Streaming and Machine Learning
3 October 2016, ADT Magazine

Structuring Apache Spark 2.0: SQL, DataFrames, Datasets And ...
2 December 2016, insideBIGDATA

provided by Google News

Job opportunities

Sr Data Developer
Global Payments, Charlotte, NC

Data Analyst Consultant, Professional Services
Looker, New York, NY

Product Analyst
PicsArt, San Francisco, CA

Senior Data Engineer
MediaMath, New York, NY

Full Stack Developer (JAVA)
General Dynamics Mission Systems, Hanover, MD

jobs by Indeed




Share this page

Featured Products

Semantic Graph Database Leader - Add The Power of Cognitive Probability Graphs - Unique Graph Visualizations - Free Download

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

Learn how to use Neo4j alongside Oracle RDBMS
for increased query speeds
& application performance.
Read the white paper.

Datastax delivers Apache Cassandra as part of a database platform purpose built for IOT, Web and Mobile Apps. Download now.

Present your product here