DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Drill vs. Spark SQL

System Properties Comparison Apache Drill vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Apache Drill and Spark SQL with Trino, DuckDB and Hive.

Editorial information provided by DB-Engines
NameApache Drill  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionSchema-free SQL Query Engine for Hadoop, NoSQL and Cloud StorageSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelDocument store
Relational DBMS
Relational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score2.77
Rank#116  Overall
#23  Document stores
#56  Relational DBMS
Score19.78
Rank#36  Overall
#22  Relational DBMS
Websitedrill.apache.orgspark.apache.org/­sql
Technical documentationdrill.apache.org/­docsspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software FoundationApache Software Foundation
Initial release20122014
Current release1.20.3, January 20233.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScala
Server operating systemsLinux
OS X
Windows
Linux
OS X
Windows
Data schemeschema-freeyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesnono
SQL infoSupport of SQLSQL SELECT statement is SQL:2003 compliantSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
RESTful HTTP API
JDBC
ODBC
Supported programming languagesC++Java
Python
R
Scala
Server-side scripts infoStored proceduresuser defined functionsno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes
Consistency concepts infoMethods to ensure consistency in a distributed systemnone
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentDepending on the underlying data sourceyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.Depending on the underlying data sourceno
User concepts infoAccess controlDepending on the underlying data sourceno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache DrillSpark SQL
Recent citations in the news

Apache Drill case study: A tutorial on processing CSV files
9 June 2016, TheServerSide.com

Use Apache Drill with Spring Boot or Java to query data using SQL queries
24 September 2019, Towards Data Science

Apache Drill Poised to Crack Tough Data Challenges
19 May 2015, Datanami

Apache Spark vs. Apache Drill
18 May 2016, LinkedIn

MapR Adds Drill to Hadoop Distribution for SQL-Based Big Data Analytics -- ADTmag
21 May 2015, ADT Magazine

provided by Google News

1.5 Years of Spark Knowledge in 8 Tips | by Michael Berk | Dec, 2023
23 December 2023, Towards Data Science

Debates in the Data Engineering Community: Pipelines, Python, and the SQL Dilemma
27 January 2024, Medium

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2023
12 July 2023, Simplilearn

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

Use generative AI with Amazon EMR, Amazon Bedrock, and English SDK for Apache Spark to unlock insights ...
16 November 2023, AWS Blog

provided by Google News



Share this page

Featured Products

Ontotext logo

GraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs. Get it free.

Milvus logo

The open source vector database for GenAI.
Try Managed Milvus Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

AllegroGraph logo

Graph Database Leader for AI Knowledge Graph Applications - The Most Secure Graph Database Available.
Free Download

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here