DB-EnginesGraphDB bannerEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Drill vs. Impala vs. Spark SQL

System Properties Comparison Apache Drill vs. Impala vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameApache Drill  Xexclude from comparisonImpala  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionSchema-free SQL Query Engine for Hadoop, NoSQL and Cloud StorageAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelDocument store
Relational DBMS
Relational DBMSRelational DBMS
Secondary database modelsKey-value storeDocument store
Key-value store
Key-value store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score2.92
Rank#79  Overall
#15  Document stores
#41  Relational DBMS
Score14.64
Rank#35  Overall
#22  Relational DBMS
Score14.67
Rank#34  Overall
#21  Relational DBMS
Websitedrill.apache.orgwww.cloudera.com/­products/­open-source/­apache-hadoop/­impala.htmlspark.apache.org/­sql
Technical documentationdrill.apache.org/­docswww.cloudera.com/­documentation/­enterprise/­latest/­topics/­impala.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software FoundationClouderaApache Software Foundation
Initial release2014
Current release1.14, August 20183.0.0, May 2018v2.3.1, June 2018
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
Implementation languageC++Scala
Server operating systemsLinux
OS X
Windows
LinuxLinux
OS X
Windows
Data schemeschema-freeyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesnoyesno
SQL infoSupport of SQLSQL SELECT statement is SQL:2003 compliantSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsRESTful HTTP API
JDBC
ODBC
JDBC
ODBC
JDBC
ODBC
Supported programming languagesC++All languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresuser defined functionsyes infouser defined functions and integration of map-reduceno
Triggersnonono
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyesyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemnoneEventual Consistency
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentDepending on the underlying data sourceyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.Depending on the underlying data sourcenono
User concepts infoAccess controlDepending on the underlying data sourceAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesProgress DataDirect: Data connectivity across standard SQL and REST
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache DrillImpalaSpark SQL
Recent citations in the news

Apache Drill Adds YARN Support
17 April 2018, iProgrammer

MapR Simplifies End-to-End Workflow for Data Scientists
8 February 2018, GlobeNewswire (press release)

Painless ODBC + dplyr Connections to Amazon Athena and Apache Drill with R & odbc
20 April 2018, Security Boulevard

Open source "Gandiva" project wants to unblock analytics
14 June 2018, ZDNet

26 principais certificações de Big Data
22 September 2018, CIO

provided by Google News

Cloudera's a data warehouse player now
28 August 2018, ZDNet

Cloudera Bringing Impala to AWS Cloud
28 November 2017, Datanami

Apache Impala Adds ODBC Scalar Functions
17 May 2018, iProgrammer

Cloudera, MapR, AtScale announce new releases at Strata
6 March 2018, ZDNet

Apache Impala gets top-level status as open source Hadoop tool
1 December 2017, TechTarget

provided by Google News

Microsoft's SQL Server gets built-in support for Spark and Hadoop
24 September 2018, TechCrunch

SQL Server 2019 Includes Hadoop And Spark
4 October 2018, iProgrammer

SQL Server 2019's Big Data Clusters Explained
26 September 2018, Redmondmag.com

Senior Data Scientist - Loss Modeling
8 October 2018, Built In Chicago

Ignite 2018 : Microsoft annonce la disponibilité de la première preview de SQL Server 2019
24 September 2018, Developpez.com

provided by Google News

Job opportunities

Senior Data Warehouse Engineer
2U, New York, NY

Sr. Data Engineer
Pharmavite LLC, Northridge, CA

Principal Software Engineer
MapR, Santa Clara, CA

Principal Distributed Query Processing Engineer
MapR, Santa Clara, CA

Senior/Principal Product Manager - Analytics & Data Processing
MapR, Santa Clara, CA

Big Data Solution Architect
Kogentix, United States

Big Data Architect
EPAM Systems, San Ramon, CA

Big Data Principal Architect
Pythian, Job, WV

Software Engineering/Big Data Solution Architect
Kogentix, Schaumburg, IL

Data Engineer 3
Choice Hotels, Phoenix, AZ

Database Software Developer
CGG, Houston, TX

Meta-Learning Data Science Internship
Bosch Group, Sunnyvale, CA

Senior Reporting Analyst
UnitedHealth Group, Minnetonka, MN

Database Developer
DiscoverOrg, Vancouver, WA

Database Analyst
DiscoverOrg, Vancouver, WA

jobs by Indeed




Share this page

Featured Products

Neo4j logo

Get your step-by-step guide comparing RDBMS to graph databases, including data models, query languages, and deployment strategies.

Redis logo

Start now with Redis Cloud
Secure, highly available Redis as a serverless, hosted, fully managed cloud service.
Sign up here.

Couchbase logo

SQL + JSON + NoSQL.
Power, flexibility & scale.
All open source.
Get started now.

RavenDB logo

Runs on Windows, Linux, Raspberry Pi. Easy to Operate, Fast Performance.
APIs for JS, .NET, Python.
Take a Free Download

Present your product here