DB-EnginesExtremeDB for everyone with an RTOSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Impala vs. Spark SQL

System Properties Comparison Apache Impala vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare Apache Impala and Spark SQL with Hive, Trino and Snowflake.

Editorial information provided by DB-Engines
NameApache Impala  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionAnalytic DBMS for HadoopSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMS
Secondary database modelsDocument store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score15.06
Rank#39  Overall
#24  Relational DBMS
Score19.56
Rank#34  Overall
#21  Relational DBMS
Websiteimpala.apache.orgspark.apache.org/­sql
Technical documentationimpala.apache.org/­impala-docs.htmlspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation infoApache top-level project, originally developed by ClouderaApache Software Foundation
Initial release20132014
Current release4.1.0, June 20223.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache Version 2Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageC++Scala
Server operating systemsLinuxLinux
OS X
Windows
Data schemeyesyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nono
Secondary indexesyesno
SQL infoSupport of SQLSQL-like DML and DDL statementsSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
JDBC
ODBC
Supported programming languagesAll languages supporting JDBC/ODBCJava
Python
R
Scala
Server-side scripts infoStored proceduresyes infouser defined functions and integration of map-reduceno
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesselectable replication factornone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyes infoquery execution via MapReduce
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nono
User concepts infoAccess controlAccess rights for users, groups and roles infobased on Apache Sentry and Kerberosno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache ImpalaSpark SQL
Recent citations in the news

Apache Impala 4 Supports Operator Multi-Threading
29 July 2021, iProgrammer

Apache Impala becomes Top-Level Project
28 November 2017, SDTimes.com

Cloudera Bringing Impala to AWS Cloud
28 November 2017, Datanami

How different SQL-on-Hadoop engines satisfy BI workloads
24 February 2016, CIO

Apache Doris just 'graduated': Why care about this SQL data warehouse
24 June 2022, InfoWorld

provided by Google News

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
25 March 2024, Simplilearn

Run Spark SQL on Amazon Athena Spark | AWS Big Data Blog
23 October 2023, AWS Blog

1.5 Years of Spark Knowledge in 8 Tips | by Michael Berk
23 December 2023, Towards Data Science

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Ontotext logo

GraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs. Get it free.

SingleStore logo

Build AI apps with Vectors on SQL and JSON with milliseconds response times.
Try it today.

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here