DBMS > Apache Drill vs. Apache Kylin vs. Heroic vs. Spark SQL vs. STSdb

System Properties Comparison Apache Drill vs. Apache Kylin vs. Heroic vs. Spark SQL vs. STSdb

Editorial information provided by DB-Engines

Name

Description

Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage

A distributed analytics engine for big data, providing a SQL interface and multi-dimensional analysis (OLAP) and leveraging the Hadoop stack

Time Series DBMS built at Spotify based on Cassandra or Google Cloud Bigtable, and ElasticSearch

Spark SQL is a component on top of 'Spark Core' for structured data processing

Key-Value Store with special method for indexing

optimized for high performance using a special indexing method

Primary database model

Document store
Relational DBMS

DB-Engines Ranking measures the popularity of database management systems
Trend Chart

Score	2.02
Rank	#124	Overall
	#22	Document stores
	#59	Relational DBMS

Score	1.25
Rank	#170	Overall
	#77	Relational DBMS

Score	0.46
Rank	#265	Overall
	#22	Time Series DBMS

Score	18.04
Rank	#33	Overall
	#20	Relational DBMS

Score	0.10
Rank	#357	Overall
	#51	Key-value stores

Website

drill.apache.org

kylin.apache.org

github.com/spotify/heroic

spark.apache.org/sql

github.com/STSSoft/STSdb4

Technical documentation

drill.apache.org/docs

kylin.apache.org/docs

spotify.github.io/heroic

spark.apache.org/docs/latest/sql-programming-guide.html

Developer

Apache Software Foundation

Apache Software Foundation, originally contributed from eBay Inc

Spotify

Apache Software Foundation

STS Soft SC

Initial release

2012

2015

2014

2011

Current release

1.20.3, January 2023

3.1.0, July 2020

3.5.0 ( 2.13), September 2023

4.0.8, September 2015

License

Commercial or Open Source

Open Source

Apache Version 2

Open Source

Apache Version 2.0

Open Source

Apache 2.0

Open Source

Apache 2.0

Open Source

GPLv2, commercial license available

Cloud-based only

Only available as a cloud service

DBaaS offerings (sponsored links)

Database as a Service

Providers of DBaaS offerings, please contact us to be listed.

Implementation language

Java

Scala

Server operating systems

Linux
OS X
Windows

Linux

Linux
OS X
Windows

Windows

Data scheme

schema-free

yes

schema-free

yes

Typing

predefined data types such as float or date

yes

primitive types and user defined types (classes)

XML support

Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.

Secondary indexes

yes

via Elasticsearch

SQL

Support of SQL

SQL SELECT statement is SQL:2003 compliant

ANSI SQL for queries (using Apache Calcite)

SQL-like DML and DDL statements

APIs and other access methods

JDBC
ODBC
RESTful HTTP API

HQL (Heroic Query Language, a JSON-based language)
HTTP API

JDBC
ODBC

.NET Client API

Supported programming languages

C++

Java
Python
R
Scala

C#
Java

Server-side scripts

Stored procedures

user defined functions

Triggers

Partitioning methods

Methods for storing different data on different nodes

Sharding

yes, utilizing Spark Core

none

Replication methods

Methods for redundantly storing data on multiple nodes

yes

none

MapReduce

Offers an API for user-defined Map/Reduce methods

yes

Consistency concepts

Methods to ensure consistency in a distributed system

none

Immediate Consistency

Eventual Consistency
Immediate Consistency

Foreign keys

Referential integrity

Transaction concepts

Support to ensure data integrity after non-atomic manipulations of data

Concurrency

Support for concurrent manipulation of data

yes

Durability

Support for making data persistent

Depending on the underlying data source

yes

In-memory capabilities

Is there an option to define some or all structures to be held in-memory only.

Depending on the underlying data source

User concepts

Access control

Depending on the underlying data source

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources

Recent citations in the news

Apache Drill vs. Apache Spark — Which SQL query engine is better for you?
23 September 2019, Towards Data Science

Apache Drill case study: A tutorial on processing CSV files
9 June 2016, TheServerSide.com

Apache Drill Poised to Crack Tough Data Challenges
19 May 2015, Datanami

Apache Drill Eliminates ETL, Data Transformation for MapR Database
11 April 2016, The New Stack

Apache Drill improves big data SQL query engine
31 August 2021, TechTarget

provided by Google News

Migrating from ClickHouse to Apache Doris: Boosting OLAP Performance
9 October 2023, hackernoon.com

Introducing Kyligence Copilot: The AI Copilot for Data to Excel Your KPIs
23 August 2023, insideBIGDATA

Overhauling Apache Kylin for the cloud
18 November 2021, InfoWorld

eBay's Kylin Becomes a Top-Level Apache Open Source Project
9 December 2015, eBay Inc.

How Kyligence Cloud uses Amazon EMR Serverless to simplify OLAP | Amazon Web Services
9 November 2022, AWS Blog

provided by Google News

Review: Google Bigtable scales with ease
7 September 2016, InfoWorld

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performance Insights from Sigma Rule Detections in Spark Streaming
1 June 2024, Towards Data Science

Simba Technologies(R) Introduces New, Powerful JDBC Driver With SQL Connector for Apache Spark(TM)
17 March 2024, Yahoo Singapore News

provided by Google News

Share this page