DB-EnginesExtremeDB: the first and only COTS deterministic embedded database management system for mission- and safety-critical hard real-time applicationsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Kylin vs. DuckDB vs. Spark SQL

System Properties Comparison Apache Kylin vs. DuckDB vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameApache Kylin  Xexclude from comparisonDuckDB  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionA distributed analytics engine for big data, providing a SQL interface and multi-dimensional analysis (OLAP) and leveraging the Hadoop stackAn embeddable, in-process, column-oriented SQL OLAP RDBMSSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSRelational DBMSRelational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score1.36
Rank#145  Overall
#71  Relational DBMS
Score0.18
Rank#291  Overall
#135  Relational DBMS
Score22.94
Rank#34  Overall
#20  Relational DBMS
Websitekylin.apache.orgduckdb.orgspark.apache.org/­sql
Technical documentationkylin.apache.org/­docsduckdb.org/­docsspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation, originally contributed from eBay IncApache Software Foundation
Initial release201520182014
Current release3.1.0, July 20200.2, August 20203.1.1, March 2021
License infoCommercial or Open SourceOpen Source infoApache Version 2.0Open Source infoMIT LicenseOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaC++Scala
Server operating systemsLinuxserver-lessLinux
OS X
Windows
Data schemeyesyesyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesyesyesno
SQL infoSupport of SQLANSI SQL for queries (using Apache Calcite)yesSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
RESTful HTTP API
CLI Client
JDBC
JDBC
ODBC
Supported programming languagesC
C++
Go info3rd party driver
Java
Python
R
Ruby info3rd party driver
Java
Python
R
Scala
Server-side scripts infoStored proceduresnono
Triggersnono
Partitioning methods infoMethods for storing different data on different nodesnoneyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnonenone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyesno
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDno
Concurrency infoSupport for concurrent manipulation of datayesyes, multi-version concurrency control (MVCC)yes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noyesno
User concepts infoAccess controlnono

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache KylinDuckDBSpark SQL
Recent citations in the news

Kyligence Joins AWS ISV Accelerate Program
29 September 2021, GlobeNewswire

Distributed OLAPer Kyligence accelerates core engine, adds real-time data support – Blocks and Files
10 August 2021, Blocks and Files

Kyligence Doubles Down on Cubes in the Cloud
22 January 2021, Datanami

Big Data Analytics Startup Kyligence Raises $70M In Series D Funding
21 April 2021, CRN

Apache Kylin Adds Real-time OLAP
3 January 2020, iProgrammer

provided by Google News

New CWI spin-off company DuckDB Labs: Solutions for fast database analytics
14 July 2021, Centrum Wiskunde & Informatica (CWI)

Apache Arrow 5 Improves Asynchronous Scanner
16 August 2021, iProgrammer

4 predictions for open source in 2021
29 December 2020, IDG Connect

provided by Google News

Online workshop: Scalable data science with Python and Spark
12 October 2021, Market Research Telecast

Java Vs Python For Data Science
20 October 2021, Analytics India Magazine

Here is Everything You Need to Know About Big Data Warehouse Manager
7 October 2021, Analytics Insight

Analytics Chip Startup Speedata Emerges from Stealth
30 September 2021, Datanami

Top 15 Online Programming Language Courses to Take Up in 2021
5 October 2021, Analytics Insight

provided by Google News

Job opportunities

Presales Solution Architect
Kyligence, United States

US Engineer, Mandarin Speaking
Kyligence, United States

Staff, Data DevOps Engineer
Rivian Automotive, Seattle, WA

Data Analyst
LT Technology Services, Spring, TX

Technical Delivery Lead - Remote Opportunity!
General Dynamics Information Technology, United States

Data Engineer, remote
RocketPower, United States

Data Engineer
NexInfo Solutions, Remote

Data Analyst
Lenovo, Morrisville, NC

jobs by Indeed



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 5 GB free..

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Present your product here