DBMS > Apache IoTDB vs. Apache Kylin vs. DuckDB vs. Faircom DB vs. TerarkDB

System Properties Comparison Apache IoTDB vs. Apache Kylin vs. DuckDB vs. Faircom DB vs. TerarkDB

Editorial information provided by DB-Engines

Name

Description

An IoT native database with high performance for data management and analysis, deployable on the edge and the cloud and integrated with Hadoop, Spark and Flink

A distributed analytics engine for big data, providing a SQL interface and multi-dimensional analysis (OLAP) and leveraging the Hadoop stack

An embeddable, in-process, column-oriented SQL OLAP RDBMS

Native high-speed multi-model DBMS for relational and key-value store data simultaneously accessible through SQL and NoSQL APIs.

A key-value store forked from RocksDB with advanced compression algorithms. It can be used standalone or as a storage engine for MySQL and MongoDB

Primary database model

Time Series DBMS

Relational DBMS

Key-value store
Relational DBMS

Key-value store

DB-Engines Ranking measures the popularity of database management systems
Trend Chart

Score	1.31
Rank	#164	Overall
	#14	Time Series DBMS

Score	1.25
Rank	#170	Overall
	#77	Relational DBMS

Score	4.63
Rank	#69	Overall
	#37	Relational DBMS

Score	0.29
Rank	#304	Overall
	#43	Key-value stores
	#136	Relational DBMS

Score	0.08
Rank	#367	Overall
	#56	Key-value stores

Website

iotdb.apache.org

kylin.apache.org

duckdb.org

www.faircom.com/products/faircom-db

github.com/bytedance/terarkdb

Technical documentation

iotdb.apache.org/UserGuide/Master/QuickStart/QuickStart.html

kylin.apache.org/docs

duckdb.org/docs

docs.faircom.com/docs/en/UUID-7446ae34-a1a7-c843-c894-d5322e395184.html

bytedance.larkoffice.com/docs/doccnZmYFqHBm06BbvYgjsHHcKc

Developer

Apache Software Foundation

Apache Software Foundation, originally contributed from eBay Inc

FairCom Corporation

ByteDance, originally Terark

Initial release

2018

2015

2018

1979

2016

Current release

1.1.0, April 2023

3.1.0, July 2020

0.10, February 2024

V12, November 2020

License

Commercial or Open Source

Open Source

Apache Version 2.0

Open Source

Apache Version 2.0

Open Source

MIT License

commercial

Restricted, free version available

commercial

restricted open source version available

Cloud-based only

Only available as a cloud service

DBaaS offerings (sponsored links)

Database as a Service

Providers of DBaaS offerings, please contact us to be listed.

Implementation language

Java

C++

ANSI C, C++

C++

Server operating systems

All OS with a Java VM (>= 1.8)

Linux

server-less

AIX
FreeBSD
HP-UX
Linux
NetBSD
OS X
QNX
SCO
Solaris
VxWorks
Windows

easily portable to other OSs

Data scheme

yes

schema free, schema optional, schema required, partial schema,

schema-free

Typing

predefined data types such as float or date

yes

yes, ANSI SQL Types, JSON, typed binary structures

XML support

Some form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.

Secondary indexes

yes

SQL

Support of SQL

SQL-like query language

ANSI SQL for queries (using Apache Calcite)

yes

yes, ANSI SQL with proprietary extensions

APIs and other access methods

JDBC
Native API

JDBC
ODBC
RESTful HTTP API

Arrow Database Connectivity (ADBC)
CLI Client
JDBC
ODBC

ADO.NET
Direct SQL
JDBC
JPA
ODBC
RESTful HTTP/JSON API
RESTful MQTT/JSON API
RPC

C++ API
Java API

Supported programming languages

C
C#
C++
Go
Java
Python
Scala

C
C#

3rd party driver
C++
Crystal

3rd party driver
Go

3rd party driver
Java
Lisp

3rd party driver
Python
R
Ruby

3rd party driver
Rust
Swift
Zig

3rd party driver

.Net
C
C#
C++
Java
JavaScript (Node.js and browser)
PHP
Python
Visual Basic

C++
Java

Server-side scripts

Stored procedures

yes

.Net, JavaScript, C/C++

Triggers

yes

Partitioning methods

Methods for storing different data on different nodes

horizontal partitioning (by time range) + vertical partitioning (by deviceId)

none

File partitioning, horizontal partitioning, sharding

Customizable business rules for table partitioning

none

Replication methods

Methods for redundantly storing data on multiple nodes

selectable replication methods; using Raft/IoTConsensus algorithm to ensure strong/eventual data consistency among multiple replicas

none

yes, configurable to be parallel or serial, synchronous or asynchronous, uni-directional or bi-directional, ACID-consistent or eventually consistent (with custom conflict resolution).

none

MapReduce

Offers an API for user-defined Map/Reduce methods

Integration with Hadoop and Spark

yes

Consistency concepts

Methods to ensure consistency in a distributed system

Eventual Consistency
Strong Consistency with Raft

Immediate Consistency

Eventual Consistency
Immediate Consistency
Tunable consistency per server, database, table, and transaction

Foreign keys

Referential integrity

yes

Transaction concepts

Support to ensure data integrity after non-atomic manipulations of data

ACID

tunable from ACID to Eventually Consistent

Concurrency

Support for concurrent manipulation of data

yes

yes, multi-version concurrency control (MVCC)

yes

Durability

Support for making data persistent

yes

Yes, tunable from durable to delayed durability to in-memory

yes

In-memory capabilities

Is there an option to define some or all structures to be held in-memory only.

yes

User concepts

Access control

yes

Fine grained access rights according to SQL-standard with additional protections for files

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources

Recent citations in the news

TsFile: A Standard Format for IoT Time Series Data
27 February 2024, The New Stack

Linux 6.5 With AMD P-State EPP Default Brings Performance & Power Efficiency Benefits For Ryzen Servers
21 September 2023, Phoronix

AMD EPYC 8324P / 8324PN Siena 32-Core Siena Linux Server Performance Review
10 October 2023, Phoronix

Intel Xeon Max Enjoying Some Performance Gains With Linux 6.6
12 October 2023, Phoronix

IoTDB Provides Data Management for Industrial Edge IT
15 October 2020, The New Stack

provided by Google News

Migrating from ClickHouse to Apache Doris: Boosting OLAP Performance
9 October 2023, hackernoon.com

Overhauling Apache Kylin for the cloud
18 November 2021, InfoWorld

eBay's Kylin Becomes a Top-Level Apache Open Source Project
9 December 2015, eBay Inc.

The Apache Software Foundation Announces Apache™ Kylin™ as a Top-Level Project
8 December 2015, GlobeNewswire

How Kyligence Cloud uses Amazon EMR Serverless to simplify OLAP | Amazon Web Services
9 November 2022, AWS Blog

provided by Google News

DuckDB: In-Process Python Analytics for Not-Quite-Big Data
31 May 2024, The New Stack

MotherDuck launches its DuckDB-based cloud analytics platform
30 May 2024, MSN

DuckDB Walks to the Beat of Its Own Analytics Drum
5 March 2024, Datanami

DuckDB: The tiny but powerful analytics database
15 May 2024, InfoWorld

My First Billion (of Rows) in DuckDB | by João Pedro | May, 2024
1 May 2024, Towards Data Science

provided by Google News

FairCom kicks off new era of database technology USA - English
10 November 2020, PR Newswire

World's First Converged IIoT Hub to be Showcased at IoT Tech Expo
3 September 2021, Automation.com

provided by Google News

Share this page