DB-EnginesExtremeDB: mitigate connectivity issues in a DBMSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Kylin vs. LMDB vs. OpenSearch vs. Spark SQL

System Properties Comparison Apache Kylin vs. LMDB vs. OpenSearch vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameApache Kylin  Xexclude from comparisonLMDB  Xexclude from comparisonOpenSearch  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionA distributed analytics engine for big data, providing a SQL interface and multi-dimensional analysis (OLAP) and leveraging the Hadoop stackA high performant, light-weight, embedded key-value database libraryA distributed, RESTful search and analytics engine forked from Elasticsearch and based on Apache LuceneSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSKey-value storeSearch engineRelational DBMS
Secondary database modelsVector DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score1.25
Rank#170  Overall
#77  Relational DBMS
Score2.09
Rank#121  Overall
#20  Key-value stores
Score16.03
Rank#37  Overall
#4  Search engines
Score18.04
Rank#33  Overall
#20  Relational DBMS
Websitekylin.apache.orgwww.symas.com/­symas-embedded-database-lmdbgithub.com/­opensearch-project
opensearch.org
spark.apache.org/­sql
Technical documentationkylin.apache.org/­docswww.lmdb.tech/­docopensearch.org/­docs/­latestspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperApache Software Foundation, originally contributed from eBay IncSymasAmazon Web ServicesApache Software Foundation
Initial release2015201120212014
Current release3.1.0, July 20200.9.32, January 20242.5.0, January 20233.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache Version 2.0Open SourceOpen Source infoApache Version 2.0Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenononono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
  • Aiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
  • STACKIT OpenSearch offers OpenSearch in a managed version in enterprise grade, 100% GDPR-compliant, for a wide range of applications like analytics, website search, offering scalability and fast data access.
Implementation languageJavaCJavaScala
Server operating systemsLinuxLinux
Unix
Windows
All OS with a Java VMLinux
OS X
Windows
Data schemeyesschema-freeschema-free infoFlexible type definitions. Once a type is defined, it is persistentyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesyesnoyes infoAll search fields are automatically indexedno
SQL infoSupport of SQLANSI SQL for queries (using Apache Calcite)noSQL-like query languageSQL-like DML and DDL statements
APIs and other access methodsJDBC
ODBC
RESTful HTTP API
Java API
RESTful HTTP/JSON API
JDBC
ODBC
Supported programming languages.Net
C
C++
Clojure
Go
Haskell
Java
JavaScript (Node.js)
Lisp
Lua
MatLab
Nim
Objective C
OCaml
Perl
PHP
Python
R
Ruby
Rust
Swift
Tcl
Go
Java
JavaScript (Node.js)
PHP
Python
Ruby infoElasticsearch client
Java
Python
R
Scala
Server-side scripts infoStored proceduresnoyesno
Triggersnoyes infoby using the 'percolation' featureno
Partitioning methods infoMethods for storing different data on different nodesnoneShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnoneyesnone
MapReduce infoOffers an API for user-defined Map/Reduce methodsyesno
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate ConsistencyEventual Consistency infoSynchronous doc based replication. Get by ID may show delays up to 1 sec. Configurable write consistency: one, quorum, all
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDnono
Concurrency infoSupport for concurrent manipulation of datayesyesyesyes
Durability infoSupport for making data persistentyesyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noyesno
User concepts infoAccess controlnono
More information provided by the system vendor
Apache KylinLMDBOpenSearchSpark SQL
Specific characteristicsOpenSearch is a highly scalable and extensible open-source software suite for search,...
» more
Competitive advantagesDistributed as fully open source under Apache License, Version 2.0 (ALv2), OpenSearch...
» more
Typical application scenariosThe OpenSearch platform is used across a broad range of search , analytics, and observability...
» more
Licensing and pricing modelsThe OpenSearch Project offers open source software licensed under Apache License...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesAiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache KylinLMDBOpenSearchSpark SQL
Recent citations in the news

Migrating from ClickHouse to Apache Doris: Boosting OLAP Performance
9 October 2023, hackernoon.com

Introducing Kyligence Copilot: The AI Copilot for Data to Excel Your KPIs
23 August 2023, insideBIGDATA

Overhauling Apache Kylin for the cloud
18 November 2021, InfoWorld

eBay's Kylin Becomes a Top-Level Apache Open Source Project
9 December 2015, eBay Inc.

How Kyligence Cloud uses Amazon EMR Serverless to simplify OLAP | Amazon Web Services
9 November 2022, AWS Blog

provided by Google News

Automating SAP S/4HANA Migration with IT-Conductor, BGP Managed Services, and AWS | Amazon Web Services
22 August 2023, AWS Blog

The Tom Brady Data Biography
8 September 2023, StatsBomb

The Lightning Memory-mapped Database
2 March 2016, InfoQ.com

Akamai launches managed database service – Blocks and Files
25 April 2022, Blocks and Files

Connecting the worlds of metabolomics databases
15 June 2021, Medical Xpress

provided by Google News

Amazon OpenSearch Ingestion now supports ingesting streaming data from Amazon MSK Serverless - AWS
6 June 2024, AWS Blog

Behind the Scenes: Upgrading OpenSearch efficiency with OCI flexible vertical scaling
13 February 2024, Oracle

Amazon OpenSearch Service now supports OpenSearch version 2.13 - AWS
21 May 2024, AWS Blog

AWS announces Amazon DocumentDB zero-ETL integration with Amazon OpenSearch Service
16 May 2024, AWS Blog

Amazon OpenSearch Serverless now available in Europe (London) and Asia Pacific (Mumbai)
16 May 2024, AWS Blog

provided by Google News

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS | Amazon Web Services
18 October 2023, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Performance Insights from Sigma Rule Detections in Spark Streaming
1 June 2024, Towards Data Science

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

provided by Google News



Share this page

Featured Products

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here