DB-EnginesExtremeDB: mitigate connectivity issues in a DBMSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Databricks vs. Elasticsearch vs. Microsoft Azure Data Explorer

System Properties Comparison Databricks vs. Elasticsearch vs. Microsoft Azure Data Explorer

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameDatabricks  Xexclude from comparisonElasticsearch  Xexclude from comparisonMicrosoft Azure Data Explorer  Xexclude from comparison
DescriptionThe Databricks Lakehouse Platform combines elements of data lakes and data warehouses to provide a unified view onto structured and unstructured data. It is based on Apache Spark.A distributed, RESTful modern search and analytics engine based on Apache Lucene infoElasticsearch lets you perform and combine many types of searches such as structured, unstructured, geo, and metricFully managed big data interactive analytics platform
Primary database modelDocument store
Relational DBMS
Search engineRelational DBMS infocolumn oriented
Secondary database modelsDocument store
Spatial DBMS
Vector DBMS
Document store infoIf a column is of type dynamic docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-types/­dynamic then it's possible to add arbitrary JSON documents in this cell
Event Store infothis is the general usage pattern at Microsoft. Billing, Logs, Telemetry events are stored in ADX and the state of an individual entity is defined by the arg_max(timestamps)
Spatial DBMS
Search engine infosupport for complex search expressions docs.microsoft.com/­en-us/­azure/­kusto/­query/­parseoperator FTS, Geospatial docs.microsoft.com/­en-us/­azure/­kusto/­query/­geo-point-to-geohash-function distributed search -> ADX acts as a distributed search engine
Time Series DBMS infosee docs.microsoft.com/­en-us/­azure/­data-explorer/­time-series-analysis
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score81.08
Rank#15  Overall
#2  Document stores
#10  Relational DBMS
Score132.83
Rank#7  Overall
#1  Search engines
Score3.80
Rank#81  Overall
#43  Relational DBMS
Websitewww.databricks.comwww.elastic.co/­elasticsearchazure.microsoft.com/­services/­data-explorer
Technical documentationdocs.databricks.comwww.elastic.co/­guide/­en/­elasticsearch/­reference/­current/­index.htmldocs.microsoft.com/­en-us/­azure/­data-explorer
DeveloperDatabricksElasticMicrosoft
Initial release201320102019
Current release8.6, January 2023cloud service with continuous releases
License infoCommercial or Open SourcecommercialOpen Source infoElastic Licensecommercial
Cloud-based only infoOnly available as a cloud serviceyesnoyes
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJava
Server operating systemshostedAll OS with a Java VMhosted
Data schemeFlexible Schema (defined schema, partial schema, schema free)schema-free infoFlexible type definitions. Once a type is defined, it is persistentFixed schema with schema-less datatypes (dynamic)
Typing infopredefined data types such as float or dateyesyes infobool, datetime, dynamic, guid, int, long, real, string, timespan, double: docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-types
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.yesnoyes
Secondary indexesyesyes infoAll search fields are automatically indexedall fields are automatically indexed
SQL infoSupport of SQLwith Databricks SQLSQL-like query languageKusto Query Language (KQL), SQL subset
APIs and other access methodsJDBC
ODBC
RESTful HTTP API
Java API
RESTful HTTP/JSON API
Microsoft SQL Server communication protocol (MS-TDS)
RESTful HTTP API
Supported programming languagesPython
R
Scala
.Net
Groovy
Community Contributed Clients
Java
JavaScript
Perl
PHP
Python
Ruby
.Net
Go
Java
JavaScript (Node.js)
PowerShell
Python
R
Server-side scripts infoStored proceduresuser defined functions and aggregatesyesYes, possible languages: KQL, Python, R
Triggersyes infoby using the 'percolation' featureyes infosee docs.microsoft.com/­en-us/­azure/­kusto/­management/­updatepolicy
Partitioning methods infoMethods for storing different data on different nodesShardingSharding infoImplicit feature of the cloud service
Replication methods infoMethods for redundantly storing data on multiple nodesyesyesyes infoImplicit feature of the cloud service. Replication either local, cross-facility or geo-redundant.
MapReduce infoOffers an API for user-defined Map/Reduce methodsES-Hadoop ConnectorSpark connector (open source): github.com/­Azure/­azure-kusto-spark
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual Consistency infoSynchronous doc based replication. Get by ID may show delays up to 1 sec. Configurable write consistency: one, quorum, allEventual Consistency
Immediate Consistency
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDnono
Concurrency infoSupport for concurrent manipulation of datayesyesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noMemcached and Redis integrationno
User concepts infoAccess controlAzure Active Directory Authentication
More information provided by the system vendor
DatabricksElasticsearchMicrosoft Azure Data Explorer
Specific characteristicsSupported database models : In addition to the Document store and Relational DBMS...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
DatabricksElasticsearchMicrosoft Azure Data Explorer
DB-Engines blog posts

PostgreSQL is the DBMS of the Year 2023
2 January 2024, Matthias Gelbmann, Paul Andlinger

show all

PostgreSQL is the DBMS of the Year 2017
2 January 2018, Paul Andlinger, Matthias Gelbmann

Elasticsearch moved into the top 10 most popular database management systems
3 July 2017, Matthias Gelbmann

MySQL, PostgreSQL and Redis are the winners of the March ranking
2 March 2016, Paul Andlinger

show all

Recent citations in the news

Databricks is Taking the Ultimate Risk of Building 'USB for AI' – AIM
15 June 2024, Analytics India Magazine

The Three Big Announcements by Databricks AI Team in June 2024
17 June 2024, MarkTechPost

Databricks launches LakeFlow to help its customers build their data pipelines
12 June 2024, TechCrunch

Databricks tells investors annualized revenue will reach $2.4 billion at midway point of year
13 June 2024, CNBC

Databricks open-sources Unity Catalog, challenging Snowflake on interoperability for data workloads
12 June 2024, VentureBeat

provided by Google News

8 Powerful Alternatives to Elasticsearch
25 April 2024, Yahoo Finance

Splunk vs Elasticsearch | A Comparison and How to Choose
12 January 2024, SentinelOne

Introducing Elasticsearch Vector Database to Azure OpenAI Service On Your Data (Preview)
26 March 2024, insider.govtech.com

Netflix Uses Elasticsearch Percolate Queries to Implement Reverse Searches Efficiently
29 April 2024, InfoQ.com

Elasticsearch Open Inference API Supports Cohere Rerank 3
11 April 2024, Business Wire

provided by Google News

We’re retiring Azure Time Series Insights on 7 July 2024 – transition to Azure Data Explorer | Azure updates
31 May 2024, Microsoft

Update records in a Kusto Database (public preview) | Azure updates
20 February 2024, Microsoft

Public Preview: Azure Data Explorer connector for Apache Flink | Azure updates
8 January 2024, Microsoft

Announcing General Availability to migrate Virtual Network injected Azure Data Explorer Cluster to Private Endpoints ...
5 February 2024, Microsoft

Migration of Azure Virtual Network injected Azure Data Explorer cluster to Private Endpoints | Azure updates
4 December 2023, Microsoft

provided by Google News



Share this page

Featured Products

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here