DB-EnginesExtremeDB for everyone with an RTOSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Kdb vs. Microsoft Azure Data Explorer vs. Snowflake vs. Sphinx

System Properties Comparison Kdb vs. Microsoft Azure Data Explorer vs. Snowflake vs. Sphinx

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameKdb  Xexclude from comparisonMicrosoft Azure Data Explorer  Xexclude from comparisonSnowflake  Xexclude from comparisonSphinx  Xexclude from comparison
DescriptionHigh performance Time Series DBMSFully managed big data interactive analytics platformCloud-based data warehousing service for structured and semi-structured dataOpen source search engine for searching in data from different sources, e.g. relational databases
Primary database modelTime Series DBMS
Vector DBMS
Relational DBMS infocolumn orientedRelational DBMSSearch engine
Secondary database modelsRelational DBMSDocument store infoIf a column is of type dynamic docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-types/­dynamic then it's possible to add arbitrary JSON documents in this cell
Event Store infothis is the general usage pattern at Microsoft. Billing, Logs, Telemetry events are stored in ADX and the state of an individual entity is defined by the arg_max(timestamps)
Spatial DBMS
Search engine infosupport for complex search expressions docs.microsoft.com/­en-us/­azure/­kusto/­query/­parseoperator FTS, Geospatial docs.microsoft.com/­en-us/­azure/­kusto/­query/­geo-point-to-geohash-function distributed search -> ADX acts as a distributed search engine
Time Series DBMS infosee docs.microsoft.com/­en-us/­azure/­data-explorer/­time-series-analysis
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score7.70
Rank#53  Overall
#3  Time Series DBMS
#1  Vector DBMS
Score5.16
Rank#69  Overall
#37  Relational DBMS
Score123.20
Rank#9  Overall
#6  Relational DBMS
Score6.03
Rank#60  Overall
#6  Search engines
Websitekx.comazure.microsoft.com/­services/­data-explorerwww.snowflake.comsphinxsearch.com
Technical documentationcode.kx.comdocs.microsoft.com/­en-us/­azure/­data-explorerdocs.snowflake.net/­manuals/­index.htmlsphinxsearch.com/­docs
DeveloperKx Systems, a division of First Derivatives plcMicrosoftSnowflake Computing Inc.Sphinx Technologies Inc.
Initial release2000 infokdb was released 2000, kdb+ in 2003201920142001
Current release3.6, May 2018cloud service with continuous releases3.5.1, February 2023
License infoCommercial or Open Sourcecommercial infofree 32-bit versioncommercialcommercialOpen Source infoGPL version 2, commercial licence available
Cloud-based only infoOnly available as a cloud servicenoyesyesno
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageqC++
Server operating systemsLinux
OS X
Solaris
Windows
hostedhostedFreeBSD
Linux
NetBSD
OS X
Solaris
Windows
Data schemeyesFixed schema with schema-less datatypes (dynamic)yes infosupport of semi-structured data formats (JSON, XML, Avro)yes
Typing infopredefined data types such as float or dateyesyes infobool, datetime, dynamic, guid, int, long, real, string, timespan, double: docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-typesyesno
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.yesyesyes
Secondary indexesyes infotable attribute 'grouped'all fields are automatically indexedyes infofull-text index on all search fields
SQL infoSupport of SQLSQL-like query language (q)Kusto Query Language (KQL), SQL subsetyesSQL-like query language (SphinxQL)
APIs and other access methodsHTTP API
JDBC
Jupyter
Kafka
ODBC
WebSocket
Microsoft SQL Server communication protocol (MS-TDS)
RESTful HTTP API
CLI Client
JDBC
ODBC
Proprietary protocol
Supported programming languagesC
C#
C++
Go
J
Java
JavaScript
Lua
MatLab
Perl
PHP
Python
R
Scala
.Net
Go
Java
JavaScript (Node.js)
PowerShell
Python
R
JavaScript (Node.js)
Python
C++ infounofficial client library
Java
Perl infounofficial client library
PHP
Python
Ruby infounofficial client library
Server-side scripts infoStored proceduresuser defined functionsYes, possible languages: KQL, Python, Ruser defined functionsno
Triggersyes infowith viewsyes infosee docs.microsoft.com/­en-us/­azure/­kusto/­management/­updatepolicyno infosimilar concept for controling cloud resourcesno
Partitioning methods infoMethods for storing different data on different nodeshorizontal partitioningSharding infoImplicit feature of the cloud serviceyesSharding infoPartitioning is done manually, search queries against distributed index is supported
Replication methods infoMethods for redundantly storing data on multiple nodesSource-replica replicationyes infoImplicit feature of the cloud service. Replication either local, cross-facility or geo-redundant.yesnone
MapReduce infoOffers an API for user-defined Map/Reduce methodsno infosimilar paradigm used for internal processingSpark connector (open source): github.com/­Azure/­azure-kusto-sparknono
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyEventual Consistency
Immediate Consistency
Immediate Consistency
Foreign keys infoReferential integrityyesnoyesno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanonoACIDno
Concurrency infoSupport for concurrent manipulation of datayesyesyesyes
Durability infoSupport for making data persistentyesyesyesyes infoThe original contents of fields are not stored in the Sphinx index.
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesnono
User concepts infoAccess controlrights management via user accountsAzure Active Directory AuthenticationUsers with fine-grained authorization concept, user roles and pluggable authenticationno
More information provided by the system vendor
KdbMicrosoft Azure Data ExplorerSnowflakeSphinx
Specific characteristicsIntegrated columnar database & programming system for streaming, real time and historical...
» more
Competitive advantagesprovides seamless scalability; runs on industry standard server platforms; is top-ranked...
» more
Typical application scenariostick database streaming sensor data massive intelligence applications oil and gas...
» more
Key customersGoldman Sachs Morgan Stanley Merrill Lynch J.P. Morgan Deutsche Bank IEX Securities...
» more
Market metricskdb+ performance and reliability proven by our customers in critical infrastructure...
» more
Licensing and pricing modelsupon request
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesCData: Connect to Big Data & NoSQL through standard Drivers.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
KdbMicrosoft Azure Data ExplorerSnowflakeSphinx
DB-Engines blog posts

Snowflake is the DBMS of the Year 2022, defending the title from last year
3 January 2023, Matthias Gelbmann, Paul Andlinger

Snowflake is the DBMS of the Year 2021
3 January 2022, Paul Andlinger, Matthias Gelbmann

show all

The DB-Engines ranking includes now search engines
4 February 2013, Paul Andlinger

show all

Recent citations in the news

Turbocharging the Engine: KX Unleashes AI-First Transformation with kdb+
28 February 2024, Business Wire

Introducing Amazon FinSpace with Managed kdb Insights, a fully managed analytics engine, commonly used by capital ...
18 May 2023, AWS Blog

KX ANNOUNCES KDB INSIGHTS AS FULLY MANAGED SERVICE ON AMAZON FINSPACE
18 May 2023, PR Newswire

McLaren Applied and KX partner to enhance ATLAS software analytics capabilities
9 August 2023, Professional Motorsport World

KX Brings the Power and Performance of kdb+ to Python Developers with PyKX
7 June 2023, Datanami

provided by Google News

Azure Data Explorer: Log and telemetry analytics benchmark
16 August 2022, azure.microsoft.com

Providing modern data transfer and storage service at Microsoft with Microsoft Azure - Inside Track Blog
13 July 2023, Microsoft

General availability: New KQL function to enrich your data analysis with geographic context | Azure updates
6 June 2023, azure.microsoft.com

What is Microsoft Fabric? A big tech stack for big data
9 February 2024, InfoWorld

Azure Data Explorer and Stream Analytics for anomaly detection
16 January 2020, azure.microsoft.com

provided by Google News

Stream data into Snowflake using Amazon Data Firehose and Snowflake Snowpipe Streaming
17 April 2024, AWS Blog

MessageGears to operate with the Snowflake data cloud
9 April 2024, MarTech

Coalesce raises more cash to transform data for Snowflake customers
4 April 2024, TechCrunch

What Is Snowflake Data Warehouse? A Tutorial
9 April 2024, Built In

Partnership Brings Cutting-Edge LLMs from Mistral AI Into Snowflake Data Cloud
12 April 2024, Acceleration Economy

provided by Google News

Switching From Sphinx to MkDocs Documentation — What Did I Gain and Lose
2 February 2024, Towards Data Science

Manticore is a Faster Alternative to Elasticsearch in C++
25 July 2022, hackernoon.com

Perplexity AI: From Its Use To Operation, Everything You Need To Know About Googles Newest Challenger
11 January 2024, Free Press Journal

The Pirate Bay was recently down for over a week due to a DDoS attack
29 October 2019, The Hacker News

How to Build 600+ Links in One Month
4 September 2020, Search Engine Journal

provided by Google News



Share this page

Featured Products

SingleStore logo

The database to transact, analyze and contextualize your data in real time.
Try it today.

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Ontotext logo

GraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs. Get it free.

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here