DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Amazon DynamoDB vs. Kdb vs. Microsoft Azure Data Explorer vs. Spark SQL

System Properties Comparison Amazon DynamoDB vs. Kdb vs. Microsoft Azure Data Explorer vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameAmazon DynamoDB  Xexclude from comparisonKdb  Xexclude from comparisonMicrosoft Azure Data Explorer  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionHosted, scalable database service by Amazon with the data stored in Amazons cloudHigh performance Time Series DBMSFully managed big data interactive analytics platformSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelDocument store
Key-value store
Time Series DBMS
Vector DBMS
Relational DBMS infocolumn orientedRelational DBMS
Secondary database modelsRelational DBMSDocument store infoIf a column is of type dynamic docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-types/­dynamic then it's possible to add arbitrary JSON documents in this cell
Event Store infothis is the general usage pattern at Microsoft. Billing, Logs, Telemetry events are stored in ADX and the state of an individual entity is defined by the arg_max(timestamps)
Spatial DBMS
Search engine infosupport for complex search expressions docs.microsoft.com/­en-us/­azure/­kusto/­query/­parseoperator FTS, Geospatial docs.microsoft.com/­en-us/­azure/­kusto/­query/­geo-point-to-geohash-function distributed search -> ADX acts as a distributed search engine
Time Series DBMS infosee docs.microsoft.com/­en-us/­azure/­data-explorer/­time-series-analysis
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score74.07
Rank#17  Overall
#3  Document stores
#2  Key-value stores
Score7.55
Rank#53  Overall
#3  Time Series DBMS
#1  Vector DBMS
Score4.38
Rank#77  Overall
#41  Relational DBMS
Score18.96
Rank#33  Overall
#20  Relational DBMS
Websiteaws.amazon.com/­dynamodbkx.comazure.microsoft.com/­services/­data-explorerspark.apache.org/­sql
Technical documentationdocs.aws.amazon.com/­dynamodbcode.kx.comdocs.microsoft.com/­en-us/­azure/­data-explorerspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperAmazonKx Systems, a division of First Derivatives plcMicrosoftApache Software Foundation
Initial release20122000 infokdb was released 2000, kdb+ in 200320192014
Current release3.6, May 2018cloud service with continuous releases3.5.0 ( 2.13), September 2023
License infoCommercial or Open Sourcecommercial infofree tier for a limited amount of database operationscommercial infofree 32-bit versioncommercialOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud serviceyesnoyesno
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageqScala
Server operating systemshostedLinux
OS X
Solaris
Windows
hostedLinux
OS X
Windows
Data schemeschema-freeyesFixed schema with schema-less datatypes (dynamic)yes
Typing infopredefined data types such as float or dateyesyesyes infobool, datetime, dynamic, guid, int, long, real, string, timespan, double: docs.microsoft.com/­en-us/­azure/­kusto/­query/­scalar-data-typesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.yesyesno
Secondary indexesyesyes infotable attribute 'grouped'all fields are automatically indexedno
SQL infoSupport of SQLnoSQL-like query language (q)Kusto Query Language (KQL), SQL subsetSQL-like DML and DDL statements
APIs and other access methodsRESTful HTTP APIHTTP API
JDBC
Jupyter
Kafka
ODBC
WebSocket
Microsoft SQL Server communication protocol (MS-TDS)
RESTful HTTP API
JDBC
ODBC
Supported programming languages.Net
ColdFusion
Erlang
Groovy
Java
JavaScript
Perl
PHP
Python
Ruby
C
C#
C++
Go
J
Java
JavaScript
Lua
MatLab
Perl
PHP
Python
R
Scala
.Net
Go
Java
JavaScript (Node.js)
PowerShell
Python
R
Java
Python
R
Scala
Server-side scripts infoStored proceduresnouser defined functionsYes, possible languages: KQL, Python, Rno
Triggersyes infoby integration with AWS Lambdayes infowith viewsyes infosee docs.microsoft.com/­en-us/­azure/­kusto/­management/­updatepolicyno
Partitioning methods infoMethods for storing different data on different nodesShardinghorizontal partitioningSharding infoImplicit feature of the cloud serviceyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyesSource-replica replicationyes infoImplicit feature of the cloud service. Replication either local, cross-facility or geo-redundant.none
MapReduce infoOffers an API for user-defined Map/Reduce methodsno infomay be implemented via Amazon Elastic MapReduce (Amazon EMR)no infosimilar paradigm used for internal processingSpark connector (open source): github.com/­Azure/­azure-kusto-spark
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency
Immediate Consistency infocan be specified for read operations
Immediate ConsistencyEventual Consistency
Immediate Consistency
Foreign keys infoReferential integritynoyesnono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACID infoACID across one or more tables within a single AWS account and regionnonono
Concurrency infoSupport for concurrent manipulation of datayesyesyesyes
Durability infoSupport for making data persistentyesyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesnono
User concepts infoAccess controlAccess rights for users and roles can be defined via the AWS Identity and Access Management (IAM)rights management via user accountsAzure Active Directory Authenticationno
More information provided by the system vendor
Amazon DynamoDBKdbMicrosoft Azure Data ExplorerSpark SQL
Specific characteristicsIntegrated columnar database & programming system for streaming, real time and historical...
» more
Competitive advantagesprovides seamless scalability; runs on industry standard server platforms; is top-ranked...
» more
Typical application scenariostick database streaming sensor data massive intelligence applications oil and gas...
» more
Key customersGoldman Sachs Morgan Stanley Merrill Lynch J.P. Morgan Deutsche Bank IEX Securities...
» more
Market metricskdb+ performance and reliability proven by our customers in critical infrastructure...
» more
Licensing and pricing modelsupon request
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesCData: Connect to Big Data & NoSQL through standard Drivers.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Amazon DynamoDBKdbMicrosoft Azure Data ExplorerSpark SQL
DB-Engines blog posts

Cloud-based DBMS's popularity grows at high rates
12 December 2019, Paul Andlinger

The popularity of cloud-based DBMSs has increased tenfold in four years
7 February 2017, Matthias Gelbmann

Increased popularity for consuming DBMS services out of the cloud
2 October 2015, Paul Andlinger

show all

Recent citations in the news

Introducing configurable maximum throughput for Amazon DynamoDB on-demand | Amazon Web Services
3 May 2024, AWS Blog

AWS announces Amazon DynamoDB zero-ETL integration with Amazon OpenSearch Service
28 November 2023, AWS Blog

Simplify cross-account access control with Amazon DynamoDB using resource-based policies | Amazon Web Services
20 March 2024, AWS Blog

A new and improved AWS CDK construct for Amazon DynamoDB tables | Amazon Web Services
31 January 2024, AWS Blog

Bulk update Amazon DynamoDB tables with AWS Step Functions | Amazon Web Services
20 March 2024, AWS Blog

provided by Google News

Turbocharging the Engine: KX Unleashes AI-First Transformation with kdb+
28 February 2024, Business Wire

KX JOINS SNOWFLAKE PARTNER NETWORK
27 June 2023, PR Newswire

McLaren Applied and KX partner to enhance ATLAS software analytics capabilities
9 August 2023, Professional Motorsport World

Introducing Amazon FinSpace with Managed kdb Insights, a fully managed analytics engine, commonly used by capital ...
18 May 2023, AWS Blog

KX Brings the Power and Performance of Kdb+ to Python Developers With PyKX
8 June 2023, AiThority

provided by Google News

Introducing Microsoft Fabric: The data platform for the era of AI | Microsoft Azure Blog
23 May 2023, azure.microsoft.com

Azure Data Explorer: Log and telemetry analytics benchmark
16 August 2022, azure.microsoft.com

Providing modern data transfer and storage service at Microsoft with Microsoft Azure - Inside Track Blog
13 July 2023, Microsoft

Azure Data Explorer and Stream Analytics for anomaly detection
16 January 2020, azure.microsoft.com

Controlling costs in Azure Data Explorer using down-sampling and aggregation
11 February 2019, azure.microsoft.com

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performant IPv4 Range Spark Joins | by Jean-Claude Cote
24 January 2024, Towards Data Science

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS | Amazon Web Services
18 October 2023, AWS Blog

provided by Google News



Share this page

Featured Products

RaimaDB logo

RaimaDB, embedded database for mission-critical applications. When performance, footprint and reliability matters.
Try RaimaDB for free.

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

SingleStore logo

Build AI apps with Vectors on SQL and JSON with milliseconds response times.
Try it today.

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here