DB-EnginesExtremeDB: mitigate connectivity issues in a DBMSEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > DuckDB vs. MarkLogic vs. Spark SQL

System Properties Comparison DuckDB vs. MarkLogic vs. Spark SQL

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameDuckDB  Xexclude from comparisonMarkLogic  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionAn embeddable, in-process, column-oriented SQL OLAP RDBMSOperational and transactional Enterprise NoSQL databaseSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelRelational DBMSDocument store
Native XML DBMS
RDF store infoas of version 7
Search engine
Relational DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score4.63
Rank#69  Overall
#37  Relational DBMS
Score5.18
Rank#63  Overall
#11  Document stores
#1  Native XML DBMS
#1  RDF stores
#7  Search engines
Score18.04
Rank#33  Overall
#20  Relational DBMS
Websiteduckdb.orgwww.progress.com/­marklogicspark.apache.org/­sql
Technical documentationduckdb.org/­docswww.progress.com/­marklogic/­documentationspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperMarkLogic Corp.Apache Software Foundation
Initial release201820012014
Current release1.0.0, June 202411.0, December 20223.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoMIT Licensecommercial inforestricted free version is availableOpen Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageC++C++Scala
Server operating systemsserver-lessLinux
OS X
Windows
Linux
OS X
Windows
Data schemeyesschema-free infoSchema can be enforcedyes
Typing infopredefined data types such as float or dateyesyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.noyesno
Secondary indexesyesyesno
SQL infoSupport of SQLyesyes infoSQL92SQL-like DML and DDL statements
APIs and other access methodsArrow Database Connectivity (ADBC)
CLI Client
JDBC
ODBC
Java API
Node.js Client API
ODBC
proprietary Optic API infoProprietary Query API, introduced with version 9
RESTful HTTP API
SPARQL
WebDAV
XDBC
XQuery
XSLT
JDBC
ODBC
Supported programming languagesC
C# info3rd party driver
C++
Crystal info3rd party driver
Go info3rd party driver
Java
Lisp info3rd party driver
Python
R
Ruby info3rd party driver
Rust
Swift
Zig info3rd party driver
C
C#
C++
Java
JavaScript (Node.js)
Perl
PHP
Python
Ruby
Java
Python
R
Scala
Server-side scripts infoStored proceduresnoyes infovia XQuery or JavaScriptno
Triggersnoyesno
Partitioning methods infoMethods for storing different data on different nodesnoneShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesnoneyesnone
MapReduce infoOffers an API for user-defined Map/Reduce methodsnoyes infovia Hadoop Connector, HDFS Direct Access and in-database MapReduce jobs
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate Consistency
Foreign keys infoReferential integritynonono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDACID infocan act as a resource manager in an XA/JTA transactionno
Concurrency infoSupport for concurrent manipulation of datayes, multi-version concurrency control (MVCC)yesyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesyes, with Range Indexesno
User concepts infoAccess controlnoRole-based access control at the document and subdocument levelsno

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
DuckDBMarkLogicSpark SQL
Recent citations in the news

MotherDuck Announces General Availability; Brings Simplicity and Power of DuckDB in a Serverless Data Warehouse
11 June 2024, PR Newswire

DuckDB: The tiny but powerful analytics database
15 May 2024, InfoWorld

DuckDB promises greater stability with 1.0 release
5 June 2024, The Register

My First Billion (of Rows) in DuckDB | by João Pedro | May, 2024
1 May 2024, Towards Data Science

DuckDB: In-Process Python Analytics for Not-Quite-Big Data
31 May 2024, The New Stack

provided by Google News

MarkLogic “The NoSQL Database”. In the MarkLogic Query Console, you can… | by Abhay Srivastava | Apr, 2024
22 April 2024, Medium

Database Platform to Simplify Complex Data | Progress Marklogic
7 February 2023, Progress Software

AI can make logistics data as valuable as intelligence or operational data for mission success
17 April 2024, Breaking Defense

Seven Quick Steps to Setting Up MarkLogic Server in Kubernetes
1 February 2024, release.nl

Intelligence for multi-domain warfighters can now be sourced from logistics operations
13 May 2024, Breaking Defense

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performant IPv4 Range Spark Joins | by Jean-Claude Cote
24 January 2024, Towards Data Science

Simba Technologies(R) Introduces New, Powerful JDBC Driver With SQL Connector for Apache Spark(TM)
17 March 2024, Yahoo Singapore News

provided by Google News



Share this page

Featured Products

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Present your product here