DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > OpenSearch vs. Spark SQL

System Properties Comparison OpenSearch vs. Spark SQL

Please select another system to include it in the comparison.

Our visitors often compare OpenSearch and Spark SQL with PostgreSQL, MySQL and Oracle.

Editorial information provided by DB-Engines
NameOpenSearch  Xexclude from comparisonSpark SQL  Xexclude from comparison
DescriptionA distributed, RESTful search and analytics engine forked from Elasticsearch and based on Apache LuceneSpark SQL is a component on top of 'Spark Core' for structured data processing
Primary database modelSearch engineRelational DBMS
Secondary database modelsVector DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score16.03
Rank#37  Overall
#4  Search engines
Score18.04
Rank#33  Overall
#20  Relational DBMS
Websitegithub.com/­opensearch-project
opensearch.org
spark.apache.org/­sql
Technical documentationopensearch.org/­docs/­latestspark.apache.org/­docs/­latest/­sql-programming-guide.html
DeveloperAmazon Web ServicesApache Software Foundation
Initial release20212014
Current release2.5.0, January 20233.5.0 ( 2.13), September 2023
License infoCommercial or Open SourceOpen Source infoApache Version 2.0Open Source infoApache 2.0
Cloud-based only infoOnly available as a cloud servicenono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
  • Aiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
  • STACKIT OpenSearch offers OpenSearch in a managed version in enterprise grade, 100% GDPR-compliant, for a wide range of applications like analytics, website search, offering scalability and fast data access.
Implementation languageJavaScala
Server operating systemsAll OS with a Java VMLinux
OS X
Windows
Data schemeschema-free infoFlexible type definitions. Once a type is defined, it is persistentyes
Typing infopredefined data types such as float or dateyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.no
Secondary indexesyes infoAll search fields are automatically indexedno
SQL infoSupport of SQLSQL-like query languageSQL-like DML and DDL statements
APIs and other access methodsJava API
RESTful HTTP/JSON API
JDBC
ODBC
Supported programming languagesGo
Java
JavaScript (Node.js)
PHP
Python
Ruby infoElasticsearch client
Java
Python
R
Scala
Server-side scripts infoStored proceduresyesno
Triggersyes infoby using the 'percolation' featureno
Partitioning methods infoMethods for storing different data on different nodesShardingyes, utilizing Spark Core
Replication methods infoMethods for redundantly storing data on multiple nodesyesnone
Consistency concepts infoMethods to ensure consistency in a distributed systemEventual Consistency infoSynchronous doc based replication. Get by ID may show delays up to 1 sec. Configurable write consistency: one, quorum, all
Foreign keys infoReferential integritynono
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanono
Concurrency infoSupport for concurrent manipulation of datayesyes
Durability infoSupport for making data persistentyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.no
User concepts infoAccess controlno
More information provided by the system vendor
OpenSearchSpark SQL
Specific characteristicsOpenSearch is a highly scalable and extensible open-source software suite for search,...
» more
Competitive advantagesDistributed as fully open source under Apache License, Version 2.0 (ALv2), OpenSearch...
» more
Typical application scenariosThe OpenSearch platform is used across a broad range of search , analytics, and observability...
» more
Licensing and pricing modelsThe OpenSearch Project offers open source software licensed under Apache License...
» more

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesAiven for OpenSearch: Fully managed open source search and analytics suite. Out-of-the-box integrations get you up and running in a couple of clicks.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
OpenSearchSpark SQL
Recent citations in the news

Modernize your data observability with Amazon OpenSearch Service zero-ETL integration with Amazon S3 | Amazon ...
5 June 2024, AWS Blog

Behind the Scenes: Upgrading OpenSearch efficiency with OCI flexible vertical scaling
13 February 2024, blogs.oracle.com

Optimize storage costs in Amazon OpenSearch Service using Zstandard compression | Amazon Web Services
11 June 2024, AWS Blog

OCI Search with OpenSearch 2.11 delivers easy access to latest AI innovations
13 March 2024, blogs.oracle.com

Simplify your query management with search templates in Amazon OpenSearch Service | Amazon Web Services
3 April 2024, AWS Blog

provided by Google News

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

What is Apache Spark? The big data platform that crushed Hadoop
3 April 2024, InfoWorld

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

Performant IPv4 Range Spark Joins | by Jean-Claude Cote
24 January 2024, Towards Data Science

Simba Technologies(R) Introduces New, Powerful JDBC Driver With SQL Connector for Apache Spark(TM)
17 March 2024, Yahoo Singapore News

provided by Google News



Share this page

Featured Products

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Present your product here