DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Spark SQL vs. SQLite vs. SWC-DB

System Properties Comparison Spark SQL vs. SQLite vs. SWC-DB

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameSpark SQL  Xexclude from comparisonSQLite  Xexclude from comparisonSWC-DB infoSuper Wide Column Database  Xexclude from comparison
DescriptionSpark SQL is a component on top of 'Spark Core' for structured data processingWidely used embeddable, in-process RDBMSA high performance, scalable Wide Column DBMS
Primary database modelRelational DBMSRelational DBMSWide column store
Secondary database modelsTime Series DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score22.94
Rank#34  Overall
#20  Relational DBMS
Score129.37
Rank#9  Overall
#6  Relational DBMS
Score0.00
Rank#353  Overall
#13  Wide column stores
Websitespark.apache.org/­sqlwww.sqlite.orggithub.com/­kashirin-alex/­swc-db
www.swcdb.org
Technical documentationspark.apache.org/­docs/­latest/­sql-programming-guide.htmlwww.sqlite.org/­docs.html
DeveloperApache Software FoundationDwayne Richard HippAlex Kashirin
Initial release201420002020
Current release3.1.1, March 20213.36.0  (18 June 2021), June 20210.5, April 2021
License infoCommercial or Open SourceOpen Source infoApache 2.0Open Source infoPublic DomainOpen Source infoGPL V3
Cloud-based only infoOnly available as a cloud servicenonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScalaCC++
Server operating systemsLinux
OS X
Windows
server-lessLinux
Data schemeyesyes infodynamic column typesschema-free
Typing infopredefined data types such as float or dateyesyes infonot rigid because of 'dynamic typing' concept.
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesnoyes
SQL infoSupport of SQLSQL-like DML and DDL statementsyes infoSQL-92 is not fully supportedSQL-like query language
APIs and other access methodsJDBC
ODBC
ADO.NET infoinofficial driver
JDBC infoinofficial driver
ODBC infoinofficial driver
Proprietary protocol
Thrift
Supported programming languagesJava
Python
R
Scala
Actionscript
Ada
Basic
C
C#
C++
D
Delphi
Forth
Fortran
Haskell
Java
JavaScript
Lisp
Lua
MatLab
Objective-C
OCaml
Perl
PHP
PL/SQL
Python
R
Ruby
Scala
Scheme
Smalltalk
Tcl
C++
Server-side scripts infoStored proceduresnonono
Triggersnoyesno
Partitioning methods infoMethods for storing different data on different nodesyes, utilizing Spark CorenoneSharding
Replication methods infoMethods for redundantly storing data on multiple nodesnonenone
MapReduce infoOffers an API for user-defined Map/Reduce methodsnono
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate Consistency
Foreign keys infoReferential integritynoyes
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datanoACID
Concurrency infoSupport for concurrent manipulation of datayesyes infovia file-system locksyes
Durability infoSupport for making data persistentyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.noyesno
User concepts infoAccess controlnono

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more
Navicat for SQLite is a powerful and comprehensive SQLite GUI that provides a complete set of functions for database management and development.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Spark SQLSQLiteSWC-DB infoSuper Wide Column Database
DB-Engines blog posts

Big gains for Relational Database Management Systems in DB-Engines Ranking
2 February 2016, Matthias Gelbmann

show all

Recent citations in the news

Managing Partitions Using Spark Dataframe Methods | Job Seeker/Employer News | tucson.com
26 October 2021, Arizona Daily Star

Online workshop: Scalable data science with Python and Spark
12 October 2021, Market Research Telecast

Java Vs Python For Data Science
20 October 2021, Analytics India Magazine

Analytics Chip Startup Speedata Emerges from Stealth
30 September 2021, Datanami

Here is Everything You Need to Know About Big Data Tester
12 October 2021, Analytics Insight

provided by Google News

How to Install and Use SQLite On Ubuntu 20.04 LTS Focal Fossa
7 October 2021, H2S Media

SQLite Extraction of Oracle Tables Tools, Methods and Pitfalls
20 July 2021, Linux Journal

SQLite On The Web: Absurd-sql
24 August 2021, Hackaday

SQLite Vulnerability May Be Putting Your Applications at Risk
8 July 2021, Security Boulevard

Top 9 Data Modeling Tools & Software 2021
6 October 2021, IT Business Edge

provided by Google News

Job opportunities

Associate Data & Machine Learning Engineer
Amazon Web Services, Inc., United States

Data Analyst
LT Technology Services, Spring, TX

Data Engineer
NexInfo Solutions, Remote

Data Analyst
Lenovo, Morrisville, NC

Healthcare Data Analyst - MedInsight
Milliman, Brookfield, WI

Jr. QA Analyst Trainee
SQA², Los Alamitos, CA

Senior C# Cross Platform Software Engineer
Mailbird, Remote

ASSOCIATE DATA SCIENTIST
NYC Careers, Manhattan, NY

Supply Chain Analyst
The Raymond Corporation, Addison, TX

Data Analyst
A+ Federal Credit Union, Austin, TX

jobs by Indeed



Share this page

Featured Products

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 5 GB free..

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

Present your product here