DB-EnginesInfluxDB: Focus on building software with an easy-to-use serverless, scalable time series platformEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Google BigQuery vs. Spark SQL vs. SQLite vs. Sqrrl

System Properties Comparison Google BigQuery vs. Spark SQL vs. SQLite vs. Sqrrl

Please select another system to include it in the comparison.

Editorial information provided by DB-Engines
NameGoogle BigQuery  Xexclude from comparisonSpark SQL  Xexclude from comparisonSQLite  Xexclude from comparisonSqrrl  Xexclude from comparison
Sqrrl has been acquired by Amazon and became a part of Amazon Web Services. It has been removed from the DB-Engines ranking.
DescriptionLarge scale data warehouse service with append-only tablesSpark SQL is a component on top of 'Spark Core' for structured data processingWidely used embeddable, in-process RDBMSAdaptable, secure NoSQL built on Apache Accumulo
Primary database modelRelational DBMSRelational DBMSRelational DBMSDocument store
Graph DBMS
Key-value store
Wide column store
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score58.10
Rank#19  Overall
#13  Relational DBMS
Score18.04
Rank#33  Overall
#20  Relational DBMS
Score111.41
Rank#10  Overall
#7  Relational DBMS
Websitecloud.google.com/­bigqueryspark.apache.org/­sqlwww.sqlite.orgsqrrl.com
Technical documentationcloud.google.com/­bigquery/­docsspark.apache.org/­docs/­latest/­sql-programming-guide.htmlwww.sqlite.org/­docs.html
DeveloperGoogleApache Software FoundationDwayne Richard HippAmazon infooriginally Sqrrl Data, Inc.
Initial release2010201420002012
Current release3.5.0 ( 2.13), September 20233.46.0  (23 May 2024), May 2024
License infoCommercial or Open SourcecommercialOpen Source infoApache 2.0Open Source infoPublic Domaincommercial
Cloud-based only infoOnly available as a cloud serviceyesnonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageScalaCJava
Server operating systemshostedLinux
OS X
Windows
server-lessLinux
Data schemeyesyesyes infodynamic column typesschema-free
Typing infopredefined data types such as float or dateyesyesyes infonot rigid because of 'dynamic typing' concept.yes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonono
Secondary indexesnonoyesyes
SQL infoSupport of SQLyesSQL-like DML and DDL statementsyes infoSQL-92 is not fully supportedno
APIs and other access methodsRESTful HTTP/JSON APIJDBC
ODBC
ADO.NET infoinofficial driver
JDBC infoinofficial driver
ODBC infoinofficial driver
Accumulo Shell
Java API
JDBC
ODBC
RESTful HTTP API
Thrift
Supported programming languages.Net
Java
JavaScript
Objective-C
PHP
Python
Ruby
Java
Python
R
Scala
Actionscript
Ada
Basic
C
C#
C++
D
Delphi
Forth
Fortran
Haskell
Java
JavaScript
Lisp
Lua
MatLab
Objective-C
OCaml
Perl
PHP
PL/SQL
Python
R
Ruby
Scala
Scheme
Smalltalk
Tcl
Actionscript
C infousing GLib
C#
C++
Cocoa
Delphi
Erlang
Go
Haskell
Java
JavaScript
OCaml
Perl
PHP
Python
Ruby
Smalltalk
Server-side scripts infoStored proceduresuser defined functions infoin JavaScriptnonono
Triggersnonoyesno
Partitioning methods infoMethods for storing different data on different nodesnoneyes, utilizing Spark CorenoneSharding infomaking use of Hadoop
Replication methods infoMethods for redundantly storing data on multiple nodesnonenoneselectable replication factor infomaking use of Hadoop
MapReduce infoOffers an API for user-defined Map/Reduce methodsnonoyes
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate ConsistencyImmediate Consistency infoDocument store kept consistent with combination of global timestamping, row-level transactions, and server-side consistency resolution.
Foreign keys infoReferential integritynonoyesno
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of datano infoSince BigQuery is designed for querying datanoACIDAtomic updates per row, document, or graph entity
Concurrency infoSupport for concurrent manipulation of datayesyesyes infovia file-system locksyes
Durability infoSupport for making data persistentyesyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.nonoyes
User concepts infoAccess controlAccess privileges (owner, writer, reader) on dataset, table or view level infoGoogle Cloud Identity & Access Management (IAM)nonoCell-level Security, Data-Centric Security, Role-Based Access Control (RBAC), Attribute-Based Access Control (ABAC)

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesCData: Connect to Big Data & NoSQL through standard Drivers.
» more
Navicat for SQLite is a powerful and comprehensive SQLite GUI that provides a complete set of functions for database management and development.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Google BigQuerySpark SQLSQLiteSqrrl
DB-Engines blog posts

PostgreSQL is the DBMS of the Year 2023
2 January 2024, Matthias Gelbmann, Paul Andlinger

Snowflake is the DBMS of the Year 2022, defending the title from last year
3 January 2023, Matthias Gelbmann, Paul Andlinger

Cloud-based DBMS's popularity grows at high rates
12 December 2019, Paul Andlinger

show all

Big gains for Relational Database Management Systems in DB-Engines Ranking
2 February 2016, Matthias Gelbmann

show all

Recent citations in the news

Winning the 2020 Google Cloud Technology Partner of the Year – Infrastructure Modernization Award
22 December 2021, CIO

Google Cloud partners Coinbase to accept crypto payments
11 October 2022, Ledger Insights

Hightouch Raises $38M in Funding
19 July 2023, FinSMEs

provided by Google News

Run Apache Hive workloads using Spark SQL with Amazon EMR on EKS | Amazon Web Services
18 October 2023, AWS Blog

Performance Insights from Sigma Rule Detections in Spark Streaming
1 June 2024, Towards Data Science

Cracking the Apache Spark Interview: 80+ Top Questions and Answers for 2024
1 April 2024, Simplilearn

18 Top Big Data Tools and Technologies to Know About in 2024
24 January 2024, TechTarget

Use Amazon Athena with Spark SQL for your open-source transactional table formats | Amazon Web Services
24 January 2024, AWS Blog

provided by Google News

Microsoft Research chief scientist has no issue with Windows Recall
6 June 2024, The Register

How to Work with SQLite Database in Python
8 June 2024, Analytics Insight

How to work with Dapper and SQLite in ASP.NET Core
10 May 2024, InfoWorld

A Guide to Working with SQLite Databases in Python
21 May 2024, KDnuggets

SQLite Vulnerability Could Put Thousands of Apps at Risk
22 March 2024, Dark Reading

provided by Google News

Splunk details Sqrrl 'screw-ups' that hampered threat hunting
6 May 2024, TechTarget

Mark Terenzoni
23 February 2024, Dark Reading

Amazon's cloud business acquires Sqrrl, a security start-up with NSA roots
23 January 2018, CNBC

Millennials possess the advantage of time for wealth creation, says Yashoraj Tyagi of Sqrrl | Mint
18 September 2023, Mint

AWS beefs up threat detection with Sqrrl acquisition
24 January 2018, TechCrunch

provided by Google News



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Datastax Astra logo

Bring all your data to Generative AI applications with vector search enabled by the most scalable
vector database available.
Try for Free

Milvus logo

Vector database designed for GenAI, fully equipped for enterprise implementation.
Try Managed Milvus for Free

Present your product here