DB-EnginesExtremeDB: the first and only COTS deterministic embedded database management system for mission- and safety-critical hard real-time applicationsEnglish
Deutsch
Knowledge Base of Relational and NoSQL Database Management Systemsprovided by solid IT

DBMS > Apache Phoenix vs. Google Cloud Bigtable vs. Spark SQL vs. SWC-DB vs. Transbase

System Properties Comparison Apache Phoenix vs. Google Cloud Bigtable vs. Spark SQL vs. SWC-DB vs. Transbase

Editorial information provided by DB-Engines
NameApache Phoenix  Xexclude from comparisonGoogle Cloud Bigtable  Xexclude from comparisonSpark SQL  Xexclude from comparisonSWC-DB infoSuper Wide Column Database  Xexclude from comparisonTransbase  Xexclude from comparison
DescriptionA scale-out RDBMS with evolutionary schema built on Apache HBaseGoogle's NoSQL Big Data database service. It's the same database that powers many core Google services, including Search, Analytics, Maps, and Gmail.Spark SQL is a component on top of 'Spark Core' for structured data processingA high performance, scalable Wide Column DBMSA resource-optimized, high-performance, universally applicable RDBMS
Primary database modelRelational DBMSWide column storeRelational DBMSWide column storeRelational DBMS
Secondary database modelsTime Series DBMS
DB-Engines Ranking infomeasures the popularity of database management systemsranking trend
Trend Chart
Score3.26
Rank#94  Overall
#50  Relational DBMS
Score3.63
Rank#89  Overall
#8  Wide column stores
Score22.94
Rank#34  Overall
#20  Relational DBMS
Score0.09
Rank#309  Overall
#13  Wide column stores
Score0.08
Rank#310  Overall
#139  Relational DBMS
Websitephoenix.apache.orgcloud.google.com/­bigtablespark.apache.org/­sqlgithub.com/­kashirin-alex/­swc-db
www.swcdb.org
www.transaction.de/­en/­solutions/­transbase-resource-optimized-high-performance-database
Technical documentationphoenix.apache.orgcloud.google.com/­bigtable/­docsspark.apache.org/­docs/­latest/­sql-programming-guide.htmlwww.transaction.de/­en/­transbase-inside
DeveloperApache Software FoundationGoogleApache Software FoundationAlex KashirinTransaction Software GmbH
Initial release20142015201420201987
Current release5.0-HBase2, July 2018 and 4.15-HBase1, December 20193.2.0, October 20210.5, April 2021Transbase 8.4, September 2020
License infoCommercial or Open SourceOpen Source infoApache Version 2.0commercialOpen Source infoApache 2.0Open Source infoGPL V3commercial infofree development license
Cloud-based only infoOnly available as a cloud servicenoyesnonono
DBaaS offerings (sponsored links) infoDatabase as a Service

Providers of DBaaS offerings, please contact us to be listed.
Implementation languageJavaScalaC++C and C++
Server operating systemsLinux
Unix
Windows
hostedLinux
OS X
Windows
LinuxFreeBSD
Linux
macOS
Solaris
Windows
Data schemeyes infolate-bound, schema-on-read capabilitiesschema-freeyesschema-freeyes
Typing infopredefined data types such as float or dateyesnoyesyes
XML support infoSome form of processing data in XML format, e.g. support for XML data structures, and/or support for XPath, XQuery or XSLT.nonononono
Secondary indexesyesnonoyes
SQL infoSupport of SQLyesnoSQL-like DML and DDL statementsSQL-like query languageyes
APIs and other access methodsJDBCgRPC (using protocol buffers) API
HappyBase (Python library)
HBase compatible API (Java)
JDBC
ODBC
Proprietary protocol
Thrift
ADO.NET
JDBC
ODBC
Proprietary native API
Supported programming languagesC
C#
C++
Go
Groovy
Java
PHP
Python
Scala
C#
C++
Go
Java
JavaScript (Node.js)
Python
Java
Python
R
Scala
C++C
C#
C++
Java
JavaScript
Kotlin
Objective-C
PHP
Python
Server-side scripts infoStored proceduresuser defined functionsnononoyes
Triggersnonononoyes
Partitioning methods infoMethods for storing different data on different nodesShardingShardingyes, utilizing Spark CoreSharding
Replication methods infoMethods for redundantly storing data on multiple nodesMulti-source replication
Source-replica replication
Internal replication in Colossus, and regional replication between two clusters in different zonesnoneSource-replica replication
MapReduce infoOffers an API for user-defined Map/Reduce methodsHadoop integrationyesnono
Consistency concepts infoMethods to ensure consistency in a distributed systemImmediate Consistency or Eventual ConsistencyImmediate consistency (for a single cluster), Eventual consistency (for two or more replicated clusters)Immediate ConsistencyImmediate Consistency
Foreign keys infoReferential integritynononoyes
Transaction concepts infoSupport to ensure data integrity after non-atomic manipulations of dataACIDAtomic single-row operationsnoyes
Concurrency infoSupport for concurrent manipulation of datayesyesyesyesyes
Durability infoSupport for making data persistentyesyesyesyesyes
In-memory capabilities infoIs there an option to define some or all structures to be held in-memory only.yesnononono
User concepts infoAccess controlAccess Control Lists (using HBase ACL) for RBAC, integration with Apache Ranger for RBAC & ABAC, multi-tenancyAccess rights for users, groups and roles based on Google Cloud Identity and Access Management (IAM)nofine grained access rights according to SQL-standard

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesSQLFlow: Provides a visual representation of the overall flow of data. Automated SQL data lineage analysis across Databases, ETL, Business Intelligence, Cloud and Hadoop environments by parsing SQL Script and stored procedure.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Apache PhoenixGoogle Cloud BigtableSpark SQLSWC-DB infoSuper Wide Column DatabaseTransbase
DB-Engines blog posts

Cloudera's HBase PaaS offering now supports Complex Transactions
11 August 2021,  Krishna Maheshwari (sponsor) 

show all

Recent citations in the news

Apache Phoenix Now HBase 2.0 Compatible
20 July 2018, iProgrammer

Developing Python Applications Against Apache Phoenix (HBase)
30 September 2016, DZone News

HPE gobbles up Ampool to add SQL grunt to Ezmeral
9 July 2021, The Register

The Apache Software Foundation Announces the 10th Anniversary of Apache® HBase
13 May 2020, GlobeNewswire

Apache Calcite, FreeMarker, Gora, Phoenix, and Solr updated
27 March 2017, SDTimes.com

provided by Google News

Google Cloud Improves SLA for Bigtable and Adds New Security Features
19 June 2021, InfoQ.com

How IIoT is Used by MachineMax, TIER Mobility, Bühler Group, Augury, and Port of Rotterdam: Case Studies
3 January 2022, Datamation

Bigtable vs Bigquery - A Quick Overview
9 September 2021, Analytics India Magazine

distributed database system examples
8 April 2021, Newstime Africa

Review: Google Bigtable scales with ease
7 September 2016, InfoWorld

provided by Google News

spark sql vs spark dataframe performance
8 April 2021, Newstime Africa

pyspark create dataframe from another dataframe
8 April 2021, Newstime Africa

Using Python for data engineering
14 January 2022, Technology Decisions

Top 10 Big Data Analytics Courses to Elevate Your Career in 2022
12 January 2022, Analytics Insight

Spark Gets Closer Hooks to Pandas, SQL with Version 3.2
26 October 2021, Datanami

provided by Google News

Aurora Vigil-Escalera Art Gallery at Estampa Contemporary Art Fair 2021
11 April 2021, Artsy

provided by Google News

Job opportunities

OpDB & HBase Field Specialist
Cloudera, New York, NY

Solutions Architect
Cloudera, New York, NY

Senior Systems Security Engineer
Fluor Corporation, Denver, CO

Senior Solutions Consultant
Cloudera, Illinois

Senior Full Stack Software Developer in Test
Amiseq, Milpitas, CA

Data Engineer - Digital Media (REMOTE)
DICK'S Sporting Goods, Pittsburgh, PA

GCP Data Engineer
Ampcus Tech Pvt Ltd, Berkeley Heights, NJ

GCP - Anthos Engineer
Capgemini, Remote

Data/Backend Engineer, Content Platform
Spotify, New York, NY

GCP Data Engineer
spar information systems, Atlanta, GA

Data Scientist
Ford Motor Company, Dearborn, MI

Healthcare Data Analyst - MedInsight
Milliman, Brookfield, WI

Process Manager
Capital One - US, Richmond, VA

Associate Data Lake Consultant
Amazon Web Services, Inc., New York, NY

Data Scientist II – Hybrid remote work location for WI and IL residents
UW Health, Madison, WI

jobs by Indeed



Share this page

Featured Products

Neo4j logo

See for yourself how a graph database can make your life easier.
Use Neo4j online for free.

Datastax Astra logo

Build cloud-native apps fast with Astra, the open-source, multi-cloud stack for
modern data apps.
Get started with 80GB free.

MariaDB logo

SkySQL, the ultimate
MariaDB cloud, is here.

Get started with SkySQL today!

Couchbase logo

The modern database for enterprise applications. Build fast. Scale Big. Save more.
Get started today.

Vertica logo

Vertica Accelerator. The fastest analytics and machine learning, delivered as SaaS, with automated setup, administration, and management. Free trial.

Present your product here