What's NoSQL

http://nosql-database.org/
NoSQL DEFINITION:

Next Generation Databases mostly addressing some of the points: being non-relational,distributed, open-source and horizontally scalable.

The original intention has been modern web-scale databases. The movement began early 2009 andis growing rapidly. Often more characteristics apply such as: schema-free,easy replication support, simple API, eventually consistent / BASE (not ACID), ahuge amount of data and more. So the misleading term "nosql" (the community nowtranslates it mostly with "not only sql") should be seen as an alias to something like thedefinition above.

List Of NoSQL Databases [currently >225]

Core NoSQL Systems: [Mostly originated out of a Web 2.0 need]

Wide Column Store / Column Families

Hadoop / HBase

API: Java / any writer, Protocol: any write call, Query Method: MapReduceJava / any exec, Replication: HDFS Replication, Written in: Java,Concurrency: ?, Misc: Links: 3 Books 1. Hadoop in action. 2. Pro Hadoop(Expert's voice in open source) 3.Hadoop The Definition Guide.

MapR, Hortonworks,Cloudera Hadoop Distribution and professional services .

Cassandra

massively scalable, partitioned row store, masterless architecture, linear scale performance, no single points of failure, read/write support across multiple data centers & cloud availability zones. API / Query Method: CQL and Thrift, replication: peer-to-peer, written in: Java, Concurrency: tunable consistency, Misc: built-in data compression, MapReduce support, primary/secondary indexes, security features. Links: Documentation, PlanetC*, Company.

Hypertable

API: Thrift (Java, PHP, Perl, Python, Ruby, etc.), Protocol: Thrift, QueryMethod: HQL, native Thrift API, Replication: HDFS Replication,Concurrency: MVCC, Consistency Model: Fully consistent Misc: High performanceC++ implementation of Google's Bigtable. » Commercial support

Accumulo

Accumulo is based on BigTableand is built on top of Hadoop, Zookeeper,and Thrift.It features improvements on the BigTable design in the form of cell-based access control,improved compression, and a server-side programming mechanism that can modify key/value pairsat various points in the data management process.

Amazon SimpleDB

Misc: not open source / part of AWS, Book (will beoutperformed by DynamoDB!)

Cloudata

Google's Big table clone like HBase. » Article

MonetDB

Column Store pioneer since 2002.

HPCC

from LexisNexis, info, article

Apache Flink

(formerly known as Stratosphere)massively parallel & flexible data analytics platform, API: Java, Scala, Query Method: expressive data flows (extended M/R, rich UDFs, iteration support), Data Store: independent (e.g., HDFS, S3, MongoDB), Written in: Java,License: Apache License V2.0,Misc: good integration with Hadoop stack (HDFS, YARN), source code on Github

IBM Informix

horizontally and vertically scalable, relational, partitioned row store, document store API / Query Method: SQL (native, DRDA, JDBC, ODBC), MongoDB wire listener, mixed mode, replication: master / slave, peer-to-peer, sharding, grid operations, written in: C, Concurrency: row, page, table, db locking, Misc: ACID, built-in data compression, scheduler, automatic cyclic storage management, extensible, in memory acceleration, native ports from ARM v6 up Links: Documentation, IIUG, Company.

Splice Machine

Splice Machine is an RDBMS built on Hadoop, HBase and Derby. Scale real-time applications using commodity hardware without application rewrites,Features: ACID transactions, ANSI SQL support, ODBC/JDBC, distributed computing

eXtremeDB Financial Edition

massively scalable in-memory and persistent storage DBMS for analytics on market data(and other time series data). APIs: C/C++, Java Native Interface (JNI), C#/.NET), Python, SQL (native, ODBC, JDBC), Data layout: row, columnar, hybrid, Written in: C, Replication: master/slave, cluster, sharding, Concurrency: Optimistic (MVCC) and pessimistic (locking)

ConcourseDB

a distributed self-tuning database with automatic indexing, version control and ACID transactions. Written In: Java. API/Protocol: Thrift (many languages). Concurrency: serializable transactions with just-in-time locking. Misc: uses a buffered storage system to commit all data to disk immediately while perform rich indexing in the background.

kdb+

time-series database optimized for Big Data analytics. [OpenNeptune, Qbase, KDI]

Document Store

Elasticsearch

API: REST and many languages, Protocol: REST, Query Method: via JSON, Replication + Sharding: automatic and configurable, written in: Java, Misc: schema mapping, multi tenancy with arbitrary indexes, » Company and Support, » Article

ArangoDB, OrientDB

( Doc Store & GraphDB & Key-Value. More details in Category Multimodel Databases)

MongoDB

API: BSON, Protocol: C, Query Method: dynamic object-based language &MapReduce, Replication: Master Slave &Auto-Sharding, Written in: C++,Concurrency: Update in Place. Misc: Indexing, GridFS, Freeware + Commercial License Links: » Talk, » Notes, » Company

Couchbase Server

API: Memcached API+protocol (binary and ASCII) , most languages, Protocol: Memcached REST interface for cluster conf + management,Written in: C/C++ + Erlang (clustering), Replication: Peer to Peer, fullyconsistent, Misc: Transparent topology changes during operation, provides memcached-compatiblecaching buckets, commercially supported version available,Links: » Wiki, »Article

CouchDB

API: JSON,Protocol: REST,Query Method: MapReduceR of JavaScript Funcs, Replication: Master Master,Written in: Erlang, Concurrency: MVCC, Misc:
Links: » 3 CouchDB books , » Couch Lounge(partitioning / clusering), » Dr. Dobbs

RethinkDB

API: protobuf-based, Query Method: unified chainable query language(incl. JOINs, sub-queries, MapReduce, GroupedMapReduce); Replication: Sync and Async Master Slave with per-table acknowledgements, Sharding: guided range-based, Written in: C++, Concurrency: MVCC. Misc: log-structured storage engine with concurrent incremental garbage compactor

SequoiaDB

API: BSON,Protocol: C,Query Method: dynamic object-based language,Replication: Master Slave & Auto-Sharding, Written in: C++,Misc: Indexing, Large Object Store, Transaction, Free + Commercial License, Benchmark, Code

RavenDB

.Net solution. Provides HTTP/JSONaccess. LINQqueries & Shardingsupported. » Misc

MarkLogic Server

(developer+commercial) API: JSON, XML, Java Protocols: HTTP, REST Query Method: Full Text Search and Structured Query, XPath, XQuery, Range, Geospatial,Bitemporal Written in: C++ Concurrency: Shared-nothing cluster, MVCC Misc: Petabyte-scalable and elastic (on premise in the cloud), ACID + XA transactions, auto-sharding, failover, master slave replication (clusters), replication (within cluster), highavailablity, disaster recovery, full and incremental backups, government grade security at the doc level, developer community »

Clusterpoint Server

(freeware+commercial) API: XML, PHP, Java, .NET Protocols: HTTP, REST, nativeTCP/IP Query Method: full text search, XML, range and Xpath queries; Written in C++ Concurrency: ACID-compliant, transactional, multi-master cluster Misc:Petabyte-scalable document store and full text search engine. Information ranking. Replication. Cloudable.

JSON ODM

Object Document Mapper for JSON-Documents written in pure JavaScript. It queries the collections with a gremlin-like DSL that uses MongoDB's API methods, but also provides joining. The collections extend the native array objects, which gives the overall ODM a good performance. Queries 500.000 elements in less then a second.

NeDB

NoSQL database for Node.js in pure javascript. It implements the most commonly used subset of MongoDB's API and is quite fast (about 25,000 reads/s on a 10,000 documents collection with indexing).

Terrastore

API: Java & http,Protocol: http,Language: Java,Querying: Range queries, Predicates, Replication: Partitioned with consistenthashing, Consistency: Per-recordstrict consistency, Misc: Based on Terracotta

AmisaDB:

Architected to unify the best of search engine, NoSQL and NewSQL DB technologies. API: REST and many languages. Query method: SQL. Written in C++. Concurrency: MVCC. Misc: ACID transactions, data distribution via consistent hashing, static and dynamic schema support, in-memory processing. Freeware + Commercial License

JasDB

Lightweight open source document database written in Java for high performance, runs in-memory, supports Android. API: JSON, Java Query Method: REST OData Style Query language, Java fluent Query API Concurrency: Atomic document writes Indexes: eventually consistent indexes

RaptorDB

JSON based, Document store database with compiled .net map functions and automatic hybridbitmap indexing and LINQ query filters

djondb

djonDB API: BSON, Protocol: C++,Query Method: dynamic queries and map/reduce, Drivers: Java, C++, PHP Misc: ACID compliant, Full shell console over google v8 engine, djondb requirements are submited by users, not market. License: GPL and commercial

EJDB

Embedded JSON database engine based on tokyocabinet. API: C/C++, C# (.Net, Mono), Lua, Ruby, Python, Node.js binding, Protocol: Native, Written in: C, Query language: mongodb-like dynamic queries, Concurrency: RW locking, transactional , Misc: Indexing, collection level rw locking, collection level transactions, collection joins., License: LGPL

densodb

DensoDB is a new NoSQL document database. Written for .Net environment in c# language.It’s simple, fast and reliable. Source

SisoDB

A Document Store on top of SQL-Server.

SDB

For small online databases, PHP / JSON interface, implemented in PHP.

NoSQL embedded db

Node.js asynchronous NoSQL embedded database for small websites or projects. Database supports: insert, update, remove, drop and supports views (create, drop, read). Written in JavaScript, no dependencies, implements small concurrency model.[CloudKit, Perservere, Jackrabbit]

ThruDB

(please help provide more facts!) Uses Apache Thriftto integrate multiple backend databases as BerkeleyDB, Disk, MySQL, S3.

iBoxDB

Transactional embedded database, it can embed into mobile, desktop and web applications,supports on-disk and in-memory storages. API: Java,C# (Android, Mono, Xamarin, Unity3D).Query Method: SQL-like and KeyValue. Written In: Java, C#. Replication: MasterSlave, MasterMaster.

BergDB

API: Java/.NET.Written in: Java. Replication: Master/Slave. License: AGLP. Historical queries. ACID. Schemaless.Concurrency: STM and persistent data structure. Append-only storage. Encrypted storage. Flexible durability control. Secondary & composite indexes. Transparently serializes Java/.NET objects.

IBM Cloudant

Cloud based, open-source, zero-config. Based on CouchDB and BigCouch.

Key Value / Tuple Store

DynamoDB

Automatic ultra scalable NoSQL DB based on fast SSDs. Multiple Availability Zones. Elastic MapReduce Integration. Backup to S3 and much more...

Azure Table Storage

Collections of free form entities (row key, partition key, timestamp). Blob and Queue Storage available, 3 timesredundant. Accessible via REST or ATOM.

Riak

API: JSON,Protocol: REST,Query Method: MapReduce term matching , Scaling: Multiple Masters; Written in: Erlang,Concurrency: eventually consistent (stronger then MVCC via Vector Clocks)

Redis

API: Tons of languages,Written in: C,Concurrency: in memoryand saves asynchronous disk after a defined time. Append only modeavailable. Different kinds of fsync policies. Replication: Master / Slave,Misc: also lists, sets, sorted sets, hashes, queues. Cheat-Sheet: », great slides » Admin UI » From the Ground up »

Aerospike

Fast and web-scale database. RAM or SSD. Predictable performance; achieves 2.5 M TPS (reads andwrites), 99% under 1 ms. Tunable consistency. Replicated, zero configuration, zero downtime,auto-clustering, rolling upgrades, Cross Datacenter Replication (XDR). Written in: C. APIs: C, C#,Erlang, Go, Java, Libevent, Node, Perl, PHP, Python, Ruby. Links: Community, Development, Slides, 2.5M TPS on 1 node at Intel, 1M TPS on AmazonWS, 1M TPS w/ SSDs on 1 Server, Combating Memory Fragmentation

LevelDB

Fast& Batch updates. DB from Google.Written in C++.Blog »,hot Benchmark », Article »(in German). Java access.

RocksDB

API: C++. Written in C++.Facebook`s improvements to Google`s LevelDB to speed throughputfor datasets larger than RAM. Embedded solution.

Berkeley DB

API: Many languages, Written in: C, Replication: Master / Slave,Concurrency: MVCC,License: Sleepycat, Berkeley DB JavaEdition: API: Java, Written in: Java,Replication: Master / Slave,Concurrency: serializable transaction isolation, License: Sleepycat

Oracle NOSQL Database

Oracle NoSQL Database is a distributed key-value database. It is designed to provide highly reliable, scalable and available data storage across a configurable set of systems that function as storage nodes.NoSQL and the Enterprise Data is stored as key-value pairs, which are written to particular storage node(s), based on the hashed value of the primary key. Storage nodes are replicated to ensure high availability, rapid failover in the event of a node failure and optimal load balancing of queries. API: Java/C.

GenieDB

Immediate consistency sharded KV store with an eventually consistent APstore bringing eventual consistency issues down to thetheoretical minimum. It features efficient record coalescing.GenieDB speaks SQL and co-exists / do intertablejoins withSQL RDBMs.

BangDB

API: Get,Put,Delete,Protocol: Native, HTTP,Flavor: Embedded, Network, Elastic Cache, Replication: P2P based Network Overlay,Written in: C++, Concurrency:?,Misc: robust, crash proof, Elastic, throw machines to scale linearly, Btree/Ehash

Chordless

API: Java & simple RPC to vals, Protocol: internal, Query Method: M/Rinside value objects, Scaling: every node is master for its slice of namespace, Writtenin: Java, Concurrency: serializable transaction isolation,

Scalaris

(please help provide more facts!) Written in: Erlang, Replication: Strong consistency overreplicas, Concurrency: non blocking Paxos.

Tokyo Cabinet / Tyrant

Links: nice talk », slides », Misc: Kyoto Cabinet »

Scalien

API / Protocol: http(text, html, JSON) , C, C++, Python, Java, Ruby, PHP,Perl. Concurrency: Paxos.

Voldemort

Open-Source implementation of Amazons Dynamo Key-Value Store.

Dynomite

Open-Sourceimplementation of Amazons Dynamo Key-Value Store. written in Erlang.With "data partitioning, versioning, and read repair, and user-providedstorage engines provide persistence and query processing".

KAI

Open Source Amazon Dnamo implementation, Misc: slides

MemcacheDB

API: Memcache protocol(get, set, add, replace, etc.), Written in: C, DataModel: Blob,Misc: Is Memcached writing to BerkleyDB.

Faircom C-Tree

API: C, C++, C#, Java, PHP, Perl, Written in: C,C++. Misc: Transaction logging. Client/server. Embedded. SQL wrapper (not core). Beenaround since 1979.

LSM

Key-Value database that was written as part of SQLite4, They claim it is faster then LevelDB. Instead of supporting custom comparators, they have a recommended data encoding for keys that allows various data types to be sorted.

KitaroDB

: A fast, efficient on-disk data store for Windows Phone 8, Windows RT, Win32 (x86 & x64) and .NET. Provides for key-value and multiple segmented key access. APIs for C#, VB, C++, C and HTML5/JavaScript. Written in pure C for high performance and low footprint. Supports async and synchronous operations with 2GB max record size.

upscaledb

: (embedded solution) API: C, C++, .NET, Java, Erlang. Written in C,C++. Fast key/value store with a parameterized B+-tree. Keys are "typed" (i.e. 32bit integers, floats, variable length or fixed length binary data). Has built-in analytical functions like SUM, AVERAGE etc.

STSdb

API: C#, Written in C#, embedded solution, generic XTable<TKey,TRecord>implementation,ACID transactions, snapshots, table versions, shared records, vertical data compression, custom compression,composite & custom primarykeys, available backend file system layer, works over multiple volumes, petabyte scalability, LINQ.

Tarantool/Box

API: C, Perl, PHP, Python, Java and Ruby. Written in: ObjectiveC,Protocol: asynchronous binary, memcached, text (Lua console). Data model: collections of dimensionless tuples, indexed using primary + secondary keys.Concurrency: lock-free in memory, consistent with disk (write ahead log).Replication: master/slave, configurable.Other: call Lua stored procedures.

Chronicle Map

In-memory (opt. persistence via mmap), highly concurrent, low-latency key-value store.API: Java.Written in: Java.Protocol: in-process Java, remote via Chronicle Engine + Wire:binary, text, Java, C# bindnings.Concurrency: in-memory lock striping, read-write locks.Replication: multi-master, eventually consistent.

Maxtable

API: C, Query Method: MQL, native API, Replication: DFS Replication, Consistency: strict consistency Writtenin: C.

quasardb

very high-performance associative database. Highly scalable. API: C, C++, Java, Python and (limited) RESTful Protocol: binary Query method: key-value, iteration, Replication: Distributed, Written in: C++ 11/Assembly, Concurrency: ACID, Misc: built-in data compression, native support for FreeBSD, Linux and Windows. License: Commercial.

Pincaster

For geolocalized apps. Concurrency: in-memory with asynchronous disk writes.API: HTTP/JSON. Written in: C.License: BSD.

RaptorDB

A pure key value store with optimized b+tree and murmurhashing. (In the near future it will be a JSON document database much likemongodb and couchdb.)

TIBCO Active Spaces

peer-to-peer distributed in-memory (with persistence) datagrid thatimplements and expands on the concept of the Tuple Space. Has SQLQueries and ACID (=> NewSQL).

allegro-C

Key-Value concept. Variable number of keys per record. Multiple keyvalues, Hierarchic records. Relationships. Diff. record types in sameDB. Indexing: B*-Tree. All aspects configurable. Full scriptinglanguage. Multi-user ACID. Web interfaces (PHP, Perl, ActionScript)plus Windows client.

nessDB

A fast key-value Database (using LSM-Tree storage engine), API: Redis protocol(SET,MSET,GET,MGET,DEL etc.), Written in: ANSI C

HyperDex

Distributed searchable key-value store. Fast (latency &throughput), scalable, consistent, fault tolerance, using hyperscpacehashing. APIs for C, C++ and Python.

SharedHashFile

Fast, open source, shared memory (using memory mapped files e.g. in /dev/shm or on SSD), multi process, hash table, e.g. on an 8 core i7-3720QM CPU @ 2.60GHz using /dev/shm, 8 processes combined have a 12.2 million / 2.5 to 5.9 million TPS read/write using small binary keys to a hash filecontaining 50 million keys. Uses sharding internally to mitigate lock contention. Written in C.

Symas LMDB

Ultra-fast, ultra-compact key-value embedded data store developed by Symas for the OpenLDAP Project.It uses memory-mapped files, so it has the read performance of a pure in-memory database while still offering the persistence of standard disk-based databases, and is only limited to the size of the virtual address space, (it is not limited to the size of physical RAM)

Sophia

Sophia is a modern embeddable key-value database designed for a high load environment. It has unique architecture that was created as a result of research and rethinking of primary algorithmical constraints, associated with a getting popular Log-file based data structures, such as LSM-tree. Implemented as a small C-written, BSD-licensed library.

NCache

.NET Open Source Distributed Cache. Written in C#. API .NET & Java. Query Parallel SQL Query, LINQ & Tags. Misc: Linear Scalability, High Availability, WAN Replication, GUI based Administration & Monitoring Tools, Messaging, Runtime Data Sharing, Cache & Item Level Events, Continuous Query & Custom Events, DB Dependencies & Expirations

TazyGrid

Open Source In-Memory JCache compliant Data Grid. Written in Java. API Java, JCache JSR 107 & .NET. Query SQL & DB Synchronization. Misc: Linear Scalability, High Availability, WAN Replication, GUI based Administration & Monitoring Tools, Distributed Messaging, MapReduce, Entry Processor and Aggregator

PickleDB

Redis inspired K/V store for Python object serialization.

Mnesia

(ErlangDB »)

LightCloud

(based on Tokyo Tyrant)

Hibari

Hibari is a highly available, strongly consistent, durable, distributedkey-value data store

OpenLDAP

Key-value store, B+tree. Lightning fast reads+fast bulk loads.Memory-mapped files for persistent storage with all the speed of an in-memorydatabase. No tuning conf required. Full ACID support.MVCC, readers run lockless. Tiny code, written in C, compiles to under 32KB ofx86-64 object code. Modeled after the BerkeleyDB API for easy migration fromBerkeley-based code. Benchmarks against LevelDB, Kyoto Cabinet, SQLite3, andBerkeleyDB are available, plus full paper and presentation slides.

Genomu

High availability, concurrency-oriented event-based K/V database with transactions andcausal consistency. Protocol: MsgPack, API: Erlang, Elixir, Node.js.Written in: Elixir, Github-Repo.

BinaryRage

BinaryRage is designed to be a lightweight ultra fast key/value store for .NET with no dependencies. Tested with more than 200,000 complex objects written to disk per second on a crappy laptop :-) No configuration, no strange driver/connector, no server, no setup - simply reference the dll and start using it in less than a minute.

Elliptics

Github Page »

DBreeze

Professional, open-source, NoSql (embedded Key/Value storage), transactional, ACID-compliant, multi-threaded, object database management system for .NET 3.0> MONO. Written in C#.

TreodeDB

API: Scala. Written in Scala.Replication: Replicas vote on writes and reads.Sharding: Hashes keys onto array of replica cohorts.Concurrency: Optimistic + Multiversion Concurrency Control.Provides multirow atomic writes. Exposes optimistic concurrency through APIto support HTTP Etags.Embedded solution.

BoltDB

Key/Value DB written in Go.

Serenety

Serenity database implements basic Redis commands and extends them with support of ConsistentCursors, ACID transactions, Stored procedures, etc. The database is designed to store data biggerthen available RAM.

[Scality », KaTree » TomP2P »,Kumofs » , TreapDB»,Wallet » ,NoSQLz »,NMDB, luxio, actord, keyspace, flare, schema-free,RAMCloud]

[SubRecord,Mo8onDb, Dovetaildb]

Graph Databases

Neo4J

API: lots of langs,Protocol: Java embedded / REST, Query Method: SparQL, nativeJavaAPI, JRuby,Replication: typical MySQL stylemaster/slave,Written in: Java, Concurrency: non-block reads, writes locks involvednodes/relationships until commit,Misc: ACIDpossible, Links: Video », Blog »

ArangoDB, OrientDB

(Doc Store & GraphDB & Key-Value. More details in Category Multimodel Databases)

Infinite Graph

(by Objectivity) API: Java,Protocol: Direct Language Binding, Query Method: Graph Navigation API,Predicate Language Qualification, Written in: Java (Core C++),Data Model: Labeled Directed Multi Graph, Concurrency: Update locking on subgraphs,concurrent non-blocking ingest, Misc: Free for Qualified Startups.

Sparksee

(former DEX):API: Java, .NET, C++, Python, Objective-C, Blueprints InterfaceProtocol: Embedded,Query Method: as above + Gremlin (via Blueprints),Written in: C++,Data Model: Labeled Directed Attributed Multigraph,Concurrency: yes,Misc: ACID possible, Free community edition up to 1 Mio objects,Links: Intro »,Technical Overview »

TITAN

:API: Java, Blueprints, Gremlin, Python, Clojure Protocol: Thrift, RexPro(Binary), Rexster (HTTP/REST) Query Method: Gremlin, SPARQL Written In: Java Data Model: labeled Property Graph, directed, multi-graph adjacency list Concurrency: ACID Tunable C Replication: Multi-Master License: Apache 2 Pluggable backends: Cassandra, HBase, MapR M7 Tables, BDB, Persistit, Hazelcast Links: Titan User Group

InfoGrid

API: Java, http/REST, Protocol: as API + XPRISO, OpenID, RSS, Atom, JSON, Javaembedded, Query Method: Web user interface with html, RSS, Atom, JSON output, Javanative,Replication: peer-to-peer,Written in: Java,Concurrency: concurrent reads, write lock within one MeshBase, Misc: Presentation »

HyperGraphDB

API: Java(and Java Langs), Written in: Java,Query Method: Javaor P2P, Replication: P2P,Concurrency: STM,Misc: Open-Source, Especially for AI and Semantic Web.

GraphBase

Sub-graph-based API, query language, tools & transactions.Embedded Java, remote-proxy Java or REST.Distributed storage & processing. Read/write all Nodes.Permissions & Constraints frameworks. Object storage, vertex-embedded agents.Supports multiple graph models. Written in Java

Trinity

API: C#, Protocol: C# Language Binding, Query Method: Graph Navigation API, Replication: P2P with Master Node,Written in: C#, Concurrency: Yes (Transactional update in online query mode,Non-blocking readin Batch Mode) Misc: distributed in-memory storage, parallel graph computationplatform (Microsoft Research Project)

AllegroGraph

API: Java, Python, Ruby, C#, Perl, Clojure, Lisp Protocol: REST,Query Method: SPARQL and Prolog, Libraries: Social Networking Analytics & GeoSpatial,Written in: Common Lisp, Links: Learning Center », Videos »

BrightstarDB

A native, .NET, semantic web database with code first Entity Framework, LINQand OData support. API: C#, Protocol: SPARQLHTTP, C#, Query Method: LINQ, SPARQL, Written in: C#

Bigdata

API: Java, Jini service discovery, Concurrency: very high(MVCC),Written in: Java, Misc: GPL + commercial, Data: RDF data with inference, dynamickey-range sharding of indices,Misc: Blog » (parallel database, high-availability architecture,immortal database with historical views)

Meronymy

RDF enterprise database management system. It is cross-platform and can be used with most programming languages.Main features: high performance, guarantee database transactions with ACID, secure with ACL's, SPARQL &SPARUL, ODBC & JDBC drivers, RDF & RDFS. »

WhiteDB

WhiteDB is a fast lightweight graph/N-tuples shared memory database library written in C with focus on speed, portability and ease of use. Both for Linux and Windows, dual licenced with GPLv3 and a free nonrestrictive royalty-free commercial licence.

OpenLink Virtuoso

Hybrid DBMS covering the following models: Relational, Document, Graph

VertexDB

FlockDB

by twitter » »

weaver

scalable, fast, consistent

BrightstarDB

Execom IOG

Fallen 8

Github »

[Java Universal Network / Graph Framework, OpenRDF / Sesame, Filament, OWLim, NetworkX, iGraph, Jena]

List of SPARQL implementations can be found here

Multimodel Databases

ArangoDB

API: REST, Graph Blueprints, C#, D, Ruby, Python, Java, PHP, Go, Python, etc. Data Model: Documents, Graphs and Key/Values. Protocol: HTTP using JSON.Query Method: declarative query language (AQL), query by example.Replication: master-slave (m-m to follow), Sharding: automatic and configurable Written in: C/C++/Javascript (V8 integrated),Concurrency: MVCC, tuneableMisc: ACID transactions, microservices framework "Foxx" (Javascript), many indices as secondary, fulltext, geo, hash, Skip-list, capped collections

OrientDB

API: REST, Binary Protocol, Java, Node.js, Tinkerpop Blueprints, Python, PHP, Go, Elixir, etc.,Schema: Has features of an Object-Database, DocumentDB, GraphDB and Key-Value DB,Written in: Java,Query Method: SQL, Gremlin, SparQL,Concurrency: MVCC, tuneable,Indexing: Primary, Secondary, Composite indexes with support for Full-Text and Spatial,Replication: Master-Master + sharding,Misc: Really fast, Lightweight, ACID with recovery.

Datomic

API: Many jvm languages, Protocol: Native + REST, Query Method: Datalog + custom extensions, Scaling: elastic via underlying DB (in-mem, DynamoDB, Riak, CouchBase, Infinispan, more to come), Written in: Clojure, Concurrency: ACID MISC: smart caching, unlimited read scalability, full-text search, cardinality, bi-directional refs 4 graph traversal, loves Clojure + Storm.

FoundationDB

Bought by Apple Inc. Not available any more.

AlchemyDB

GraphDB + RDBMS + KV Store + Document Store. Alchemy Database is alow-latency high-TPS NewSQL RDBMS embedded in the NOSQL datastoreredis. Extensive datastore-side-scripting is provided via deeplyembedded Lua. Bought and integrated with Aerospike.

CortexDB

CortexDB is a dynamic schema-less multi-model data base providing nearly all advantages of up to now known NoSQL data base types (key-value store, document store, graph DB, multi-value DB, column DB) with dynamic re-organization during continuous operations, managing analytical and transaction data for agile software configuration,change requests on the fly, self service and low footprint.

WonderDB

API:JDBC,SQL; WonderDB is fully transactional, distributed NewSQL database implemented in java based on relational architectures. So you can get best of both worlds, sql, joins and ease of use from SQL and distribution, replication and sharding from NoSQL movement. Tested performance is over 60K per node with Amazon m3.xlarge VM.

---

The following section containts Soft NoSQL Systems

[Mostly NOT originated out of a Web 2.0 need but worth a look for great non relational solutions]

Object Databases »

Versant

API:Languages/Protocol: Java, C#, C++, Python. Schema: language class model (easy changable). Modes: alwaysconsistent and eventually consistent Replication: synchronous fault tolerant and peer to peer asynchronous. Concurrency: optimisticand object based locks. Scaling: can add physical nodes on fly for scale out/inand migrate objects between nodes without impact to application code. Misc: MapReducevia parallel SQL like query across logical database groupings.

db4o

API: Java, C#, .Net Langs, Protocol: language, Query Method: QBE (byExample), Soda, Native Queries, LINQ (.NET),Replication: db4o2db4o & dRS to relationals, Written in: Java,Cuncurrency: ACID serialized, Misc: embedded lib, Links:DZone Refcard #53 »,Book »,

Objectivity

API:Languages: Java, C#, C++, Python, Smalltalk, SQL access through ODBC. Schema: nativelanguage class model, direct support for references, interoperable across all language bindings. 64 bit uniqueobject ID (OID) supports multi exa-byte. Platforms: 32 and 64 bit Windows, Linux, Mac OSX,*Unix. Modes: always consistent (ACID). Concurrency: locks at cluster ofobjects (container) level. Scaling: unique distributed architecture, dynamic addition/removalof clients & servers, cloud environment ready. Replication: synchronous with quorum faulttolerant across peer to peer partitions.

GemStone/S

API: Java, C, C++, SmalltalkSchema: language class modelPlatforms: Linux, AIX, Solaris, Mac OSX, Windows clientsModes: always consistent (ACID)Replication: shared page cache per node, hot standby failoverConcurrency: optimistic and object based locksScaling: arbitrarily large number of nodesMisc: SQL via GemConnect

Starcounter

API: C# (.NET languages),Schema: Native language class model, Query method: SQL, Concurrency: FullyACID compliant, Storage: In-memory with transactions secured on disk, Reliability: Full checkpoint recovery, Misc: VMDBMS - Integrating the DBMS with the virtual machinefor maximal performance and ease of use.

Perst

API: Java,Java ME,C#,Mono. Query method: OO via Perst collections, QBE, Native Queries,LINQ, native full-text search, JSQL Replication: Async+sync (master-slave) Written in: Java, C#. Caching: Object cache (LRU, weak, strong), page pool, in-memory database Concurrency: Pessimistic+optimistic(MVCC) + async or sync (ACID) Index types: Many tree models + TimeSeries. Misc: Embedded lib., encryption, automatic recovery, native full text search, on-line or off-line backup.

VelocityDB

Written in 100% pure C#, Concurrency: ACID/transactional, pessimistic/optimistic locking, Misc: compact data, B-tree indexes, LINQ queries, 64bit object identifiers (Oid) supporting multi millions of databases and high performance. Deploy with a single DLL of around 400KB.

HSS Database

Written in: 100% C#,The HSS DB v3.0 (HighSpeed-Solutions Database), is a client based, zero-configuration, auto schema evolution, acid/transactional, LINQ Query, DBMS for Microsoft .NET 4/4.5, Windows 8 (Windows Runtime), Windows Phone 7.5/8, Silverlight 5, MonoTouch for iPhone and Mono for Android

ZODB

API: Python,Protocol: Internal, ZEO,QueryMethod: Direct object access, zope.catalog, gocept.objectquery,Replication: ZEO, ZEORAID, RelStorageWritten in: Python, C Concurrency: MVCC, License: Zope Public License (OSI approved)Misc: Used in production since 1998

Magma

Smalltalk DB, optimistic locking, Transactions, etc.

NEO

API: Python - ZODB "Storage" interface, Protocol: native, Query Method: transactional key-value,Replication: native,Written in: Python,Concurrency: MVCC(internally), License: GPL "v2 or later", Misc: Load balancing, fault tolerant, hot-extensible.

siaqodb

An object database engine that currently runs on .NET, Mono, Silverlight,WindowsPhone 7, MonoTouch, MonoAndroid, CompactFramework; It hasimplemented a Sync Framework Provider and can be synchronized with MSSQLServer; Querymethod: LINQ;

Sterling

is a lightweight object-oriented database for .NET with support forSilverlight and Windows Phone 7. It features in-memory keys andindexes, triggers, and support for compressing and encrypting theunderlying data.

Morantex

Stores .NET classes in a datapool. Build for speed. SQL Serverintegration. LINQ support.

EyeDB

EyeDB is an LGPL OODBMS,provides an advanced object model (inheritance, collections, arrays,methods, triggers, constraints, reflexivity), an object definitionlanguage based on ODMG ODL, an object query and manipulation languagebased on ODMG OQL. Programming interfaces for C++ and Java.

FramerD

Object-Oriented Database designed to support the maintenance andsharing of knowledge bases. Optimized for pointer-intensive datastructures used by semantic networks, frame systems, and manyintelligent agent applications. Written in: ANSI C.

Ninja Database Pro

Ninja Database Pro is a .NET ACID compliant relational object database thatsupports transactions, indexes, encryption, and compression. It currentlyruns on .NET Desktop Applications, Silverlight Applications, and Windows Phone 7 Applications.

NDatabase

API: C#, .Net, Mono, Windows Phone 7, Silverlight, Protocol: language, Query Method: Soda, LINQ (.NET), Written in: C#, Misc: embedded lib, indexes, triggers, handle circular ref,LinqPad support, Northwind sample, refactoring, in-memory database,Transactions Support (ACID) and more, Documentation: »

PicoLisp

Language and Object Database, can be viewed as a Database DevelopmentFramework. Schema: native language class model with relations + various indexes.Queries: language build in + a small Prolog like DSL Pilog. Concurrency: synchronization+ locks.Replication, distribution and fault tolerance is not implemented per default but can be implemented with nativefunctionality. Written in C (32bit) or assembly (64bit).

acid-state

API: Haskell,Query Method: Functional programming,Written in: Haskell,Concurrency: ACID, GHC concurrent runtime,Misc: In-memory with disk-based log, supports remote accessLinks: Wiki »,Docs »

ObjectDB

API: Java (JPA / JDO)Query method: JPA JPQL, JDO JDOQLReplication: Master-slaveWritten in: 100% Pure JavaCaching: Object cache, Data cache, Page cache, Query Result cache, Query program cacheConcurrency: Object level locking (pessimistic + optimistic)Index types: BTree, single, path, collectionMisc: Used in production since 2004, Embedded mode, Client Server mode, automatic recovery, on-line backup.

CoreObject

CoreObject: Version-controlled OODB, that supports powerful undo, semantic merging, and real-time collaborative editing.MIT-licensed, API: ObjC, Schema: EMOF-like, Concurrency: ACID, Replication: differential sync, Misc: DVCS based on object graph diffs, selective undo, refs accross versioned docs, tagging, temporal indexing, integrity checking. [StupidDB »,KiokuDB » (Perl solution),Durus »]

Grid & Cloud Database Solutions

Oracle Coherence

Oracle Coherence offers distributed, replicated, multi-datacenter, tiered (off-heap/SSD) and near (client) caching. It provides distributed processing, querying, eventing, and map/reduce, session management, and prorogation of database updates to caches. Operational support provided by a Grid Archive deployment model.

GigaSpaces

Popular SpaceBased Grid Solution.

GemFire

GemFire offers in-memory globally distributed data management with dynamic scalability, very high performance and granular control supporting the most demanding applications. Well integrated with the Spring Framework, developers can quickly and easily provide sophisticated data management for applications. With simple horizontal scale-out, data latency caused by network roundtrips and disk I/O can be avoided even as applications grow.

Infinispan

scalable, highly available data grid platform, open source,written in Java.

Queplix

NOSQL Data Integration Environment, can integrate relational, object, BigData – NOSQL easily and withoutany SQL.

Hazelcast

Hazelcast is a in-memory data grid that offers distributed data in Java with dynamic scalability under the Apache 2 open source license. It provides distributed data structures in Java in a single Jar file including hashmaps, queues, locks, topics and an execution service that allows you to simply program these data structures as pure java objects, while benefitting from symmetric multiprocessing and cross-cluster shared elastic memory of very high ingest data streams and very high transactional loads.

Crate Data

A shared nothing, document-oriented cluster data store. Accessed via SQL and has builtin BLOB support. Uses the cluster state implementation and node discovery of Elasticsearch. License: Apache 2.0, Query Method: SQL, Clients: HTTP (REST), Python, Java (JDBC or native), Ruby, JS, Erlang, Replication + Sharding: automatic and configurable, written in: Java, » Crate Data GitHub Project, » Documentation. [ GridGain, ScaleOut Software, Galaxy, Joafip,Coherence, eXtremeScale]

XML Databases

EMC Documentum xDB

(commercial system) API: Java, XQuery,Protocol: WebDAV, webservices, Query method: XQuery, XPath, XPointer,Replication: lazyprimary copy replication (master/replicas), Written in: Java,Concurrency: concurrent reads, writes withlock; transaction isolation,Misc: Fully transactional persistent DOM; versioning; multiple indextypes; metadata and non-XML data support; unlimited horizontal scaling.Developer Network »

eXist

API: XQuery, XML:DB API,DOM, SAX, Protocols: HTTP/REST,WebDAV, SOAP, XML-RPC, Atom, Query Method: XQuery, Written in: Java(open source),Concurrency: Concurrentreads, lock on write;Misc: Entire web applications can be written in XQuery, using XSLT,XHTML, CSS, and Javascript (for AJAX functionality). (1.4)adds anew full text search index based on Apache Lucene, a lightweight URLrewriting and MVC framework, and support for XProc.

Sedna

Misc: ACID transactions, security, indices, hot backup. Flexible XMLprocessing facilities include W3C XQuery implementation, tightintegration of XQuery with full-text search facilities and a node-levelupdate language.

BaseX

BaseX is a fast, powerful, lightweight XML database systemandXPath/XQuery processor with highly conformant support for the latestW3C Update and Full Text Recommendations. Client/Server architecture,ACID transaction support, user management, logging, Open Source,BSD-license, written in Java, runs out of the box.

Qizx

commercial and open source version, API: Java, Protocols:HTTP, REST, QueryMethod: XQuery, XQueryFull-Text, XQuery Update, Written in: Java, full source can bepurchased,Concurrency: Concurrentreads & writes, isolation, Misc: Terabyte scalable, emphasizesquery speed.

Berkeley DB XML

API: Many languages,Written in: C++,Query Method: XQuery,Replication: Master /Slave, Concurrency: MVCC,License: Sleepycat
[ Xindice Tamino]

Multidimensional Databases

Globals:

by Intersystems, multidimensionalarray.Node.jsAPI, array based APIs (Java / .NET), and a Java based document API.

Intersystems Cache

PostrelationalSystem. Multidimensional array APIs, Object APIs, Relational Support(Fully SQL capable JDBC, ODBC, etc.) and Document APIs are newinthe upcoming 2012.2.x versions. Availible forWindows, Linux and OpenVMS.

GT.M

API: M, C, Python, Perl,Protocol: native, inprocess C, Misc: Wrappers: M/DB for SimpleDBcompatible HTTP », MDB:Xfor XML », PIPfor mapping to tables for SQL »,Features: Small footprint (17MB), Terabyte Scalability, Unicodesupport, Database encryption, Secure, ACID transactions (single node),eventual consistency (replication), License: AGPL v3 on x86 GNU/Linux, Links: Slides »,

SciDB

Array Data Model for Scientists, » paper, » poster, »HiScaBlog

MiniM DB

:Multidimensional arrays, API: M, C, Pascal, Perl,.NET, ActiveX, Java, WEB.Available for Windows and Linux.

rasdaman

:Short description: Rasdaman is a scientific database that allows to store and retrieve multi-dimensional raster data (arrays) of unlimited size through an SQL-style query language.API: C++/Java, Written in C++, Query method: SQL-like query language rasql,as well as via OGC standards WCPS, WCS, WPS link2

DaggerDB

:is a new Realtime analytics database written in .NET C#.ACID compliant. fluent .NET query API, Client / server or in-process.In-memory and persistent mode.[ EGTM: GT.M for Erlang, "IODB: EGTM-powered ObjectDB for Erlang]

Multivalue Databases

U2

(UniVerse, UniData): MultiValueDatabases, Data Structure: MultiValued, Supports nestedentities, Virtual Metadata, API: BASIC, InterCall,Socket, .NET and Java API's, IDE: Native, Record Oriented,Scalability: automatictable space allocation, Protocol: Client Server, SOA,Terminal Line, X-OFF/X-ON, Written in: C, Query Method: NativemvQuery, (Retrieve/UniQuery) and SQL,Replication: yes, Hotstandby, Concurrency: Recordand File Locking (Fine and Coarse Granularity)

OpenInsight

API: Basic+,.Net, COM, Socket, ODBC, Protocol: TCP/IP, Named Pipes, Telnet,VT100. HTTP/S Query Method: RList, SQL & XPath Written in:Native 4GL, C, C++, Basic+, .Net,Java Replication: Hot StandbyConcurrency: table &/or row locking, optionally transaction based & commit& rollback Data structure: Relational &/orMultiValue, supports nested entities Scalability: rows and tables size dynamically

TigerLogic PICK

(D3, mvBase, mvEnterprise) Data Structure: Dynamic multidimensional PICK data model, multi-valued, dictionary-driven, API: NET, Java, PHP, C++, Protocol: C/S, Written In: C, Query Method: AQL, SQL, ODBC, Pick/BASIC, Replication: Hot Backup, FFR, Transaction Logging + real-time replication, Concurrency: Row Level Locking, Connectivity: OSFI, ODBC, Web-Services, Web-enabled, Security: File level AES-128 encryption

Reality

(Northgate IS):The original MultiValue data set database, virtual machine, enquiry andrapid development environment. Delivers ultra efficiency, scalabilityand resilience while extended for the web and with built-in autosizing, failsafe and more. Interoperability includes Web Services, JavaClasses, XML,ActiveX, Sockets, C and, for those that have tointeroperate with the SQLworld, ODBC/JDBCand two-way transparent SQL data access.

OpenQM

Supports nested data. Fully automated table space allocation. Concurrencycontrol via task locks, file locks & shareable/exclusive recordlocks. Case insensitivity option. Secondary key indices. Integrateddata replication. QMBasic programming language for rapid development.OO programming integrated into QMBasic. QMClient connectivity fromVisual Basic, PowerBasic, Delphi, PureBasic, ASP, PHP, C and more.Extended multivalue query language.

Model 204 Database

A high performance dbms that runs on IBM mainframes (IBM z/OS, z/VM, zVSE),+SQL interface with nested entity supportAPI: native 4GL (SOUL + o-o support), SQL, Host Language (COBOL, Assembler, PL1) API, ODBC, JDBC, .net, Websphere MQ, SocketsScalability: automatic table space allocation, 64-bit supportWritten in: IBM assembler, CQuery method: SOUL, SQL, RCL ( invocation of native language from client )Concurrency: record and file level lockingConnectivity: TN3270, Telnet, Http

Tieto TRIP

Hybrid database / search engine system with characteristics of multi-value, document, relational, XML and graph databases. Used in production since 1985 for high-performance search and retrieve solutions. Full-text search, text classification, similarity search, results ranking, real time facets, Unicode, Chinese word segmentation, and more. Platforms: Windows, Linux, AIX and Solaris. API: .NET, Java and C/C++. Query methods: native (CCL), SQL subset, XPath. Commercial.

ESENT

(by Microsoft) ISAM storage technology. Access using index orcursor navigation. Denormalized schemas, wide tables with sparsecolumns, multi-valued columns, and sparse and rich indexes. C# andDelphi drivers available. Backend for a number of MS Products asExchange.

jBASE

more info »

Event Sourcing

Event Store

Time Series Databases

Axibase

Distributed DB designed to store and analyze high-frequency time-series data at scale.Includes a large set of built-in features: Rule Engine, Visualization, Data Forecasting, Data Mining.API: RESTful API, Network API, Data API, Meta API, SQLAPI Clients: R, Java, Ruby, Python, PHP, Node.jsReplication: Master SlaveMajor protocol & format support: CSV, nmon, pickle, StatsD, collectd, tcollector, scollector, JMX, JDBC, SNMP, JSON, ICMP, OVPM, SOAP.

other NoSQL related databases

IBM Lotus/Domino

Type: Document Store, API: Java, HTTP, IIOP, C API, REST Web Services, DXL, Languages: Java, JavaScript,LotusScript, C, @Formulas, Protocol: HTTP, NRPC, Replication: Master/Master, Written in: C, Concurrency:EventuallyConsistent, Scaling: ReplicationClusters

eXtremeDB

Type: In-MemoryDatabase; Written in: C;API: C/C++, SQL, JNI,C#(.NET), JDBC;Replication: Async+sync(master-slave), Cluster; Scalability: 64-bit and MVCC

RDM Embedded

APIs: C++, Navigational C.Embedded Solution that is ACID Compliant with Multi-Core, On-Disk&In-Memory Support. Distributed Capabilities, Hot Online Backup,supports all Main Platforms. SupportedB Tree & Hash Indexing. Replication: Master/Slave,Concurrency: MVCC.Client/Server: In-process/Built-in.

ISIS Family

(semistructured databases) »

Moonshadow

NoSql, in-memory, flat-file, cloud-based. API interfaces. Small data footprint and very fast data retrieval. Stores 200 million records with 200 attributes in just 10GB. Retrieves 150 million records per second per CPU core. Often used to visualize big data on maps. Written in C.

VaultDB

Next-gen NoSQL encrypted document store. Multi-recipient / group encryption. Featuers: concurrency, indices, ACID transactions, replication and PKI management. Supports PHP and many others. Written in C++. Commercial but has a free version. API: JSON

Vyhodb

Service oriented, schema-less, network data model DBMS.Client application invokes methods of vyhodb services, which arewritten in Java and deployed inside vyhodb. Vyhodb services readsand modifies storage data. API: Java, Protocol:RSI - Remote service invocation, Written in: Java,ACID: fully supported, Replication: async master slave, Misc: online backup,License: proprietary

Prevayler

Java RAM Data structurejournalling.

Yserial

Python wrapper over sqlite3

Scientific and Specialized DBs

BayesDB

BayesDB, a Bayesian database table, lets users query the probable implications of their tabular data as easily as an SQL database lets them query the data itself. Using the built-in Bayesian Query Language (BQL), users with no statistics training can solve basic data science problems, such as detecting predictive relationships between variables, inferring missing values, simulating probable observations, and identifying statistically similar database entries.

GPUdb

A distributed database for many core devices. GPUdb leverages many core devices such as NVIDIA GPUs to providean unparallelled parallel database experience. GPUdb is a scalable,distributed database with SQL-style query capability, capable ofstoring Big Data. Developers using the GPUdb API add data, and query the data with operations like select, group by, and join. GPUdb includes many operations not available in other "cloud database" offerings.

unresolved and uncategorized

Btrieve

(by Pervasive Software) key/index/tupel DB. Using Pages. » (faq »)

KirbyBase

Written in: Ruby. github: »

Tokutek:

Recutils:

GNU Tool for text files containing records and fields. Manual »

FileDB:

Mainly targeted to Silverlight/Windows Phone developers but its alsogreat for any .NET application where a simple local database isrequired, extremely Lightweight - less than 50K, stores one table perfile, including index, compiled versions for Windows Phone 7,Silverlight and .NET, fast, free to use in your applications

CodernityDB

written in Python illuminate Correlation Database », FluidDB (Column Oriented DB) »,Fleet DB », Btrieve,
Twisted Storage », Java-Chronicle », Ringo, Sherpa,tin, Dryad, SkyNet, Disco
Possibly the oldest NoSQL DB (together with MUMPS and IBMs IMS & IDMS [1968,1964]): »Adabas VSAM by IBM is also a good candidate.