20centaurifux/blocks-monger

MongoDB storage backend for blocks (content-addressable data storage).

blocks-monger

This library provides a content-addressable block store.

Installation

The library can be installed from Clojars using Leiningen:

Usage

The blocks.store.monger namespace provides the monger-block-store constructor. Specify at least the host and db-name option to connect to your MongoDB server.

Blocks are stored in a collection named blocks. Each document contains the hex-encoded id of the stored block, meta data, algorithm and data (base64 encoded).

=> (require '[blocks.core :as blocks]
            '[blocks.store.monger])

; create a new block store:
=> (def store (blocks/->store "monger://localhost/my-storage"))

; insert block:
=> @(blocks/put! store (blocks/read! "hello world"))
Block[hash:sha2-256:b94d27b9934d3e08a52e52d7da7dabfac484efe37a5380ee9088f7ace2efcde9 11 *]

; listing blocks - data is filtered on server-side:
=> (blocks/list-seq store :limit 1 :algorithm :sha2-256 :after "122")
(Block[hash:sha2-256:b94d27b9934d3e08a52e52d7da7dabfac484efe37a5380ee9088f7ace2efcde9 11 *])

; deleting all documents:
(blocks/erase! store)

blocks-monger's Issues

Upgrade to blocks 2.x

Version 2.0.0 of blocks has many changes to the storage interface. This primarily involves making the store methods asynchronous to support higher-performance and concurrent usage of the store. In addition, there have been several simplifications to the codebase.

This implementation needs to be upgraded to support the new interfaces; a simple version of this would involve wrapping futures around each of the existing methods. Listing as a stream is a bit more complex though - for pointers, see the s3 implementation.