shadowjonathan/conduit_toolbox

🧰🦀 A bunch of tools that're helpful for conduit

$ whoami

Someone interested in systems (of all kinds, not just computers), who does programming on the side, and sometimes makes a thing or two.

Currently relatively focused on matrix, supporting it on the side via ruma, poking it from all sides.

Someone who loves to work in Rust. 💚 🦀

Wanting to make more Europe-focused software.

conduit_toolbox's Issues

RocksDB fixup tool

@timokoesters:

Okay short summary for you: rocksdb has a bug where it always sets a wrong compressions option if a specific rust feature is enabled, but we want to use another, incompatible, compression option. That means all people currently using rocksdb want to migrate from "rocksdb with feature A" to "rocksdb with feature B"

I'd rather want to have a fixup tool for this, so someone can run it "to just fix it"

Deprecate conduit_sled_to_sqlite

In favour of conduit_migrate

• Add banner to README
• Add alt instructions
• Remove actual binary target

Change rocksdb config

From timo:

I changed the rocksdb config, you might need to copy that one over

Unable to migrate from rocks to sqlite

I was trying to use this tool to move my conduit database from rocksdb to sqlite and it does not work correctly. I get the following error:

% conduit_migrate -f rocks -t sqlite -s conduit -d exit
[tools/migrate/src/main.rs:164:5] &src_dir = "/home/user/conduit"
[tools/migrate/src/main.rs:164:5] &dst_dir = "/home/user/exit"
Error: Corruption: unknown checksum type 4 from footer of /home/user/conduit/006562.sst, while checking block at offset 1035 size 79

It seems as if there is a problem with that particular file, however conduit does not complain about any database problems.

Installation method does not work

The installation method suggested in README.md does not work:

❯ cargo install --locked --git https://github.com/shadowjonathan/conduit_toolbox
    Updating git repository `https://github.com/shadowjonathan/conduit_toolbox`
error: multiple packages with binaries found: conduit_migrate, conduit_sled_to_sqlite

Ability to convert synapse's signing key to DER PKCS#8 v2

Add flag to migration to `mv` media subdirectory

Update README to include conduit_migrate

Ability to extract the signing key from conduit

globals > keypair

Add persy backend

Add persy backend, according to the interface from this MR