chrisjsewell/aiida-process-coordinator

A prototype for a non-RabbitMQ `Process` execution coordinator.

aiida-process-coordinator's Issues

Other alternatives to RabbitMQ

Hi Chris, just adding here the link to another message broker that a colleague just mentioned to me today:
https://mqtt.org/
This seems to be much more lightweight than RabbitMQ, as it's designed for IoT devices, but has similar concepts (actually I think there is a RabbitMQ plugin for the mqtt protocol).

It seems there are many py client libraries, a few are unmaintained but at least one or two seem to be actively maintained (like the eclipse one). Beside checking if this would work for our usecase, one would need also to check if there are robust and easy to install servers/brokers (otherwise we just shift the problem rather than fixing it :-) ).

I just wanted to mention it here so we don't forget - a solution as proposed in this repo without additional servers has clearly that pro, but I fear that implementing a robust message passing protocol with guarantees is a lot of work, and relying on some existing protocol and implementation (but simpler to install and use than RabbitMQ) could be a good compromise.

(As a note there's also ZeroMQ but I think it's a much more low-level communication library, while mqtt has a full protocol definition).