zacblanco/cloud-ksvd

MATLAB and Python Implementation for the Cloud K-SVD Algorithm

cloud-ksvd's Issues

Remove MPI from Consensus

Work has already been started but I wanted to make a tracking issue for the work leading up to this.

Make repo python-package compliant

Want to reorganize the repo so it's more compatible with the pip module architecture - this way we can export and upload cloud k-svd elsewhere for others to use.

Also this will help integrate doing tests+travis once we get the ball rolling.

Asynchronous Consensus Methods

We should add different consensus implementations which allow us to test consensus in a variety of ways.

Cluster Management Interface

Goal here is to create a somewhat simple interface that allows us to do the following things:

• Kick off Cloud K-SVD job on the cluster
• Submit graph topology
• Adjust sparsity constraints
• Adjust Dictionary size (in atoms)
• Check the connection to each node in the cluster
• Return data from the Cloud K-SVD jobs

Replace MPI send/receive with asychronous sockets calls

We need to stop using MPI, but rather UDP.

We've shown from some research that the algorithm can run faster if we use UDP rather than MPI communication and can be faster in terms of resiliency.

With this in mind we should create some kind of async socket interface in order to send and listen for data in the background while our algorithm is listening.