microsoft/openmsftl

Research simulation toolkit for federated learning

Open MS Federated Transfer Learning (OpenMSFTL)

OpenMSFTL is meant for facilitating research and development for federated learning algorithms.

This implements the following algorithms:

• Simple federated averaging (FedAVG)
• Dual optimization a.k.a adaptive FedAVG
• Spectral aggregation

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

openmsftl's Issues

Support for Speech Tasks

Support for Speech Tasks
We would like to add support for at least one speech task. Ideally, follow the vision_datasets.py implementation and do a parallel implementation, The output should be similar to that of vision_datasets

Multi Processing Support

We need to extend the code to Mutiple cpu , multiple gpus as available in most seamless way possible without making things convoluted.

Support for NLP Tasks

Support for NLP Tasks
We would like to add support for nlp tasks. Ideally, follow the vision_datasets.py implementation and do a parallel implementation, The output should be similar to that of vision_datasets, so I am guessing one of the two ways: use torchnlp and create dataloaders. Or, use our own embedding , indexer etc. For reference feel free to re-use my earlier implementations:
https://github.com/anishacharya/nlp-done-right/tree/master/common/utils