disco
disco copied to clipboard
epfml
paper implementation tracker
over the years, a bunch of papers have been published at MLO and around which might help DISCO one way or the other. here goes a list of the ones we spoke about. it is still up for debate which we actually need the most.
- :tornado: communication efficiency
- :lock: privacy-preserving
- secure aggregation for privacy-preserving ML
- somewhat done, only honest-but-curious server, need to be validated
- secure byzantine-robust ML
- secure aggregation for privacy-preserving ML
- :hammer_and_wrench: fault-tolerant and dynamic over time
- buffered async aggregation
- done, need to document it in code
- async SGD
- buffered async aggregation
- :ninja: robust to malicious actors and data poisoning
- byzantine robust optimisation
- partially done via norm clipping
- byzantine robust learning on heterogeneous data
- byzantine robust optimisation
- :apple: :banana: interpretable in imperfectly interoperable data distributions
- :mirror: personalizable
only cosmetic change needed:
async buffered is already implemented.
byz as well (partially)
future roadmap: ... ifedavg future roadmap: ... personalized future roadmap: ... incentivize
What do you think about: https://arxiv.org/abs/2411.19870
https://distro.nousresearch.com/
