disco icon indicating copy to clipboard operation
disco copied to clipboard

Garbage Collecting past node contributions

Open JulienVig opened this issue 1 year ago • 0 comments

At every round, nodes receive weight updates from peers or the server which they store and/or aggregate to update their local model. Currently, weights from past rounds are kept indefinitely and accumulates over time. This is not prohibitive but is not efficient.

Specifically, in the federated case, the server results and the aggregated results are stored indefinitely

// client/federated.ts
const serverResult = await this.sendPayloadAndReceiveResult() // creates new tensors
// aggregator/mean.ts
this.aggregate() // creates new tensors

JulienVig avatar Jun 11 '24 11:06 JulienVig