exo
exo copied to clipboard
Smarter model downloading
See: https://github.com/exo-explore/exo/issues/14
Right now, every device downloads the entire model which is unnecessary. The design of exo makes things like this particularly difficult since all nodes are equal and p2p.
Two things needed:
- Sticky node ids. (To keep shards sticky)
- Filter files to download based on shards.