petals icon indicating copy to clipboard operation
petals copied to clipboard

Manual management of shards

Open nrs-status opened this issue 2 months ago • 0 comments

Hi, I was wondering if anyone had recommendations of which parts of the library I should look at if I'm interested in how models are sharded, and if there's a way to manage this sharding manually? Most of all, if there's a way to load a shard from an already sharded model, for instance in a private cluster, so that there's a way to know in advance which instance will have which shard. Any reading suggestions in the repo are appreciated!

nrs-status avatar Apr 10 '24 20:04 nrs-status