distributed-inferencing topic

List distributed-inferencing repositories

pytorch-pruning-2step

23
Stars
5
Forks
Watchers

2-stage pruning to favor distributed inference (local device compute half of the model, upload the feature for further computing on stronger devices or cloud).