distributed-inferencing topic
List
distributed-inferencing repositories
pytorch-pruning-2step
23
Stars
5
Forks
Watchers
2-stage pruning to favor distributed inference (local device compute half of the model, upload the feature for further computing on stronger devices or cloud).