nos icon indicating copy to clipboard operation
nos copied to clipboard

Investigate model weights diffs for faster `hub.load(...)`

Open spillai opened this issue 1 year ago • 0 comments

If we're able to build checksums for layer-wise weights, we should be able to only download the diffs and speed up model downloads significantly. This is particularly helpful if you're fine-tuning models (especially the last few layers, or changing only parts of an ensemble model).

spillai avatar May 10 '23 02:05 spillai