cog-sdxl
cog-sdxl copied to clipboard
load compressed weights
this uses https://github.com/technillogue/nyacomp to accelerate loading. it features nvCOMP bindings and tricks to start downloading and loading weights in parallel with python code. it can achieve load times as low as 9s in ideal conditions.
- use nyacomp to load weights and bump libraries
- include metadata files needed to load compressed
- argument to compress or reload weights