cog-sdxl icon indicating copy to clipboard operation
cog-sdxl copied to clipboard

load compressed weights

Open technillogue opened this issue 1 year ago • 0 comments

this uses https://github.com/technillogue/nyacomp to accelerate loading. it features nvCOMP bindings and tricks to start downloading and loading weights in parallel with python code. it can achieve load times as low as 9s in ideal conditions.

  • use nyacomp to load weights and bump libraries
  • include metadata files needed to load compressed
  • argument to compress or reload weights

technillogue avatar Jan 10 '24 20:01 technillogue