HyperTag icon indicating copy to clipboard operation
HyperTag copied to clipboard

Published 20 hours ago • verified publisher icon Ravn-Tech

Reduce daemon memory usage

Open SeanPedersen opened this issue 3 years ago • 0 comments

The daemon needs around 2GB of RAM and 1GB of VRAM right now. Try to minimize this.

Possible strategies:

  • Distill CLIP model
  • Replace DistilBERT with CLIP's text encoder (see #41 though...)

SeanPedersen avatar Feb 02 '21 22:02 SeanPedersen