sgnlp icon indicating copy to clipboard operation
sgnlp copied to clipboard

download_pretrained for demo API does not cache downloaded files/models

Open jonheng opened this issue 2 years ago • 0 comments

To allow the containers to start up quicker, models and files were downloaded and cached during build time.

Recent changes in the huggingface transformers package has broken this functionality:

  • Released in v4.22.0
  • Issue

Possible choices moving forward:

  • Write a simple caching utility function
  • Stick to versions of transformers before 4.22.0

jonheng avatar Sep 19 '22 07:09 jonheng