LLaVA-NeXT icon indicating copy to clipboard operation
LLaVA-NeXT copied to clipboard

Llama-3-8B gets always requested/required/loaded

Open uahic opened this issue 1 year ago • 2 comments

When importing (even selective) from conversation.py, the AutoTokenizer.from_pretrained("meta-llama....") gets triggered and tries to access huggingface, and for me personally I have no access to this model which causes an error.

image

The issue here is that all Conversations get instantiated as soon as anything from this file is imported. There should be a lazy loading way to do that

uahic avatar Aug 02 '24 16:08 uahic