JosephSBoyle

icon company Canon Medical Research icon location London, England icon location Doctoral Student with QMUL & Canon Medical Research Europe

Results 2 issues of JosephSBoyle

Add return type hint to AutoModel.from_pretained

11 comment

### Feature request I think the ergonomics of using, e.g. `AutoModelForSequenceClassification.from_pretrained(...)` can be improved. Consider the following example: ```python model = AutoModelForSequenceClassification.from_pretrained("bert-base-uncased") ``` It's quite hard to reason about `model`...

Error when using -ngl > 0

3 comment

Hia, I'm able to run on CPU, but when I try to run with GPU using: ```bash $ ./llamafile.exe -m Meta-Llama-3-70B-Instruct.Q4_0.llamafile -ngl 999 --port 7777 ``` I get the following...