David Young

Having the same issue. I'll give the PIL older version a try. I agree that easyocr should be adjusted for newer PIL versions. Or at least give people a heads...

Back installing worked for me. As well as installing from the the git master as archywillh mentioned worked for me as well. Thank you archywillhe for that info by the...

I think that this might be related to the interesting development that can be seen at: https://github.com/ollama/ollama/pull/3418#issuecomment-2080159140 Near the bottom of the #3418 issue you can see that dhiltgen has...

That is a really good point to reiterate.

Think you should consider doing arrangements for the other parameters as well. Would be pretty nice.

Just had an additional idea. The system prompt and/or other modelfile parameters could be in the file which could be passed in at command. file_a: ``` /set parameter system "This...

Pytorch convert from jax likely will open this model to be more accessible to 8-bit quantization. Which I think has been done. https://huggingface.co/hpcai-tech/grok-1 and https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/grok-1 for example. This is just...

Found this: - https://github.com/xai-org/grok-1/issues/202 'keyfan' and the 'LagPixelLOL' related links from the page of the mentioned issue may have related info of interest for you. Saw something mentioned in regards...

Quantization, when done right, can drop the disk and mem usage quite considerably. Moving this into cheaper inference and accessibility realms. On the downsides, quantization can add some time for...

@eshaojun If you have not already, you may want to do some research into ggerganov's llama.cpp github repo and accompanying GGUF quantization system. May prove useful in regards of your...