Stephen Hood

Looks like a domain direct configuration issue. Working on this, thanks for the report!

This is now fixed.

This is an interesting device, but my understanding is that it has very little onboard memory, which means that it's unlikely to be able to run even the smaller LLMs....

A llamafile is just a distribution mechanism and execution engine for open LLMs. This project has no involvement in the creation or tuning of the models themselves; we just make...

RAG is a powerful use for LLMs, no doubt about it, but we are not currently considering adding RAG to llamafile. Our reasoning follows: Adding RAG functionality to llamafile would...

Thank you for this feedback! We agree this is a concern. We’ve personally validated and can vouch for the example wrapped weights we provide with this project. Our plan next...

Thanks for the suggestions, folks. We're going to look into this. Any recommendations on a specific AMD card we should use for dev and testing? We could pick up an...

Just a quick update that we now have an RDNA2 card, and an RDNA3 card is on the way. @jart is actively working on adding this support!