Alex O'Connell
Alex O'Connell
Just figured it out. You're using the correct token IDs, the parameters needed to be converted from string form to integers for the mask detection function to work properly. I...
Those models don't support system prompts. I can try and tweak things to support that but most of the code assumes that you are able to pass a system prompt...
I don't think I ever properly got the DPO stuff working. The loss never went down with the DPO dataset and the code hasn't been updated in a while.
closing old issue
This should be fixed in v0.3.5
I messed up the last release and just re-published it. Sometimes Github handles re-releases weird, so if that doesn't work I can just push a fully new version.
closing since this is related to an older version. recommended fix is to update to the latest version
I did some experiments with Qwen2 0.5B and the results were quite impressive compared to models like Phi-2 from last year: https://github.com/acon96/home-llm/blob/feature/polish-dataset/docs/experiment-notes-qwen.md#tinyhome-qwen-rev3 I definitely think that this project shows a...
The Home models actually predate tool support in Ollama. That means they only work with the extension provided in this repo (Local LLM Conversation) and not the built in Home...
> Is this already possible? Is there any update to fix this? [@acon96](https://github.com/acon96) :) I have a branch working on adding support for it [here](https://github.com/acon96/home-llm/tree/feature/agents-and-tools) but I haven't had time...