David
David
@fullstackwebdev That means manual processing, and lots of bookkeeping. @slundberg. How about a simple list of ordereddict? Something like `[{"system":"I am an AI assistant"}, {"search tool":"searches the internet, uses the...
So its whisper that's causing problems? You can try swapping to Distill Whisper small, which is half the size, and should run much faster on the Pi.
Hmmm, I'll try using tabbyAPI to replicate the bug.
Actually, this was already planned 😅 Did someone leak this!? 🤔
The model is really cool! I'm not sure how those modalities would be useful though. For example, it could generate music, or just as easily, have function calling and pick...
Closing this, as the next steps are listed on the Readme
@aaronchantrill Please look into the various card formats, and do a small write-up. I'm happy to integrate the correct code, but I don't have time to research which is best.
Not even looked into this yet! I need to build out the core systems first.
I'm on holiday 2 week now, without my workstation, so I wont be able to test the new code properly (maybe on my macbook, but its a bit slow...). Sorry...
This didn't make a difference for me on my 2060, but it didn't make it worse either. So, if its a net positive, I'm happy to accept the PR! Thanks...