Fred Bliss
Fred Bliss
> I also added Kobold/text-generation-webui support so you can run Llama or whatever you want locally. I only tested it a bit, but it worked well back when I made...
Anyone else make any progress on this? Was about to start looking at it where you left off, @paolorechia :)
@VikParuchuri I've been working on doc ai related things for years - this is one of the most elegant libraries I've seen, and using techniques/models that I've found worked best...
I'm getting it hanging on wsl2 ubuntu (win 11) as well. In a notebook and as a standalone python script (as well as wrapped in main). been using cuda +...
I'm sure someone will get to it before I have a chance, but I did this for cogvlm (probably a ton of others have as well). Not sure it helps...
Big fan of unsloth on my CUDA PC. Thought I'd see if there's any renewed interest here for MLX? Curious if anyone's been able to do a quick analysis on...
> @fblissjr Yep #4 :) So it's doable, just technically I do not have a Mac!!! Am a Windows + Linux user (shockingly!!) so I thought just adding Unsloth code...
This is something I'd be happy to test and contribute to as well. I remember seeing the original tweet, and just now got the Thunderbolt 4 cable connected across two...
> @awni That sounds like a good and doable first step. If I have time this week, I'm happy to take a first stab at it. > > FWIW, there...
> In progress #1097 amazing. so ready.