Jacob Myers
Jacob Myers
I'll leave this here so I don't forget to look into this. I'll have to see if any other marlin screen implementations have accomplished this and how they went about...
@Tw0bit Yeah, I'm actually working with Alex to get this going
I've seen that implementation, and while it's functional, what me and Alex are cooking up should be a bit cleaner and give some more options.
I would be very interested in implementing such a thing if people are interested in collaboration. I think the best approach would be for me to set up the framework...
@N3tYaroz3 Nothing yet currently, I need to implement the language system and then I'll update this with what's needed.
@imax10000, I may still try to use the marlin language system rather that writing my own, but if need be there will be a template that I will distribute for...
After some testing, I found that setting my server to "interactive" mode, made it behave much more like I expected. It was about the same speed for the first response,...
Another small update: In addition to the impact of the server mode, it also seems the context window size is very important. Based on my testing, if I set the...
@MasterJH5574 Do you have any thoughts on this? For now the increased context windows size is an okay workaround, but it is taking up a lot off unnecessary VRAM and...
I bit the bullet and switched over to Ubuntu 24.04 hoping the WSL was the issue... it was not unfortunately. I am still experiencing the same behavior. As soon as...