henk717
henk717
For now i'd like to focus on the GPT-J and Neo models since those we know for certain work correctly (at least until we can reliably get good output from...
+1 on this, people would love to have this in KoboldAI but we have no good way of implementing it at the moment. We already have OpenAI support so that...
Plus one on this, its basically impossible for the end users to reliably differentiate and the only way we have been keeping it managable on a user support side is...
Going to give you a very quirky solution for this from my sysadmin experience. Press Ctrl + Windows Key + Q and wait until that thing fully loaded and you...
Having the same issue, it doesnt appear to get a model list? Test URl is here : https://koboldai-koboldcpp-tiefighter.hf.space/v1
Awesome to see that the automatic disable is being planned, will keep this in mind in my implementation.
What model causes this?
Or I see its the Horde backend, that one indeed needs some fixing still. For the time being check out https://koboldai.net which has excellent Horde compatibility.
As a workaround you can use https://koboldai.org/cpp standalone (Optionally with the Online Services -> API -> KoboldAI API option if you wish to keep this UI)
It is a single GPU doing the calculations and the CPU has to move the data stored in the VRAM of the other GPU's. So you are introducing a GPU...