Maximilian Winter
Maximilian Winter
I managed to get the code running. But I think you have a problem with your GetVariable Function in ParserFunction.cs it compares the lowercase name to the normal case variable...
Here is my code with the fixed code. https://github.com/Maximilian-Winter/CSCS-Unity
I tried the second option to implement my own provider for llama-cpp-python in guidance but haven't got very far. I will try again later today.
Ok, I got a basic version working with guidance and llama-cpp-python. Will clean it up and test a little bit and then post a link here!
Here is the fork of guidance with llama-cpp-python support: https://github.com/Maximilian-Winter/guidance I'm not sure about any bugs, but this is the result of the RPG Character Example: The following is a...
@hippalectryon-0 I'm currently make some changes to llama-cpp-python to add logits processors and the stop criteria lists.
@hippalectryon-0 I have fixed all bug on my side and added all the need things in llama-cpp-python to my fork of it. You will find the fork here: https://github.com/Maximilian-Winter/llama-cpp-python
@microsoft-github-policy-service agree
@alxspiker I found a couple of problems with my implementation and are fixing them right now!
@alxspiker I have fixed all errors on my side but couldn't reproduce your error, but I added nmap to the settings!