xbotter

Three years have passed, is there a solution?

I am currently working on the maintenance of LLamaSharp.SemanticKernel. If possible, I would be willing to do it.

@JeffreySu Please review it and let me know if there is anything that needs to be changed.

> Is it possible to integrate with SK Planner. Let’s say, BotSharp’s Router can use 3rd Planner for reasoning if user wants to. We know currently BotSharp has a feedback...

The interfaces of Semantic Kernel are usually oriented towards OpenAI's API, so the ChatCompletion interfaces are stateless. This is indeed a challenge for locally deployed models. This seems inevitable for...

The new version of the semantic kernel has added some breaking change, and the latest package has been updated in the PR #306

> I also notice that there is no way to add grammar to this right now so AskAsync can't force good output of JSON as an example. Can this be...

> On the first issue I was able to take your code, and manually add a grammar to it. Is there a way that we can just expose Grammar in...

> @xbotter I think we should watch the prompt put into our model in the second run with context size reduced to 4096. Could you please take a look? I'm...

The llama.cpp has been enhanced to support the BERT model, allowing the use of BERT embedding models. https://github.com/ggerganov/llama.cpp/pull/5423