Jakub Bartczuk

That's the question - maybe someone else would find this util helpful? Or should we roll this into `with dspy.context`? I was confused that `dspy.context` doesn't work this way.

I've tried this with two models and actually it's far from obvious how overwriting parameters should work. The problem is that for example ollama reloads a model on the server...

Hey @sgugger how did you prepare the models? Could you point us how to convert original .pth or .safetensors model to your format? Thanks! PS Awesome RWKV joined transformers!

Well without doing this, when I pulled the model from CLI, API was giving an error saying it doesn't exist.

The problem was that the model wasn't possible to use, even though it showed in models list. Basically everything was mentioned in the issue.

I've written [synchronous version](https://github.com/eth-sri/lmql/compare/main...lambdaofgod:lmql:synchronous_fastapi_server) (I had problems with making the queues work) that can be used to illustrate the point.

I'm having the same problem. @jkhenning what do you mean by webapp section?

Thanks man! One more question: I'm kinda new to writing Emacs packages, are there resources that you suggest to read about code style/conventions you'd prefer for this project? Like Google...

@rksm could you take a look at the llm package and describe how it could be used to replace `org-ai-openai.el`? I was trying to add Gemini support, but the currently...

That didn't help. BTW I tried it with mistral and it's wrong but in a different way ``` Prediction( answer='Answer: Four.' ) ``` I also tried with both "text" and...