instructor_ex
instructor_ex copied to clipboard
thmsmlr
Structured outputs for LLMs in Elixir
`LLamacpp` adapter uses the wrong config field to get the API url. To create a unit test around `LLamacpp.url/0` I made the function public. I've also added a `nil` case...
Hello! Is anyone working on adding Gemini support already? - API documentation: https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/gemini - Gemini 1.5 Pro seems to have support for function calling. - There seems to be two...
We are using Version `0.0.5` in our application. We recently got this error: ```elixir ** (FunctionClauseError) no function clause matching in Instructor.echo_response/1 (instructor 0.0.5) lib/instructor.ex:510: Instructor.echo_response(%{"choices" => [%{"finish_reason" => "stop",...
This is just a proposal, but basically I have a reasonably complex workflow that requires a lot of calls to the OAI API. Because of this, I'm running into rate...
One reason for wanting to use InstructorEx with Azure OpenAI is due to Azure's ability to deploy a model to a specific region to comply with data sovereignty regulations. This...
This PR would add two new params to `chat_completion`, namely `inspect_request?` and `inspect_response?` which has the effect of calling `IO.inspect` on the request, just before sending it to the LLM,...
When using this library to automate things, it's not great to have the process crash on errors that are to be expected, like HTTP errors. Any thoughts?
When running in `prod`, I'm getting different results than when running in `dev`. After digging, it seems that the @doc description from my schema is missing in prod. E.g. in...
In `:tools` mode, the JSON schema is included in the prompt twice: once in the system message, and again in the tool description. This PR ignores the system message for...