Tom Usher

Results 13 comments of Tom Usher

`llm` doesn't currently provide a way to request `n` results from an LLM. Potential to contribute upstream, or just work around that somehow.

For some context; The `ai_utils` module in `wagtail-vector-index` is now a more complete abstraction around AI providers like LiteLLM, providing async and streaming interfaces for supported backends. It would be...

Renamed, new goal is to consider how best to reuse code between these packages.