async-openai icon indicating copy to clipboard operation
async-openai copied to clipboard

Ollama AI Chat Completion Example / OpenAI Compatibility

Open 64bit opened this issue 1 year ago • 3 comments

Given that officially Chat completion API is compatibale - this library should work without any changes. Hence it would be great to have a fully self contained example which works with local ollama using this crate

https://ollama.com/blog/openai-compatibility

64bit avatar Feb 10 '24 00:02 64bit

This would be great, is it just a matter of switching the endpoint?

jacksongoode avatar Mar 02 '24 09:03 jacksongoode

I do not know :) hence this example calls for self contained - so that it works out of the box and answer(s) the question(s) like that :)

64bit avatar Mar 02 '24 20:03 64bit

I'll give it a shot!

jacksongoode avatar Mar 04 '24 05:03 jacksongoode