Librum-Server icon indicating copy to clipboard operation
Librum-Server copied to clipboard

Published 20 hours ago • verified publisher icon Librum-Reader

Self-Hosted AI Server support

Open aditya-shri opened this issue 1 year ago • 1 comments

Added support for using self hosted AI models. The self-hosted AI models should support OpenAI API calls.

aditya-shri avatar Feb 12 '24 15:02 aditya-shri

Most selfhosted api servers need model parameter in their requests, which differs from Openai model names. Hence, with current architecture, I cannot use any selfhosted server. One possible solution is to pass model parameter as an environment variables.

ilkersigirci avatar Apr 05 '24 12:04 ilkersigirci