optillm Create a gradio based GUI to compare different approaches

Initially brought up in #8 having a GUI would make it easier to visualize and compare different approaches.

Sep 17 '24 07:09 codelion

Hi @codelion I liked this project very much and want to work on this issue. I will be grateful for any specific guidance from your side.

Dec 23 '24 17:12 AdityaPandeyCN

Hi @AdityaPandeyCN for the UI we can have a simple chat-like interface that connects with the optillm proxy and allows users to choose the approaches and try out queries. Something similar to https://huggingface.co/spaces/codelion/optillm

Dec 24 '24 04:12 codelion

Hey @codelion This looks good I am thinking about why the approach similar to huggingface spaces was not used where we introduce an app.py for GUI separately. I was working on this similar to that.

Jan 08 '25 09:01 AdityaPandeyCN

You can still continue working on that and we will add that in when ready. I just added this today since I saw -https://www.gradio.app/guides/creating-a-chatbot-fast#quickly-loading-from-ollama-or-any-open-ai-api-compatible-endpoint with the new release of gradio. As it was a single line change I added it to the optillm.py file itself.

Jan 08 '25 10:01 codelion