SafeCool

Results 2 comments of SafeCool

The LLM I deployed myself, such as Qwen, is in the form of an openai interface. How should I evaluate the effectiveness of this model? Why didn't I find it in the documentation and can only use GPT?

> Hi [@SafeCool](https://github.com/SafeCool) ! Thanks for your question. > > You can absolutely evaluate your own LLMs, such as Qwen, using the OpenAI-compatible API in Opik! While the documentation often...

The LLM I deployed myself, such as Qwen, is in the form of an openai interface. How should I evaluate the effectiveness of this model? Why didn't I find it in the documentation and can only use GPT?

> Thanks for sharing the code! > > The issue might be that you're initializing the `Hallucination` metric without explicitly setting the LLM, so by default, it uses `OpenAI GPT-4o/3.5-turbo`...