opik [OPIK-610] multi models support infrastructure

Details

This lays the ground for adding additional LLM provider integrations.

Issues

OPIK-610

Dec 24 '24 14:12 idoberko2

+1 to Andres's comment, there's still a lot that can be moved to a common ancestor class.

Dec 24 '24 16:12 amirzatcomet

Do you think it's still relevant to the latest version?

Dec 24 '24 16:12 idoberko2

what are the FE required changes for this?

Jan 06 '25 09:01 amirzatcomet

The changes are fully backwards compatible. The meaning is:

for openai, it will work as it works right now
for anthropic, the API structure is the same but the FE will need to be extended with an additional provider, models, etc.

Jan 06 '25 09:01 idoberko2

The changes are fully backwards compatible. The meaning is:

for openai, it will work as it works right now

for anthropic, the API structure is the same but the FE will need to be extended with an additional provider, models, etc.

Is there a FE ticket with the requirements? (you can get that from Jacques if you don't want to do it yourself, but might be faster to just write the ticket on your own).

Jan 06 '25 10:01 amirzatcomet

Yes, there's https://comet-ml.atlassian.net/browse/OPIK-688. @aadereiko already made an initial implementation mainly for my tests.

Jan 06 '25 11:01 idoberko2