mem0 icon indicating copy to clipboard operation
mem0 copied to clipboard

Allow LLMs other than GPT4 to be used for eval

Open taranjeet opened this issue 1 year ago • 4 comments

🚀 The feature

Right now eval is done using GPT4 model. Can we use any open source model to do the same?

Motivation, pitch

from slack user Bojan Jakimovski Screenshot 2024-02-01 at 7 40 58 PM

taranjeet avatar Feb 02 '24 03:02 taranjeet

@taranjeet @deshraj Can I start working on this and any idea which open-source model should we here first?

Dev-Khant avatar Mar 15 '24 14:03 Dev-Khant

Hi @deshraj @taranjeet Any update on this?

Dev-Khant avatar Mar 23 '24 02:03 Dev-Khant

Yes, feel free to work on it.

deshraj avatar Apr 16 '24 05:04 deshraj

Yes, feel free to work on it.

@deshraj I wanted to ask you which open-source model should we add first?

Dev-Khant avatar Apr 18 '24 09:04 Dev-Khant