ragas
ragas copied to clipboard
[Question] How to change custom mode name
[ ] I checked the documentation and related resources and couldn't find an answer to my question.
** How do I specify the name of the model** An LLM is deployed locally. All interfaces are the same as openai, but the mode name is different
Code Examples
Now I can do this in the following way to change key and url
os.environ['OPENAI_API_KEY'] ="xxxx" os.environ['OPENAI_API_BASE'] = "xxxx"
But after that, when I run simple code:
data_samples = { 'question': [ 'When did Einstein born?', 'Where did Einstein born?', ], 'answer': [ 'Einstein was born in 1879.', 'Einstein was born in Germany.', #'Einstein was born in 1879 in Germany.' ], 'ground_truth': [ 'Einstein was born in 1879 in Germany.', 'Einstein was born in 1879 in Germany.', ] } dataset = Dataset.from_dict(data_samples) score = evaluate(dataset, metrics=[answer_correctness]) print( score.to_pandas() )
it's shows: openai.NotFoundError: Error code: 404 - {'error': {'message': "model 'gpt-3.5-turbo' not found, try pulling it first", 'type': 'api_error', 'param': None, 'code': None}}