search_with_lepton icon indicating copy to clipboard operation
search_with_lepton copied to clipboard

Published 20 hours ago • verified publisher icon leptonai

lepton search client config gpt-4

Open mqd273 opened this issue 9 months ago • 2 comments

how we can config the gpt-4 model. using leaton search client

mqd273 avatar Apr 27 '24 03:04 mqd273

First apply the gpt api, and then modify it base_url=f"https://{self.model}.lepton.run/api/v1/", to base_url=f""https://api.openai.com/v1"
and change "LLM_MODEL": "mixtral-8x7b", the model name here

ng-fukgin avatar May 09 '24 06:05 ng-fukgin

啊，我英语不太好，就是你先申请gpt4 的api，然后修改这里的，改为base_url=f""https://api.openai.com/v1" 以及 这里的的 ""LLM_MODEL":mixtral-8x7b"

ng-fukgin avatar May 09 '24 06:05 ng-fukgin