lagent
lagent copied to clipboard
May I know once I want to make a LLM by `BaseAPIModel`, where could I input the url_base?
I cannot find where can I input my url of my LLM on cloud. I should make one just like you do in GPTAPI
, shoudn't I?
So why this class
called BaseAPIModel?
class BaseAPIModel(BaseModel):
"""Base class for API model wrapper.
Args:
model_type (str): The type of model.
query_per_second (int): The maximum queries allowed per second
between two consecutive calls of the API. Defaults to 1.
retry (int): Number of retires if the API call fails. Defaults to 2.
meta_template (Dict, optional): The model's meta prompt
template if needed, in case the requirement of injecting or
wrapping of any meta instructions.
"""
pass