lagent icon indicating copy to clipboard operation
lagent copied to clipboard

May I know once I want to make a LLM by `BaseAPIModel`, where could I input the url_base?

Open ZhaoCake opened this issue 4 months ago • 6 comments

I cannot find where can I input my url of my LLM on cloud. I should make one just like you do in GPTAPI, shoudn't I? So why this class called BaseAPIModel?

class BaseAPIModel(BaseModel):
    """Base class for API model wrapper.

    Args:
        model_type (str): The type of model.
        query_per_second (int): The maximum queries allowed per second
            between two consecutive calls of the API. Defaults to 1.
        retry (int): Number of retires if the API call fails. Defaults to 2.
        meta_template (Dict, optional): The model's meta prompt
            template if needed, in case the requirement of injecting or
            wrapping of any meta instructions.
    """
    pass

ZhaoCake avatar Feb 21 '24 07:02 ZhaoCake