inference
inference copied to clipboard
BUG: custom model's name must be related to model itself
Now, the model name is useful, e.g. for prompt template etc. If registering a custom model, e.g. chatglm3-6b with glm3, some random output will be output.