RunningLeon

## Motivation Change to use device instead of device-type in cli ## Modification Please briefly describe what modification is made in this PR. ## BC-breaking (Optional) Does the modification introduce...

supported onnx opset version

1

## error log | 日志或报错信息 | ログ Hi, does onnx2ncnn support onnx with opset_version==13. For instance, [Squeeze-13](https://github.com/onnx/onnx/blob/main/docs/Changelog.md#Squeeze-13) takes `axes` as 2nd input. ## model | 模型 | モデル 1. original...

Feature Request: How to support model with dynamic inference graph

1

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

### Checklist - [X] 1. I have searched related issues but cannot get the expected help. - [X] 2. The bug has not been fixed in the latest version. -...

Launch multiple api servers for dp > 1

2

## Motivation Support launch multiple api servers for dp > 1 TODO: - [x] Update after https://github.com/InternLM/lmdeploy/pull/3523 ### Usage Example for two nodes with ep=16, dp=16 ### Step 1: Launch...

## Motivation https://github.com/InternLM/lmdeploy/issues/3501 ## Modification Please briefly describe what modification is made in this PR. ## BC-breaking (Optional) Does the modification introduce changes that break the backward-compatibility of the downstream...

## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this...