[Feature] multi-nodes surpport

[hezeli123]

Motivation

70B models or more larger modes should be deployed by multi-nodes( A30/L40s ...). Multi-nodes surpport will be appreciate.

Related resources

No response

Additional context

No response

[lvhan028]

Sorry, pipline parallelism has a very low priority in lmdeploy. I will put this feature in our backlog.

Is it possible to use lmdeploy's tensor parallelism?

[github-actions[bot]]

This issue is marked as stale because it has been marked as invalid or awaiting response for 7 days without any further response. It will be closed in 5 days if the stale label is not removed or if there is no further response.

[github-actions[bot]]

This issue is closed because it has been stale for 5 days. Please open a new issue if you have similar issues or you have any new updates now.