关于demo.py的多显卡问题

[297297297]

请问如何实现如推理过程中给出的多显卡同时工作命令--nproc_per_node 2，我现在有俩块RTX4090，但运行demo.py显示显存不足，只有一块起了作用

[JThh]

Has the sequence parallelism been enabled? Kindly check if this line has set the enable_sequence_parallelism flag to True.

Otherwise, can you switch to smaller models, as illustrated here.

[github-actions[bot]]

This issue is stale because it has been open for 7 days with no activity.