🚀[FEA]: Multi-GPU CI

[mnabian]

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Medium

Please provide a clear description of problem you would like to solve.

Multi-GPU CI is needed for testing model parallel utilities.

Describe any alternatives you have considered

No response

Additional context

No response

[ktangsali]

Just an update on this issue, currently this can be handled via CI on the internal mirror. The team is looking into making this available on the public side.

[mnabian]

@ktangsali could you please provide an update for this issue?

[ktangsali]

This is implemented and functional now. Please run /multi-gpu-ci in comments to trigger multi GPU tests.