[ROCm] Make multi gpu tests exclusive if executed locally
๐ Summary of Changes Make multigpu tests being executed exclusively.
๐ฏ Justification Multigpu tests have to run exclusively to not clash the utilization of gpus in parallel. This PR marks multigpu tests as such by adding 'multi_gpu' tag, and in case of rocm make them run exclusively if executed locally.
๐ Kind of Contribution Please remove what does not apply: โป๏ธ Cleanup
๐ Benchmark (for Performance Improvements) Not relevant, no logic change
๐งช Unit Tests: Not relevant, no logic change
๐งช Execution Tests: Not relevant, no logic change
@beckerhe had a comment on that. It seems that xla_cc_tests are not really gpu tests but cpu only tests. I will have to remove the tag and adjust accordingly!
@xla-rotation please check this PR