[release/2.6][ROCm] Fix unit test: matmul_offline_mgpu_tunableop

[naromero77amd]

Fixes #SWDEV-525882

Total of four upstream cherry picks: https://github.com/pytorch/pytorch/pull/142274 https://github.com/pytorch/pytorch/pull/143172 https://github.com/pytorch/pytorch/pull/143322 https://github.com/pytorch/pytorch/pull/143507

[naromero77amd]

Might be able to preserve provenance by not doing the "squash" during the merge.

[rocm-repo-management-api[bot]]

Jenkins build for da19bad3e08726b0579d784a8b4b5bee17b8da72 commit finished as FAILURE Links: Blue Ocean view / Build artifacts

[pruthvistony]

UTs are passing when it was tested locally.