Thomas Vegas

re-added the leak suppression since we still see a leak detected, although all nvmlInit calls being matched with nvmlShutdown in codebase.

This will help in presence of intra-node communication, there is a graph in original description of PR #9194 showing performance gain for each rank count. For instance with >= 128...