gaopengff

**Environment:** 1. Framework: TensorFlow 2. Framework version: 2.12.0 3. Horovod version: 0.26.1 **Bug report:** The unit test case **_test/parallel/test_tensorflow.py::TensorFlowTests::test_horovod_allreduce_product_gpu_** will fail at datatype of **tf.float32** and **tf.float64** when launcher rank...