TransformerEngine
TransformerEngine copied to clipboard
Is 4090D compatible with FP8
I am planning to buy a 4090D for FP8 experiments, but I am not sure if it can use the FP8 in transformer engine
Hello @chengqihao. Yes, 4090D is compatible with FP8.