qlora
qlora copied to clipboard
Enhance GPU `bfloat16` support check
This PR updates the existing code to check GPU support for bfloat16 using torch.cuda.is_bf16_supported() function, which returns a boolean value. This should provide a more robust approach than using torch.cuda.get_device_capability().