TensorRT
TensorRT copied to clipboard
✨[Feature] Supporting Blackwell FP4
Is your feature request related to a problem? Please describe.
Support FP4 functionality on Blackwell using the ModelOpt workflow initially
Describe the solution you'd like
https://github.com/NVIDIA/TensorRT-Model-Optimizer/blob/7eecd11b0fde7a589b5568f17e19fb67c665730d/tests/torch/gpu/quantization/test_torch_export.py#L103 Support networks created with this workflow
Describe alternatives you've considered
Additional context
Waiting on https://github.com/pytorch/pytorch/pull/148791