TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

✨[Feature] Supporting Blackwell FP4

Open narendasan opened this issue 9 months ago • 0 comments

Is your feature request related to a problem? Please describe.

Support FP4 functionality on Blackwell using the ModelOpt workflow initially

Describe the solution you'd like

https://github.com/NVIDIA/TensorRT-Model-Optimizer/blob/7eecd11b0fde7a589b5568f17e19fb67c665730d/tests/torch/gpu/quantization/test_torch_export.py#L103 Support networks created with this workflow

Describe alternatives you've considered

Additional context

Waiting on https://github.com/pytorch/pytorch/pull/148791

narendasan avatar Mar 11 '25 17:03 narendasan