wohenniubi issues

Repositories
Issues
Comments

Results 2 issues of


                                            wohenniubi

NVIDIA RuntimeError: FP8 weight is not found in dir /work/build/models/bert/fp8/faster-transformer-bert-fp8-weights-scales

- To reproduce the problem After modifying use_fp8 from False to **True** as follow: ``` @ConfigRegistry.register(HarnessType.Custom, AccuracyTarget.k_99, PowerSetting.MaxP) class H100_PCIE_80GB_CUSTOM(OfflineGPUBaseConfig): system = KnownSystem.H100_PCIe_80GB_Custom # Applicable fields for this benchmark are...

NVIDIA make generate_engines Error Code 4: Internal Error Network has dynamic or shape inputs

- Run generate_engines cmd `make generate_engines RUN_ARGS="--benchmarks=bert --scenarios=offline"` will lead to the error `Error Code 4: Internal Error (Network has dynamic or shape inputs, but no optimization profile has been...