Andy Dai

nvprof is deprecated

1

======== Warning: This version of nvprof doesn't support the underlying device, GPU profiling skipped ======== Warning: nvprof is not supported on devices with compute capability 8.0 and higher. So I...

Fixed typo in bash command.

[Bugfix] Fix order of arguments matters in config.yaml

20

FILL IN THE PR DESCRIPTION HERE FIX #8947 **BEFORE SUBMITTING, PLEASE READ THE CHECKLIST BELOW AND FILL IN THE DESCRIPTION ABOVE** --- PR Checklist (Click to Expand) Thank you for...

[Frontend][Misc] Goodput metric support

4

This PR adds support of goodput metric for benchmarking serving system. If the user doesn't specify `--goodput`, request goodput will not be shown. Supported service level objectives: `TTFT, TPOT, E2EL`...