DayDayupupupup

CUDA memory is not released after inference

5

## Branch/Tag/Commit Based on V5.3, and merged https://github.com/NVIDIA/FasterTransformer/commit/e2dd1641880840db76b8902b34106c85b026a0af to solve early_stop ## Docker Image Version Refer to fastertransformer_backend, build triton image triton_with_ft:22.12 ## GPU name A30 ## CUDA Driver 510.47.03...