TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

flux model engine_from_bytes(bytes_from_path(self.engine_path)) OutOfMemory

Open algorithmconquer opened this issue 1 year ago • 2 comments
trafficstars

from polygraphy.backend.trt import engine_from_bytes; when run engine_from_bytes(bytes_from_path(self.engine_path)) OutOfMemory on L40 with 1gpu with flux-dev,how to solve

algorithmconquer avatar Oct 17 '24 10:10 algorithmconquer