yolo-tensorrt icon indicating copy to clipboard operation
yolo-tensorrt copied to clipboard

insuficient memory error

Open sleepingsaint opened this issue 2 years ago • 0 comments

Error

I am trying to run the sample_detector.cpp application. It got compiled with no errors ( some are deprecated warnings ) but I think it got compiled properly. Now when I run the yolo-trt I get insufficient memory error.

WARNING: Requested amount of GPU memory (4294967296 bytes) could not be allocated. There may not be enough free memory for allocation to succeed.
WARNING: Skipping tactic 1 due to insuficient memory on requested size of 4294967296 detected for tactic 0.
Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize()

This is the error I am getting.

Solutions I tried

I tried adding setMaxWorkspaceSize as suggested in the error like below:

// filename : modules/yolo.cpp line 164:166
// setting max workspace size as 1 GB 
std::size_t MAX_WORKSPACE_SIZE = 1ULL << 30;
config->setMaxWorkspaceSize(MAX_WORKSPACE_SIZE);

Even adding this didn't resolve the issue. Still getting the error.

Could you please help me? Any where else to add the setMaxWorkspaceSize function or should I do any thing else?

PC Specs

Ubuntu 20.04 LTS 8 GB RAM Nvidia 940MX - 4 GB graphics card Tensorrt Docker container with opencv installed

Docker file I used

FROM nvcr.io/nvidia/tensorrt:22.02-py3
ARG DEBIAN_FRONTEND=noninteractive
RUN apt-get update && apt-get install --no-install-recommends -y libopencv-dev

Any help is appreciated. Thanks in advance :)

sleepingsaint avatar Feb 27 '22 12:02 sleepingsaint