jetson-containers icon indicating copy to clipboard operation
jetson-containers copied to clipboard

Published 20 hours ago • verified publisher icon dusty-nv

Unable to view benchmark results for minigpt4

Open lakshanthad opened this issue 8 months ago • 1 comments

Hello,

I am running JetPack 5.1.2 on an Orin NX 16GB device and following the page below to perform the minigpt4 benchmarks: https://github.com/dusty-nv/jetson-containers/tree/master/packages/llm/minigpt4

However, after the benchmarks is finished, I cannot find the minigpt4.csv file. What I am trying to find is to obtain the tokens/ second.

Best Regards, Lakshantha

lakshanthad avatar Nov 24 '23 07:11 lakshanthad

Hi @lakshanthad, did you run benchmark.py with --save /data/minigpt4.csv ? If you started the container with run.sh, it will automatically mount your jetson-containers/data directory to /data inside the container. Otherwise, specify a different path that you mounted inside the container, so you can view the CSV file outside.

dusty-nv avatar Nov 27 '23 00:11 dusty-nv