Junbang Liang

icon indicating a website link https://junbangliang.github.io/

icon company Columbia University icon location New York icon location Master's Student in Computer Science at Columbia University

Results 3 comments of Junbang Liang

Inference time is slower than expected

With the gpu synchronization implemented, the script now gives the following inference time. Is there a way to speed up the inference for a large amount of images? ``` GPU...

Inference time is slower than expected

@kishore-greddy Yes I did try 512x512 resolution. The inference speed is still over 100ms.

Inference time is slower than expected

@kishore-greddy Now I tried it on another A100 machine and now I can get down to 70ms, results vary between machines but still not close to numbers reported from the...