Alexander

I have faced a similar problem. Tried to use the lib on heatmaps and pafs, produced by openpose_pytorch model. Used the topology for COCO in the same file(witch matches the...

@wyukai Can you share the code of your test inference? The difference may be coused by copying the image to the device. You might have noticed, that one must provide...

@wyukai Try to run something like this for your pytorch code: `def predict_by_batch_pip(batch_size, imgs, model): try: pred_list = [] imgs = torch.stack(imgs) s = time.time() with torch.no_grad(): img_per_bath = imgs...

Perhaps this gap between C++ vs Python TRT can be solved by providing proper optimization level to CMakeLists.txt. I have just pushed some modifications to CMakeLists.txt in master branch. I...

@wyukai Yes, i have. I have tested a few different compiler options that specify gpu architectures. Unfortunately i havent noticed any notable boost from it. I also spent some time...