MemoNet icon indicating copy to clipboard operation
MemoNet copied to clipboard

Published 20 hours ago • verified publisher icon MediaBrain-SJTU

Slow inference time

Open ahndroo opened this issue 9 months ago • 0 comments

When running the model on my RTX6000 ADA, the inference time is near 200ms for a batch of 1. What would cause such a large deviation from the reported 55ms on an RTX3090?

ahndroo avatar May 23 '24 14:05 ahndroo