tensorrt-utils
tensorrt-utils copied to clipboard
Change default opt profile behavior to be more like implicit batch
Instead of several profiles with min==opt==max, do profiles with some ranges of batch sizes to make it easier to migrate from an implicit batch workflow