Sergey

The change allows to increase performance in multi-thread environment.

2

In this case data locality is improved and it may have positive effect to final inference in case of MT execution. Thanks for contributing to TVM! Please refer to guideline...

[Runtime][MemoryPool] Memory pool with limited cache size

2

The commit contains new memory manager which limits amount of cached buffers. The problem appeared on scenario with 4 sequential transformer based networks which generate output with different sizes on...