tvm
tvm copied to clipboard
[Bug] Failed to build I-ViT
Steps to reproduce the behavior:
git clone https://github.com/zkkli/I-ViT.git
Just follow the TVM_benchmark.
One or more operators have not been tuned. Please tune your model for better performance. Use DEBUG logging level to see more details.
Traceback (most recent call last):
File "D:/TVM/I-ViT/TVM_benchmark/evaluate_accuracy.py", line 97, in
tvm.version :0.15.dev0
Platform: LAPTOP
Operating system: Windows
Device: PC+RTX 3070
Python version: 3.8
GPU driver version (if applicable):12.0
CUDA/cuDNN version (if applicable):12.0
I have the same problem as you, but the difference is that: When I use Ansor tuning vit_b_32.onnx, the tvm.auto_scheduler.extract_tasks is crushed. I print some messages in tvm.auto_scheduler.relay_integration.auto_schedule_topi:
This information shows that the problem seems to occur when fusing
layout_transform, reshape_transpose and concatenate_add.
Maybe the underlying reason for the problem you encountered is also this.
@Yanhan-cmd @Jocx-H
I have also been testing I-VIT recently, and you can switch the TVM version to v0.9.0. However, I found that its speed is far from as fast as claimed in the paper, and FasterTransformer is not as slow as the paper suggests