Wayne

README里面的【Speedup of Transformer Inference】是哪个模型的，这边用里面的VIT用例测试的性能只有2.64倍？

4

导出模型：python3 export/huggingface/hf_vit_export.py 测试性能：python3 test/ls_vit.py 环境： V100服务器，torch1.10， python3.7.13，CUDA11.3 性能测试结果： =========lightseq========= lightseq generating... lightseq time: 0.005731139099225402s lightseq results (class predictions): [1] =========huggingface========= huggingface generating... huggingface time: 0.015130232088267803s huggingface results (class predictions): [1]