VisionWu

ImportError: cannot import name 'BatchedKvCache' from 'punica'

2

Everything go well when I install punica from binary package. However, it shows "ImportError: cannot import name 'BatchedKvCache' from 'punica'" when I run "python -m benchmarks.bench_textgen_lora --system punica --batch-size 32"....