punica icon indicating copy to clipboard operation
punica copied to clipboard

Published 20 hours ago • verified publisher icon punica-ai

ImportError: cannot import name 'BatchedKvCache' from 'punica'

Open VisionwWu opened this issue 1 year ago • 2 comments

Everything go well when I install punica from binary package. However, it shows "ImportError: cannot import name 'BatchedKvCache' from 'punica'" when I run "python -m benchmarks.bench_textgen_lora --system punica --batch-size 32". How can I fix this?

VisionwWu avatar Jan 08 '24 03:01 VisionwWu