vidur icon indicating copy to clipboard operation
vidur copied to clipboard
verified publisher icon microsoft

What are requirements for main.py from cpu_overhead

Open Dodon4 opened this issue 1 year ago • 0 comments

Found a cpu example and want to test this. It needs sarathi, but sarathi that I found haven't implementation for LLMEngine. What're requirements for cpu usage

Dodon4 avatar Jul 25 '24 10:07 Dodon4