Jacob Myers

icon location PhD Student at Worcester Polytechnic Institute Quantum Physics Researcher and Aspiring Experimentalist

Results 1 issues of Jacob Myers

Very slow time to first token on ROCM

5 comment

## ❓ General Questions When using MLC LLM with ROCM on a Radeon 7900xtx I am noticing a very large time to first token. With context lengths around 4k I'm...

question