I get Generate error, Error: WebGPU: cannot factorize big gridDim.x=104197 when I paste text into the box sometimes.

[itissid]

On an M1 Macbook Pro with 16GB running OS 13.1

[tqchen]

Thanks for reporting. This was originally due to webGPU's limitation of maxComputeWorkgroupsPerDimension so we spread the launch, we will find ways to fix this as newer version comes with more relaxed limits

[tqchen]

should be fixed by https://github.com/apache/tvm/pull/14674, we will update the model after v1 update

Thank you for reporting this

[jinhongyii]

We have updated to vicuna-v1, and the bug is fixed.