Tianqi Chen comments

Results 637 comments of


                                            Tianqi Chen

[BUG] Find an error initializing the WebGPU device OperationError: D3D12

@aseok this is related to #21 , you can try to upgrade your browser to chrome 113(beta)

[BUG] Find an error initializing the WebGPU device OperationError: D3D12

@0dminnimda Unfortunately year the card's memory is not enough for this model, since we need ~ 6G , we will work on bringing more optimizations and smaller models

I get Generate error, Error: WebGPU: cannot factorize big gridDim.x=104197 when I paste text into the box sometimes.

Thanks for reporting. This was originally due to webGPU's limitation of maxComputeWorkgroupsPerDimension so we spread the launch, we will find ways to fix this as newer version comes with more...

I get Generate error, Error: WebGPU: cannot factorize big gridDim.x=104197 when I paste text into the box sometimes.

should be fixed by https://github.com/apache/tvm/pull/14674, we will update the model after v1 update Thank you for reporting this

crashed after installed on vivo x90 Pro [Bug]

Closing for now. Please check the latest apk

consider adding 6.9/12B/20B from h2oGPT project

Comparing to other models seems this model was less in demand, closing due to inactive issues, feel free to open new ones

Multi-GPU support for larger-than-VRAM models

thank you for your suggestion, yes we love to support the needs of the community and bring it in our roadmap

Multi-GPU support for larger-than-VRAM models

Multi gpu now lands in mlc

Better instruction needed

Thank you for your suggestions, we love to enable more users to DIY and will work on the instructions in the incoming weeks.

How do i use this in my own programs?

https://github.com/mlc-ai/mlc-llm/tree/main/python