web-llm

web-llm copied to clipboard

Model Version: [vicuna-7b-v1.1] GPU: GTX 1060 6G Mobile, System: Ubuntu 22.04 LTS, browser: Chrome 114.0.5720.4 dev | Edge 114.0.1793.0, Laptop: Alienware 13 R3 16G i7-7700HQ CPU @ 2.80GHz × 8 browser features: #enable-vulkan #enable-unsafe-webgpu #enable-webgpu-developer-features

The old verson [vicuna-7b-v0] can't detect Nvidia GPU, [vicuna-7b-v1.1] seems to detect it but crashed while running.

Browser console error:

vkAllocateMemory failed with VK_ERROR_OUT_OF_DEVICE_MEMORY at CheckVkOOMThenSuccessImpl (..<URL>) at AllocateResourceHeap (..<URL>) at AllocateResourceHeap (..<URL>) at Allocate (..<URL>) at Allocate (..<URL>) at Initialize (..<URL>) at Create (..<URL>) at CreateBuffer (..<URL>)

5[Invalid Buffer] is invalid.

• While validating entries[0] as a Buffer. Expected entry layout: { binding: 0, visibility: ShaderStage::Compute, buffer: { type: BufferBindingType::Storage, hasDynamicOffset: 0, minBindingSize: 0 } }
• While validating [BindGroupDescriptor] against [BindGroupLayout]
• While calling [Device].CreateBindGroup([BindGroupDescriptor]).

8[Invalid BindGroup] is invalid.

• While encoding [ComputePassEncoder].SetBindGroup(0, [Invalid BindGroup], 0, ...).

12[Invalid CommandBuffer] is invalid. at ValidateObject (..<URL>) at ValidateSubmit (..<URL>)

mlc.ai/:1 [Invalid Buffer] is invalid.

• While encoding [CommandEncoder].CopyBufferToBuffer([Buffer], 0, [Invalid Buffer], 0, 16384).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While encoding [CommandEncoder].CopyBufferToBuffer([Invalid Buffer], 0, [Invalid Buffer], 0, 720896).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While encoding [CommandEncoder].CopyBufferToBuffer([Buffer], 0, [Invalid Buffer], 0, 16384).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While encoding [CommandEncoder].CopyBufferToBuffer([Buffer], 0, [Invalid Buffer], 0, 720896).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While validating entries[1] as a Buffer. Expected entry layout: { binding: 1, visibility: ShaderStage::Compute, buffer: { type: BufferBindingType::ReadOnlyStorage, hasDynamicOffset: 0, minBindingSize: 0 } }
• While validating [BindGroupDescriptor] against [BindGroupLayout]
• While calling [Device].CreateBindGroup([BindGroupDescriptor]).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While validating entries[1] as a Buffer. Expected entry layout: { binding: 1, visibility: ShaderStage::Compute, buffer: { type: BufferBindingType::ReadOnlyStorage, hasDynamicOffset: 0, minBindingSize: 0 } }
• While validating [BindGroupDescriptor] against [BindGroupLayout]
• While calling [Device].CreateBindGroup([BindGroupDescriptor]).

mlc.ai/:1 [Invalid Buffer] is invalid.

• While validating entries[1] as a Buffer. Expected entry layout: { binding: 1, visibility: ShaderStage::Compute, buffer: { type: BufferBindingType::ReadOnlyStorage, hasDynamicOffset: 0, minBindingSize: 0 } }
• While validating [BindGroupDescriptor] against [BindGroupLayout]
• While calling [Device].CreateBindGroup([BindGroupDescriptor]).

mlc.ai/:1 GPU connection lost llm_chat.js:626 undefined mlc.ai/:1 Uncaught (in promise) DOMException: Device is lost