Yulong Wang

icon company @Microsoft icon location ONNX Runtime (Node.js, Web, WebGPU)

Results 218 comments of Yulong Wang

webgpu: optimize Gemm and MatMul using subgroup feature

could you please help to merge to latest main and push? The pipeline failures should be unrelated, and may be fixed by rerun.

[WebGPU] Register DataTransfer to Env

Please add override `CreateDataTransfer`: https://github.com/microsoft/onnxruntime/blob/c30905d638418383b8d83b3b1bb65b7b42226f5a/onnxruntime/core/session/plugin_ep/ep_factory_internal_impl.h#L56-L59 in class `WebGpuEpFactory` (file in https://github.com/Microsoft/onnxruntime/blob/main/onnxruntime/core/session/plugin_ep/ep_factory_webgpu.h) for the purpose of this change.

[Web] no available backend found. ERR: [wasm] RuntimeError: Aborted(CompileError: WebAssembly.instantiate(): expected magic word 00 61 73 6d, found 3c 21 44 4f @+0). Build with -sASSERTIONS for more info., [cpu] Error: previous call to 'initializeWebAssembly()' failed., [xnnpack] Error: previous call to 'initializeWebAssembly()' failed.

Looks like a similar issue to #19829 #19556 #11413. Please refer to https://github.com/microsoft/onnxruntime/issues/19829#issuecomment-1986524595 In short, make sure: - The .wasm files are correctly deployed - The .wasm files should be...

[WebGPU] `Error: [WebGPU] Kernel "[Mul] /head/istft/Mul_1" failed. Error: Failed to generate kernel's output[0] with dims [1,3520,3520]. If you are running with pre-allocated output, please make sure the output type/dims are correct. Error: 81415528.`

#22997 is submitted for fixing the shader bug in `Transpose`. However, it's quite suspicious that the input of a `Transpose` node is a 1D tensor. Not sure if it's because...

[WebGPU] `Error: [WebGPU] Kernel "[Mul] /head/istft/Mul_1" failed. Error: Failed to generate kernel's output[0] with dims [1,3520,3520]. If you are running with pre-allocated output, please make sure the output type/dims are correct. Error: 81415528.`

Reopen the issue. need further investigation.

[Web] warning about the use of eval in Vite

The only `eval` is introduced by dependency protobufjs: https://github.com/protobufjs/protobuf.js/blob/master/lib/inquire/index.js#L12

[Web] warning about the use of eval in Vite

We still need protobufjs if using WebGL. If using CPU only, you can import `onnxruntime-web/wasm` If using WebGPU, you can import `onnxruntime-web/webgpu` They both do not depend on protobufjs and...

[Web] warning about the use of eval in Vite

The "use of eval" warning will exist for a while until WebGL backend is eventually go out of lifetime and be replaced by WebGPU. The specific code that uses "eval"...