crabml icon indicating copy to clipboard operation
crabml copied to clipboard

crabml.js

Open flaneur2020 opened this issue 1 year ago • 1 comments

crabML is WebGPU-native. we can consider wrapping a Node.js module over it, which compiles crabml into wasm, allows us run inference in a browser.

(currently we have not utilized WASM's SIMD instructions yet, and the WebGPU backend does not support quantization yet, but these features will come)

flaneur2020 avatar Mar 12 '24 09:03 flaneur2020

I plan to kickoff the project layout first.

Xuanwo avatar Mar 12 '24 09:03 Xuanwo