Dilshod Tadjibaev
Dilshod Tadjibaev
CC: @laggui @nathanielsimard @louisfd @wingertge I submitted a PR to recreate the issue.
CC @laggui
@laggui, safetensors team didn't want to change API to use more stable data type BtreeMap instead of HashMap by HashBrown. Instead they suggested to use safetensors exported hashbrown lib: https://github.com/huggingface/safetensors/pull/656#issuecomment-3378585043...
> I've already been looking into this issue. One thing I've been trying to do is using a zero copy recorder as a start. I am still working on that...
Also I'll be working on an updated file format that allows streamable loading using burn-store.
@BjornTheProgrammer yes, I think going into the new direction (using ModuleStore) would more sense. Btw, your PR wasn't a waste, it helped me realize we need a better way to...
CCing @ArthurBrussee, this might be useful for you when loading WASM. Comments/inputs are appreciated.
> [[@antimora](https://github.com/antimora)](https://github.com/antimora) Just following up on this since I can assign a developer to begin working on implementing the ONNX nodes to Burn safetensor converter. Would this be something you're...
CC @laggui
CC @wingertge