Aurick Qiao

Results 14 comments of Aurick Qiao

> We should add a test to ensure it's working correctly (loaded weights and outputs are the same as with the default loader) Sure, that makes sense. What's the spec...

@Yard1 added test, please take a look

> One question I have is that can this be implemented using safetensor's partial read? safetensors have all the metadata in headers so you can access the tensors partially Conceptually,...

> @aurickq curious how this relates to #3729? Ah, I hadn't seen that PR, thanks for bringing it up! From what I understand, both PRs address the problem of model...