mergekit icon indicating copy to clipboard operation
mergekit copied to clipboard

Make all Slerp operations use PyTorch rather than Numpy for simplicity

Open humzaiqbal opened this issue 10 months ago • 0 comments

Hi! I used the SLERP algorithm but noticed that it first converts all torch tensors to Numpy and then does the algorithm and converts everything back. Since people would presumably be loading checkpoints which are torch by default I figure it would be best to make the code default to torch. It also cleans up some of the code, like getting rid of the maybe_torch function. Let me know if this looks good to merge, if not happy to iterate!

humzaiqbal avatar Apr 08 '24 22:04 humzaiqbal