nebuly icon indicating copy to clipboard operation
nebuly copied to clipboard

[Speedster] `optimize_model` function transfers the original model from the GPU to the CPU

Open mfumanelli opened this issue 1 year ago • 6 comments

Problem

The optimize_model function transfers the original model from the GPU to the CPU:

image

Desired Behavior

Maintaining the model on the initial device.

mfumanelli avatar Mar 17 '23 10:03 mfumanelli

I can try to work on this @mfumanelli! 🌈

LuigiCerone avatar Mar 17 '23 17:03 LuigiCerone

I can try to work on this @mfumanelli! 🌈

mfumanelli avatar Mar 17 '23 17:03 mfumanelli

Hello @LuigiCerone, I see there was no PR related to this issue in the previous months, are you still planning to work on this? If not can I tackle this issue @mfumanelli?

youssefadr avatar Aug 11 '23 09:08 youssefadr

Hello @youssefadr, go for it! Thanks :)

LuigiCerone avatar Aug 21 '23 10:08 LuigiCerone

Great, I'll make a PR soon!

youssefadr avatar Sep 03 '23 14:09 youssefadr

I am working on it and debugging to evaluate where the bug comes from, if someone has already worked on it and has more insights, I'll be happy to listen!

youssefadr avatar Oct 08 '23 18:10 youssefadr