koila icon indicating copy to clipboard operation
koila copied to clipboard

is kolia support python3.6?

Open Yuruzu opened this issue 3 years ago • 5 comments

Yuruzu avatar Jan 15 '22 14:01 Yuruzu

Sorry, not yet. It doesn't even support python3.7 (#7) haha. We'll get there eventually 😊

rentruewang avatar Jan 15 '22 23:01 rentruewang

SO SAD

Yuruzu avatar Jan 16 '22 02:01 Yuruzu

Sorry, not yet. It doesn't even support python3.7 (#7) haha. We'll get there eventually 😊

hi, i try to use kolia in python3.8, but i miss trouble too. i follow the getting-started.py and use dgl package to train graph data, but i have the same RuntimeError: CUDA out of memory., can u give a more detailed example of dividing the training, validation, test data set? i should add the code (lazy_input, lazy_label) = lazy(input, label, batch=0) before or after dividing the dataset ? thanks a lot!

Yuruzu avatar Jan 17 '22 09:01 Yuruzu

Hi, thanks for the report!

Koila is a gradient accumulator, so what happens is that is automatically tries to split up the batches (in the background) in the case that there is OOM. However, it doesn't know how to handle "some" layers currently, so it has no effect on those layers. This is done silently in the background. Turns out that if a layer is not recognized by the framework, it doesn't prevent OOM.

As of right now, this project is in a re-write (see #18), which should've happened last month. But I just got a job at a company so currently the schedule is very messy. So I have to apologize for not having time to fix many existing bugs, which would be automatically fixed in a more modular design.

Thanks for reading!

rentruewang avatar Jan 17 '22 16:01 rentruewang

It's okay, looking forward to the next version

Yuruzu avatar Jan 25 '22 02:01 Yuruzu