med-seg-diff-pytorch icon indicating copy to clipboard operation
med-seg-diff-pytorch copied to clipboard

Adding training scripts

Open isamu-isozaki opened this issue 2 years ago • 23 comments

Hi! Thanks for the code! My friend and I are making a training script using this dataset

isamu-isozaki avatar Jan 31 '23 16:01 isamu-isozaki

Will make a pr if you want!

isamu-isozaki avatar Jan 31 '23 16:01 isamu-isozaki

sure, thank you!

lucidrains avatar Feb 02 '23 08:02 lucidrains

@isamu-isozaki highly recommend the huggingface accelerate library

lucidrains avatar Feb 02 '23 17:02 lucidrains

@lucidrains Sounds good! Quite a fan of it already. We are mostly done with the script but will integrate accelerate and open a pr

isamu-isozaki avatar Feb 02 '23 17:02 isamu-isozaki

:pray: :rocket:

lucidrains avatar Feb 02 '23 18:02 lucidrains

Hi! Thanks for the code! My friend and I are making a training script using this dataset

Thank you very much for your contribution and look forward to your code!

Time9Y avatar Feb 12 '23 07:02 Time9Y

Thanks for the code, I tried to add the training code but the result was not satisfactory.

Time9Y avatar Feb 12 '23 07:02 Time9Y

@Time9Y yup my friend and I are having trouble getting good results too. It kinda works on 64x64 resolution but on 128 it just breaks. I'll try checking the paper for their params

isamu-isozaki avatar Feb 12 '23 13:02 isamu-isozaki

oh this is disappointing

could i have made an error?

they released a public official repository btw

lucidrains avatar Feb 13 '23 20:02 lucidrains

@lucidrains Haha no most likely we screwed up a bit. And sounds good! Will check that out. I'll add our script as a pr in a bit. Just cleaning up since it's a bit messy but maybe we can get your opinion too!

isamu-isozaki avatar Feb 14 '23 02:02 isamu-isozaki

@lucidrains This should be my problem, the code you provided is clean and efficient.

Time9Y avatar Feb 14 '23 11:02 Time9Y

@isamu-isozaki I've seen the code you submitted and it's so cool. Hope I can use it soon!

Time9Y avatar Feb 14 '23 12:02 Time9Y

@Time9Y Thank you! Will let you know when finished

isamu-isozaki avatar Feb 14 '23 22:02 isamu-isozaki

@isamu-isozaki I've received the code, it's awesome! During training process, how many iterations did you get good results after.

Time9Y avatar Feb 15 '23 06:02 Time9Y

@Time9Y Thanks! For 64x64 around 10 epochs gave me not-too-terrible results. Self-condition is pretty interesting too. Honestly, looking forward to hearing from you if u get good results!

isamu-isozaki avatar Feb 15 '23 13:02 isamu-isozaki

@isamu-isozaki Amazing, I achieved great results in 50 iterations, thanks for your contribution! This code will help our research progress.

Time9Y avatar Feb 16 '23 03:02 Time9Y

@Time9Y Oh awesome! Glad it helped. What parameters did you guys use out of curiosity?

isamu-isozaki avatar Feb 16 '23 04:02 isamu-isozaki

@isamu-isozaki The parameters are basically similar to yours, while referring to this code. https://github.com/WuJunde/MedSegDiff lr 1e-4 eopch 150 batch_size 4 UNet (1, 2, 3, 4) not use ddim

Time9Y avatar Feb 16 '23 04:02 Time9Y

@Time9Y Thanks! My friend will appreciate that a lot

isamu-isozaki avatar Feb 16 '23 05:02 isamu-isozaki

@isamu-isozaki Amazing, I achieved great results in 50 iterations, thanks for your contribution! This code will help our research progress.

great to hear! :pray:

@isamu-isozaki thank you so much for taking the time to contribute the training script!

lucidrains avatar Feb 16 '23 16:02 lucidrains

@lucidrains Np! I wanted to contribute later to your muse repo so this was a bit of a practice run. And also, @dsbuddy helped a lot.

isamu-isozaki avatar Feb 16 '23 19:02 isamu-isozaki

@lucidrains Sry, found a slight bug in training but made pr to fix it!

isamu-isozaki avatar Feb 16 '23 19:02 isamu-isozaki

@dsbuddy thank you Daniel :100: !

lucidrains avatar Feb 16 '23 22:02 lucidrains