Medusa icon indicating copy to clipboard operation
Medusa copied to clipboard

Published 20 hours ago • verified publisher icon FasterDecoding

train medusa stage-2

Open smartliuhw opened this issue 10 months ago • 1 comments

how can i launch stage-2 training without using axolotl? can i just comment these lines in the train_code and save the whole model?

https://github.com/FasterDecoding/Medusa/blob/5e980538695096e7e372c1e27a6bcf142bfeab11/medusa/train/train_legacy.py#L346-L348

smartliuhw avatar Apr 06 '24 15:04 smartliuhw

and one more question. how can i obtain the medusa_choices during inference like the choices in this file? is it generated automatically or set manually? looking forward to your relay! @leeyeehoo @ctlllll

smartliuhw avatar Apr 07 '24 01:04 smartliuhw