LLaDA icon indicating copy to clipboard operation
LLaDA copied to clipboard

Published 20 hours ago • verified publisher icon ML-GSAI

Could you let me know when the LLaDA 1B model will be released?

Open pdh930105 opened this issue 9 months ago • 3 comments

pdh930105 avatar Mar 24 '25 06:03 pdh930105

i was gonna ask this and see ur issue lol

pengzhangzhi avatar Mar 24 '25 17:03 pengzhangzhi

if 1b can't be released whats the reason:?

pengzhangzhi avatar Mar 24 '25 17:03 pengzhangzhi

Thanks for your interest!

We have an LLaDA model with 1 billion parameters, which has been trained on 400 billion tokens and there is no annealing stage. This is a semi-finished product that has not been fully trained and is only used for exploratory experiments. Therefore, we have no plan to open-source this model.

nieshenx avatar Apr 22 '25 11:04 nieshenx