where are the discrete units weights from?

[thivux]

in the train.py file, you have an argument named --warmstart to allow "initialize[ing] from the fairseq HuBERT checkpoint". I wonder which checkpoint is it since fairseq offers a lot of HuBERT checkpoints.

[arjunbahuguna]

I believe it is the HuBERT Base (~95M params) model checkpoint, since that's what they use in the paper.