Junki Ohmura

@oneTaken In the keras model you have, what is the number of epochs? I am interested in learning rate. (accuracy vs epochs)

Now accuracy on training set may be over 6,70%. But this is overfitted. In test set, accuracy is under 20%. So still some problems exist.

@oneTaken Thank you. This is helpful! I list up some points I have to clarify. But If you can compare these with the keras model, the information will be really...

@oneTaken Thank you again! And I noticed my LSTMs assume `batch_first=True`. But I didn't set it! Now I'm checking this. > batch_first – If True, then the input and output...

After 30 epochs, test acc was 40% in following settings - p1 only - use log_softmax and NLLLoss - no EMA for variables

Hi @aneesh-joshi Thank you for your feedback. Unfortunately, I could not have enough time to fix my model. As DongjunLee suggested, the following may help. If you can find some...

@wlhgtc Thank you for your report. I am not sure about this. But `cuda out of memory` is exactly the problem of your GPU memory. Is your GPU memory sufficient?...

I also faced this problem. Just pass `channel_id=None` is fine if you use mono or stereo audios. https://github.com/facebookresearch/fairseq/blob/34973a94d09ecc12092a5ecc8afece5e536b7692/examples/textless_nlp/gslm/speech2unit/pretrained/hubert_feature_reader.py#L34C46-L34C56

Hi @nateanl Oh, I didn't know that. I will follow the issue. Thanks!