Alexei Baevski comments

Results 13 comments of


Alexei Baevski

Hydra error in fairseq-generate cli (task: translation_multi_simple_epoch)

why is the ddp_backend set to "simple" in that checkpoint? this is not one the values we support (we only support c10d and no_c10d). where did the checkpoint you are...

Hydra error in fairseq-generate cli (task: translation_multi_simple_epoch)

@shruti-bh do you know why ddp_backend is set to this value?

[data2vec] Loss goes down and up again

hey, if variances are jumping up and down, that looks like a collapse and you may want to lower you learning rate. i dont have variance plots for the nlp...

Data2Vec: error when loading own pretrained model

i think this looks reasonable, please submit a PR!

Const enum are preserved and not replaced with actual values

still a problem in any version > 0.17 it seems, including 1.1.1. const enums are supposed to be transpiled into their value, but instead are kept as is which causes...

Const enum are preserved and not replaced with actual values

Nope, putting that into tsconfig as below does not work. Tried both 1.1.1 and 0.19.1 "awesomeTypescriptLoaderOptions": { "forkChecker": true, "useBabel": true, "target": "es6", "disableFastEmit": false }, just to be clear...

Package manager console blocked after installing a package

Same here, it is really annoying. Also does not happen 100% of the time, but most of the time

The normalization settings of input audio

it wont have a much of an effect, but you have to match the feature extractor to the normalization setting normalize in dataloader -> layer norm in feature extractor no...

Wav2vec2 error after validation when training : terminate called after throwing an instance of 'c10::Error'

looks like some driver, cuda or pytorch problem, have you tried other versions? what if you run validate.py and point at your checkpoint? does it work if you train with...

Fix Torchscript typing in transformer_encoder.py

some tests are still failing