Andrei Catalin Coman

icon indicating a website link https://andreiccoman.github.io

icon location Martigny, Switzerland icon location Research Assistant at Idiap Research Institute | PhD Student at École polytechnique fédérale de Lausanne

Results 1 comments of Andrei Catalin Coman

Add a warning when some of the modules are in eval mode before the training stage

Hello, thanks @mszulc913 for bringing this up. It seems like when loading a `huggingface` model using `from_pretrained`, it defaults its `training` state to `False` during the `training_step`. That's indeed not...