Jiyeon Ham
Results
2
comments of
Jiyeon Ham
We used 5e-4 learning rate for the DAE pre-training. We also did not reset the optimizer when we start the training step.
At the end of the pre-training, the validation loss reached 2.976. After the training, the validation loss reached 2.705.