meshed-memory-transformer icon indicating copy to clipboard operation
meshed-memory-transformer copied to clipboard

Published 20 hours ago • verified publisher icon aimagelab

Random output after several early epoch then start training

Open TrungThanhTran opened this issue 4 years ago • 0 comments

Hi @marcellacornia,

When I started my train, I got random outputs for about the first five epochs, I mean it generated words. Then, it produced nothing, and I had to train for several epochs to get good results. Do you have any idea? Because of initialization?

TrungThanhTran avatar Mar 25 '20 01:03 TrungThanhTran