FastSpeech2
FastSpeech2 copied to clipboard
M2voc training stuck?
Why does the training of M2voc keep stuck and there is no information output?
You may need to check your system log.
print('total_step', total_step)
for epoch in range(hp.epochs):
print('epoch ', epoch)
for i, batchs in enumerate(loader):
print('batchs ', i)
for j, data_of_batch in enumerate(batchs):
start_time = time.perf_counter()
print(f'batchs:{i}, samples:{j}')
The above code snippet is part of train.py, and print() is added for testing. The following is the log printed when nohup training:
total_step 27440000
epoch 0
Using cache found in /home/usrername/.cache/torch/hub/descriptinc_melgan-neurips_master
From the log, the training should be stuck in the position of the dataloader. Is this due to a network problem or a data problem?