YuXiangLin

Thanks for your response, I set weights of different tasks to be 1 and get better results ( I set the weight of loss about gaze to be 10 at...

The loss curve looks like:  The audio samples are as follows: https://huggingface.co/datasets/mozilla-foundation/common_voice_16_0/viewer/zh-TW The reconstructed audio sample: https://drive.google.com/file/d/1yk_xZL17FkhIYMjojesd-PHWyAKuqzSA/view?usp=sharing