vall-e icon indicating copy to clipboard operation
vall-e copied to clipboard

Training on a custom dataset

Open korakoe opened this issue 1 year ago • 3 comments

Hello, I was reading the training instructions (and the prepare dataset scripts) and I don't understand how you'd create and use custom datasets with this model.

korakoe avatar Apr 14 '23 05:04 korakoe

@korakoe

you can skip lhotse download and lhotse prepare, but you must prepare the lhoste manifests files like https://github.com/lhotse-speech/lhotse/blob/master/lhotse/recipes/libritts.py#L84

more examples: https://github.com/lhotse-speech/lhotse/tree/master/lhotse/recipes

lifeiteng avatar Apr 14 '23 07:04 lifeiteng

@lifeiteng this was very much helpfull. Thanks for it!!

debasishaimonk avatar May 27 '23 07:05 debasishaimonk

Is this used for transcribing? You can just use whisper to transcribe most languages. Then convert it into hdf5 file and texts and feed it via dynamic batch samppler

constan1 avatar Oct 19 '23 21:10 constan1