audiocraft icon indicating copy to clipboard operation
audiocraft copied to clipboard

LoRAs possible for fast and lightweight fine-tuning?

Open oxysoft opened this issue 2 years ago • 5 comments

Just wondering if it will be feasible? Obviously the base model probably wasn't trained with any copyrighted music and probably won't recognize any band name I throw at it, so it will be very valuable. I could already foresee a huge library of LoRAs much like Stable Diffusion for every band imaginable - Pink Floyd crossed with Aphex Twin, anyone?

oxysoft avatar Jun 10 '23 01:06 oxysoft

you first have to figure out how to train

chavinlo avatar Jun 10 '23 03:06 chavinlo

I wonder if we could somehow generate more than 30 seconds

this model amazing

FurkanGozukara avatar Jun 10 '23 03:06 FurkanGozukara

I wonder if we could somehow generate more than 30 seconds

See:

  • https://github.com/facebookresearch/audiocraft/issues/8#issuecomment-1585740081
  • https://github.com/facebookresearch/audiocraft/issues/36#issuecomment-1586236702

0xdevalias avatar Jun 21 '23 02:06 0xdevalias

you first have to figure out how to train

  • https://github.com/facebookresearch/audiocraft#will-the-training-code-be-released\
    • Yes. We will soon release the training code for MusicGen and EnCodec.

0xdevalias avatar Jun 21 '23 02:06 0xdevalias

Any updates on this?

adamfils2 avatar Oct 04 '23 17:10 adamfils2