CosyVoice
CosyVoice copied to clipboard
[Question] Add new emotion tags
@aluminumbox Hello. I wanted to add new emotion tags such as: "[surprise yelp]", "[heavy breathing]", "[excited whoop]" etc.
When I checked I found out that tokenizer has: 151663 tokens, but the LLM("Qwen2ForCausalLM") vocabulary size is 151936
What I did:
- I added special tokens, and tokenizer length become 151993
- Resized the token embeddings (model.llm.model.resize_token_embeddings(151993))
- Finetuned the model
- Updated CosyVoice2-0.5B model with finetuned llm.pt and flow.pt
- Called inference. But those emotion tags was not created. They were just silence.
I tried with 1000 samples, but it does not learn.
This issue is stale because it has been open for 30 days with no activity.
This issue was closed because it has been inactive for 14 days since being marked as stale.