Simon comments

Results 6 comments of


                                            Simon

ADM infer代码的一些疑惑

👌有时间测试一下

Request for your unique_text_tokens.k2symbols

I forgot to upload and .k2symbols was covered by the new 24k generator .k2symbols...But I will release 24k checkpoints ASAP.

can you share some demo?

The current version's prosody is weird and I trying to fix it. Maybe I will train the better version and release the checkpoint this month.

Will the project be updated in the future?

Yes. But for now, I do not have enough GPU to train the new 24k version with a bigger dataset.

Don't see GE mentioned in the paper

GE was removed from the current version to test core MRTE's performance and I can't find the exact structure of GE. Maybe I will add to the newer 24k version...

Train-inference output mismatch when given alibi_slopes?

Alibi slope matrix will be calculated depending on cache_seqlens when calling flash_attn_with_kvcache and you put the first token. That is the point but I haven't seen the code of how...