end-to-end_asr_pytorch
end-to-end_asr_pytorch copied to clipboard
eastonYi
不知道 您 试过 ctc_model 的 cer么?我跑了下cer 有四十多,我不知道是不是哪里有问题
Aishell么，greedy search也能到6以下
On Dec 7, 2021, at 4:52 PM, zzuczy @.@.>> wrote:
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/eastonYi/end-to-end_asr_pytorch/issues/8, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKX3J3P2OSPPNWV26D3UPXDOLANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
Aishell么，greedy search也能到6以下 On Dec 7, 2021, at 4:52 PM, zzuczy @.@.>> wrote: — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#8>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKX3J3P2OSPPNWV26D3UPXDOLANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
transformer + ctc 6以下 ? 比您在readme里写的其他更复杂的模型都高啊
https://github.com/by2101/OpenASR/tree/master/egs/aishell1/s5 这个transformer的实现也能到6%以下了，你要不试一下？ 我目前在用的transformer实现baseline能到5.6%，transformer-ctc性能稍差一点。
On Dec 7, 2021, at 5:00 PM, zzuczy @.@.>> wrote:
Aishell么，greedy search也能到6以下 On Dec 7, 2021, at 4:52 PM, zzuczy @.@.>> wrote: — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#8https://github.com/eastonYi/end-to-end_asr_pytorch/issues/8>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKX3J3P2OSPPNWV26D3UPXDOLANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
transformer + ctc 6以下 ? 比您在readme里写的其他更复杂的模型都高啊
— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/eastonYi/end-to-end_asr_pytorch/issues/8#issuecomment-987709488, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKWZQVDTVDZH7WR4O2DUPXEMHANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
https://github.com/by2101/OpenASR/tree/master/egs/aishell1/s5 这个transformer的实现也能到6%以下了，你要不试一下？ 我目前在用的transformer实现baseline能到5.6%，transformer-ctc性能稍差一点。 On Dec 7, 2021, at 5:00 PM, zzuczy @.@.>> wrote: Aishell么，greedy search也能到6以下 On Dec 7, 2021, at 4:52 PM, zzuczy @.@.>> wrote: — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#8<#8>>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKX3J3P2OSPPNWV26D3UPXDOLANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. transformer + ctc 6以下 ? 比您在readme里写的其他更复杂的模型都高啊 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#8 (comment)>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKWZQVDTVDZH7WR4O2DUPXEMHANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
好的,多谢多谢,我刚才也试了一下贪心,确实好很多很多,看来 是 beam search 有点问题。
不客气，有问题再交流
On Dec 7, 2021, at 5:14 PM, zzuczy @.@.>> wrote:
https://github.com/by2101/OpenASR/tree/master/egs/aishell1/s5 这个transformer的实现也能到6%以下了，你要不试一下？ 我目前在用的transformer实现baseline能到5.6%，transformer-ctc性能稍差一点。 On Dec 7, 2021, at 5:00 PM, zzuczy @.@.>> wrote: Aishell么，greedy search也能到6以下 On Dec 7, 2021, at 4:52 PM, zzuczy @.@.>> wrote: — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#8https://github.com/eastonYi/end-to-end_asr_pytorch/issues/8<#8https://github.com/eastonYi/end-to-end_asr_pytorch/issues/8>>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKX3J3P2OSPPNWV26D3UPXDOLANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. transformer + ctc 6以下 ? 比您在readme里写的其他更复杂的模型都高啊 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#8 (comment)https://github.com/eastonYi/end-to-end_asr_pytorch/issues/8#issuecomment-987709488>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKWZQVDTVDZH7WR4O2DUPXEMHANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
好的,多谢多谢,我刚才也试了一下贪心,确实好很多很多,看来 是 beam search 有点问题。
— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/eastonYi/end-to-end_asr_pytorch/issues/8#issuecomment-987720583, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEE7NKWMSW4IL7BC3JJGU73UPXF6JANCNFSM5JQVTR2A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
不客气，有问题再交流 On Dec 7, 2021, at 5:14 PM, zzuczy @.@.>> wrote:
有个现象，我不知道您有没有遇到过。现在用 transformer + ctc 跑结果没问题，但是 我想 在 transformer 前面加 conv 进行 降采样，变成 conv + transformer + ctc ,其实和您这里其中的一个实现很像，只不过没有 decoder 结构。但是这个加了conv 的结构之后，优化就会变得困难，比如我这里 step 1 loss 还是 11.444，step 101 loss 就直接 nan 了。 其实这个现象我遇到不止一次了，我之所以会在github上找transformer + ctc 的实现，就是之前我之前在 cnn + rnn + ctc 上 改了一个 conv + transformer + ctc，结果 conv + transformer + ctc 还没 cnn + rnn + ctc 好。给我的感觉就是 conv + transformer 优化有困难。但是按理说不应该，比如您这里的 conv + encoder + ctc + decoder 的结构，结果就挺正常的，所以这块我就很疑惑。
不客气，有问题再交流 On Dec 7, 2021, at 5:14 PM, zzuczy @.@.>> wrote:
我发现 conv + encoder + ctc + decoder + ce 这个结构，其中 ctc loss 的下降 （因为你的 code 里把 ctc 和 ce 都打印出来了），就没有 transformer + ctc 的 ctc loss 下降的快，而是和 conv + transformer + ctc 的表现一样，难道真的可以得出 conv + transformer 不好优化的结论？