[BUG]: the speed of chinese data for chatgpt is very slow

[tnickMoxuan]

🐛 Describe the bug

the num of data is 10000 by debugging， i find the main reason is the line highlighted in red，but i do not konw why

Environment

No response

[ht-zhou]

Thank you for your feedback. It's slow here in fact, and it's one of our points to optimize soon.

[binmakeswell]

Hi @tnickMoxuan We have updated a lot. Please check the latest code. This issue was closed due to inactivity. Thanks.