Videos with furigana/karaoke style subtitles

[jam-madrigal]

So, I followed the steps here and downloaded the subtitle files in srv3 format with yt-dlp, then converted them to .ass format with YTSubConverter. The English subs work great, whether i use the --visual option in command line or not, however, I can't seem to get subtitles with furigana to display properly. The furigana shows up like so

When It should look like this

Is there a way to correct this? Either by correcting the placement or even if that means removing the furigana if it comes down to it.

I'm working with this video https://youtu.be/HOmS6Kn0bn8