Shipping builds crashing when a TTS function is called

[lucoiso]

[ocinon]

@lucois: sorry, just to clarify, I was using TTS not STT in my test.

[lucoiso]

@lucois: sorry, just to clarify, I was using TTS not STT in my test.

oops! xD

[lucoiso]

@ocinon I can replicate this issue in UE5.1 but isn't occurring in UE4.27.

When I package the project using UE5.1, it generates a Symbols folder containing only libUnreal.so, but UE4.27 packaging occurs exactly as UE5.1 in Development or DebugGame mode and the application works without crashes. lol

It looks like they introduced a bug in the Engine related to third party linkages in Android builds, but I need to confirm.

I'll continue looking for a solution and will also report this behavior in Unreal's Bug Submission.

[ocinon]

@lucoiso thanks for looking into it. Let me know if there is any help you need.

[Yak0vkaSup]

I have got a same bug actually, TTS crash the engine

Unhandled Exception: 0xc06d007e

KERNELBASE UnrealEditor_AzSpeech!__delayLoadHelper2() [D:\a_work\1\s\src\vctools\delayimp\delayhlp.cpp:312] UnrealEditor_AzSpeech!_tailMerge_microsoft_cognitiveservices_speech_core_dll() UnrealEditor_AzSpeech!UAzSpeechAudioDataSynthesisBase::StartAzureTaskWork() [D:\build\U5M-Marketplace\Sync\LocalBuilds\PluginTemp\HostProject\Plugins\AzSpeech\Source\AzSpeech\Private\AzSpeech\Tasks\Bases\AzSpeechAudioDataSynthesisBase.cpp:19] UnrealEditor_AzSpeech!UAzSpeechTaskBase::Activate() [D:\build\U5M-Marketplace\Sync\LocalBuilds\PluginTemp\HostProject\Plugins\AzSpeech\Source\AzSpeech\Private\AzSpeech\Tasks\Bases\AzSpeechTaskBase.cpp:24]

[lucoiso]

Hello! @Yak0vkaSup : )

Can you enable the option "Enable Internal Logs" in Project Settings -> Plugins -> AzSpeech and send me the output log?

The logs will be printed in the Output Log inside the engine and also in the file located at PROJECT_FOLDER/Saved/Logs

And can you send me the SDK logs? You can enable in the same settings page with the option "Enable SDK Logs" and find it inside: PROJECT_FOLDER/Saved/Logs/AzSpeech

[Yak0vkaSup]

Hey Lucoiso, here it is cef3.log and i dont have AzSpeech folder/file

and here is crash logs

[Yak0vkaSup]

[lucoiso]

@Yak0vkaSup 😯 Can you try the ver. v1.3.8? https://github.com/lucoiso/UEAzSpeech/releases/tag/v1.3.8

[Yak0vkaSup]

[lucoiso]

@Yak0vkaSup can you send the last log?

[Yak0vkaSup]

RPM_studio.log

[Yak0vkaSup]

and this one also RPM_studio.log

[Yak0vkaSup]

thank you in advance!

[lucoiso]

@Yak0vkaSup

Do you have Visual Studio w/ C++ modules and .NET installed? For some reason the plugin appears not to have compiled and the engine cannot load it. (looking the v1.3.8 log)

[Yak0vkaSup]

Maybe I need to reinstall .net SDK, I will try it, thank you

[Yak0vkaSup]

Your are my hero! thank you very much! Good luck!

[lucoiso]

Glad the problem was resolved! Any problems, you can get in touch! :) I'll take a look at this Marketplace v1.3.7 issue, thanks for letting me know!

Now I'm trying to resolve a packaging issue for HoloLens, due to some changes Epic made in UE5.0 and UE5.1 😵‍💫

[Yak0vkaSup]

Glad the problem was resolved! Any problems, you can get in touch! :) I'll take a look at this Marketplace v1.3.7 issue, thanks for letting me know!

Now I'm trying to resolve a packaging issue for HoloLens, due to some changes Epic made in UE5.0 and UE5.1 😵‍💫

Sounds great. I tried to connect your plugin TTS to Metahuman LipSync but there is a problem with ATL. Did you try to do it by yourself? Probably its gonna be really cool. I connected your plugin to ChatGPT and now tring to figure out how to make lipsync.

[lucoiso]

@Yak0vkaSup

Related to lipsync, the plugin currently only outputs the Viseme Data before the synthesis occurs. You can enable it in Project Settings -> Plugins -> AzSpeech -> Enable Viseme

https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/how-to-speech-synthesis-viseme?tabs=visemeid&pivots=programming-language-cpp

[Yak0vkaSup]

Hello again, Yes, of course I enabled Viseme for my tests. I read all docs 🥸. But it doesn’t work for me, did it work for you? I will try again later to try to understand why it doesn’t work with MetaHuman for me.

[lucoiso]

Hello again, Yes, of course I enabled Viseme for my tests. I read all docs 🥸. But it doesn’t work for me, did it work for you? I will try again later to try to understand why it doesn’t work with MetaHuman for me.

@Yak0vkaSup

I didn't use it with MetaHumans, but the plugin returns these viseme data: Id, Offset and Animation, depending on the type of synthesis. And the values are updated and can be obtained using some getters hehehe:

1. Get Viseme Data: returns the last received viseme data
2. Get Viseme Data Array: returns a array containing all generated viseme data structs

[Yak0vkaSup]

At the moment i inspect this problem

[Yak0vkaSup]

SSML doesnt work by the way

[lucoiso]

SSML doesnt work by the way

Did an error occur while using SSML? What happened? :0

[lucoiso]

@ocinon

UE5.1.1 Hotfix released and found this fix in the notes:

UE-170079 | Requesting Android Permissions causes an Ensure on Android Devices

The TTS function requests permission to access the microphone. Maybe this is the reason for the problem. I'll update the engine and check! 👀

https://forums.unrealengine.com/t/5-1-1-hotfix-released/765638

[ocinon]

@lucoiso tested TTS with UE5.1.1 on Android, and it still crashes. Sorry, no dice ;)

[ocinon]

@lucoiso any update on this from Epic's support?

[lucoiso]

@ocinon

They still haven't answered me. I even sent them a sample project to test in the bug report, but I haven't had a response so far, and I haven't found what could be causing this either. :S

[lucoiso]

Will check if this is still occurring in the new versions.