UEAzSpeech icon indicating copy to clipboard operation
UEAzSpeech copied to clipboard

Experimental: Support for iOS Platform

Open lucoiso opened this issue 3 years ago • 13 comments

This plugin currently does not support iOS platforms. Note: I don't have an iOS device to test, so this improvement will be experimental.

lucoiso avatar Jul 01 '22 14:07 lucoiso

So, Does it still support iOS? Please let me know so that I can also help you test it on one

Legumtechnica avatar Dec 18 '22 18:12 Legumtechnica

Pushed an experimental branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM

lucoiso avatar Dec 18 '22 22:12 lucoiso

Will test today and let you know

Legumtechnica avatar Dec 19 '22 07:12 Legumtechnica

iOS also crashes on runtime, Should I create a new issue?

Legumtechnica avatar Jan 03 '23 09:01 Legumtechnica

Hi @Ishu07 ! : ) Can you try again and send me the log for iOS build? I've updated the iOS UPL file and disabled the Azure SDK logs for Android and iOS : )

iOS support is currently experimental, there is no guarantee that it will work, as I have no way to test it here, so I am trying to adapt when an error is reported after an update.

If you can test again and send me the log, that would be great. :)

lucoiso avatar Jan 09 '23 18:01 lucoiso

Hi, i will try soon and report :)

Legumtechnica avatar Jan 09 '23 18:01 Legumtechnica

Hi, my compuyter is Apple M1, When build for Mac, there are some errors and the log is here: Showing Recent Messages ld: in /Users/xxxx/Documents/Unreal Projects/ChatGPT/Plugins/UEAzSpeech/Source/ThirdParty/AzureWrapper/libs/Mac/x64/libMicrosoft.CognitiveServices.Speech.core.a(event_helpers.cpp.o), building for macOS, but linking in object file built for Mac Catalyst, file '/Users/xxxx/Documents/Unreal Projects/ChatGPT/Plugins/UEAzSpeech/Source/ThirdParty/AzureWrapper/libs/Mac/x64/libMicrosoft.CognitiveServices.Speech.core.a' for architecture x86_64 企业微信20230410-162634@2x


I found that the lib files(.a/.dylib) for Mac platform in the ThirdParty are from different folder: .a files from:

  1. maccatalyst-arm64
  2. maccatalyst-arm64

.dylib files from:

  1. osx-arm64
  2. osx-x64

So that when I compile the source code, it tell me that Mac catalyst is not compatible with MacOS?

1165048017 avatar Apr 10 '23 08:04 1165048017

Hi @1165048017 ! :)

I'll check this and try some adjustments. Did you try using this branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM ? Can you test it? :)

lucoiso avatar Apr 10 '23 17:04 lucoiso

@lucoiso Yes, I check my branch again: gitbranch

By the way, an error occured before the MacOs & Mac catalyst mannualcopy I just copied one of .a files from Mac folder into my Engine/Source folder and solved it.

But, after that, the MacOS & Mac catalyst problem appeared again 企业微信20230411-112343@2x

1165048017 avatar Apr 11 '23 03:04 1165048017

Made new changes, can you try again? 👀

lucoiso avatar Apr 13 '23 21:04 lucoiso

@lucoiso GOOD JOB, it works now; The text to speech or audio works well on my MacOS; I will test it on my iPhone soon. By the way! Another stupid question T_T ! I don't know how to convert the voice input from my microphone to text; I see the Speech to Text button in the sample project, should I continuously press it, or just click it and then saying something, and it will stop recording after few seconds?

—————————————— IOS crash log is here 截屏2023-04-17 01 48 25

1165048017 avatar Apr 16 '23 17:04 1165048017

@1165048017

Disabled SDK logs for iOS, i think it's the same issue that was occurring for android, can you test it again? 😯

You can test using this branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM Or disabling Azure SDK Logs in: Project Settings -> Plugins -> AzSpeech -> Information -> Disable: Enable Azure SDK Logs

lucoiso avatar Apr 16 '23 19:04 lucoiso

@lucoiso The Text to speech/Text to AudioData/SoundWave and SSM to Soundwavw/viseme/speech/audio data worked in my iPhone! But Text to Wav and speech to wav crashed, maybe it have no access to save file into my phone? Because I didn't see the APP ask my phone's storage access privacy. The crash log is here 企业微信20230417-153946@2x

Additionally, It seems like that Speech/wav to text is unavailable too in my iphone ( works well in my M1). Maybe the privacy of microphone prevent it from listening my voice.

1165048017 avatar Apr 17 '23 07:04 1165048017