Audio corrupt / weird behaviour

Open marvpaul opened this issue 1 year ago • 0 comments

When recording video + audio (AudioListener) it dosen't seem to work (0.0.18 alpha 7/8). On Mac editor it has a weird sound in the final recording, even though I play a harmonic meditation music in the scene. On iOS it's even worse, when I click record, I hear a weird sound directly on my phone and the audio which I currently play inside my app will be completely silent.

This is a sample project and when I record within the editor using this sample project, it results in those videos (no error log): https://github.com/marvpaul/videokitbug

https://github.com/natmlx/videokit/assets/10696948/c1719b15-11e4-4a6e-9efb-804bc59fbe5d

On iOS the final recording is without any audio. Also I got this error log

VideoKit: MP4Recorder prepared video encoder at resolution 720x1,558
VideoKit: MP4Recorder prepared audio encoder with format 2Hz 24,000ch
Main Thread Checker: UI API called on a background thread: -[UIView bounds]
PID: 1145, TID: 108321, Thread name: (none), Queue name: com.apple.root.default-qos.overcommit, QoS: 0
Backtrace:
4   UnityFramework                      0x000000010e22e89c UnityIsFullscreen + 172
5   UnityFramework                      0x000000010e887f50 _ZN14CrashReporting13CrashReporter24PopulateReportSharedDataERNS_11CrashReportEbb + 928
6   UnityFramework                      0x000000010e8879d8 _ZN14CrashReporting13CrashReporter9HandleLogERK21DebugStringToFileData7LogTypeb + 1140
7   UnityFramework                      0x000000010eb4f5b8 _ZN14CallbackArray3IRK21DebugStringToFileData7LogTypebE6InvokeES2_S3_b + 112
8   UnityFramework                      0x000000010eb4f064 _Z40DebugStringToFilePostprocessedStacktraceRK21DebugStringToFileData + 228
9   UnityFramework                      0x000000010e6c2f28 _ZN9Scripting23LogExceptionFromManagedE21ScriptingExceptionPtriPKcbPKNS_30LogExceptionFromMangedSettingsE + 520
10  UnityFramework                      0x000000010e6c1db0 _ZN9Scripting12LogExceptionE21ScriptingExceptionPtriPKcb + 132
11  UnityFramework                      0x000000010e6c1394 _ZN19ScriptingInvocation6InvokeEP21ScriptingExceptionPtrb + 172
12  UnityFramework                      0x000000010e834eb4 _ZN17AudioCustomFilter12readCallbackEP14FMOD_DSP_STATEPfS2_jii + 324
13  UnityFramework                      0x000000010f0711c0 _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 1348
14  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
15  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
16  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
17  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
18  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
19  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
20  UnityFramework                      0x000000010f080dec _ZN4FMOD12DSPSoundCard4readEPvPj16FMOD_SPEAKERMODEij + 132
21  UnityFramework                      0x000000010f08e944 _ZN4FMOD6Output3mixEPvj + 648
22  UnityFramework                      0x000000010f0905ac _ZN4FMOD15OutputCoreAudio11updateMixerEv + 92
23  UnityFramework                      0x000000010f0a9c58 _ZN4FMOD6Thread8callbackEPv + 180
24  libsystem_pthread.dylib             0x00000001f6c8da90 _pthread_start + 136
25  libsystem_pthread.dylib             0x00000001f6c8cfcc thread_start + 8
=================================================================
Main Thread Checker: UI API called on a background thread: -[UIView bounds]
PID: 1145, TID: 108321, Thread name: (none), Queue name: com.apple.root.default-qos.overcommit, QoS: 0
Backtrace:
4   UnityFramework                      0x000000010e22e89c UnityIsFullscreen + 172
5   UnityFramework                      0x000000010e887f50 _ZN14CrashReporting13CrashReporter24PopulateReportSharedDataERNS_11CrashReportEbb + 928
6   UnityFramework                      0x000000010e8879d8 _ZN14CrashReporting13CrashReporter9HandleLogERK21DebugStringToFileData7LogTypeb + 1140
7   UnityFramework                      0x000000010eb4f5b8 _ZN14CallbackArray3IRK21DebugStringToFileData7LogTypebE6InvokeES2_S3_b + 112
8   UnityFramework                      0x000000010eb4f064 _Z40DebugStringToFilePostprocessedStacktraceRK21DebugStringToFileData + 228
9   UnityFramework                      0x000000010e6c2f28 _ZN9Scripting23LogExceptionFromManagedE21ScriptingExceptionPtriPKcbPKNS_30LogExceptionFromMangedSettingsE + 520
10  UnityFramework                      0x000000010e6c1db0 _ZN9Scripting12LogExceptionE21ScriptingExceptionPtriPKcb + 132
11  UnityFramework                      0x000000010e6c1394 _ZN19ScriptingInvocation6InvokeEP21ScriptingExceptionPtrb + 172
12  UnityFramework                      0x000000010e834eb4 _ZN17AudioCustomFilter12readCallbackEP14FMOD_DSP_STATEPfS2_jii + 324
13  UnityFramework                      0x000000010f0711c0 _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 1348
14  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
15  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
16  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
17  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
18  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
19  UnityFramework                      0x000000010f070dac _ZN4FMOD9DSPFilter4readEPPfPiPj16FMOD_SPEAKERMODEij + 304
20  UnityFramework                      0x000000010f080dec _ZN4FMOD12DSPSoundCard4readEPvPj16FMOD_SPEAKERMODEij + 132
21  UnityFramework                      0x000000010f08e944 _ZN4FMOD6Output3mixEPvj + 648
22  UnityFramework                      0x000000010f0905ac _ZN4FMOD15OutputCoreAudio11updateMixerEv + 92
23  UnityFramework                      0x000000010f0a9c58 _ZN4FMOD6Thread8callbackEPv + 180
24  libsystem_pthread.dylib             0x00000001f6c8da90 _pthread_start + 136
25  libsystem_pthread.dylib             0x00000001f6c8cfcc thread_start + 8
Uploading Crash Report
ArgumentException: Cannot append audio buffer with sample rate {audioBuffer.sampleRate}Hz to recorder with sample rate {sampleRate}Hz
Parameter name: audioBuffer
  at VideoKit.MediaRecorder.Append (VideoKit.AudioBuffer audioBuffer) [0x00000] in <00000000000000000000000000000000>:0 
  at VideoKit.Sources.SceneAudioSource+<>c__DisplayClass10_0.<.ctor>b__0 (System.Single[] data, System.Int32 channels) [0x00000] in <00000000000000000000000000000000>:0 

ArgumentException: Cannot append audio buffer with sample rate {audioBuffer.sampleRate}Hz to recorder with sample rate {sampleRate}Hz
Parameter name: audioBuffer
  at VideoKit.MediaRecorder.Append (VideoKit.AudioBuffer audioBuffer) [0x00000] in <00000000000000000000000000000000>:0 
  at VideoKit.Sources.SceneAudioSource+<>c__DisplayClass10_0.<.ctor>b__0 (System.Single[] data, System.Int32 channels) [0x00000] in <00000000000000000000000000000000>:0 

ArgumentException: Cannot append audio buffer with sample rate {audioBuffer.sampleRate}Hz to recorder with sample rate {sampleRate}Hz
Parameter name: audioBuffer
  at VideoKit.MediaRecorder.Append (VideoKit.AudioBuffer audioBuffer) [0x00000] in <00000000000000000000000000000000>:0 
  at VideoKit.Sources.SceneAudioSource+<>c__DisplayClass10_0.<.ctor>b__0 (System.Single[] data, System.Int32 channels) [0x00000] in <00000000000000000000000000000000>:0 

ArgumentException: Cannot append audio buffer with sample rate {audioBuffer.sampleRate}Hz to recorder with sample rate {sampleRate}Hz
Parameter name: audioBuffer
  at VideoKit.MediaRecorder.Append (VideoKit.AudioBuffer audioBuffer) [0x00000] in <00000000000000000000000000000000>:0 
  at VideoKit.Sources.SceneAudioSource+<>c__DisplayClass10_0.<.ctor>b__0 (System.Single[] data, System.Int32 channels) [0x00000] in <00000000000000000000000000000000>:0

Apr 29 '24 21:04 marvpaul