MixedReality-WebRTC icon indicating copy to clipboard operation
MixedReality-WebRTC copied to clipboard

Video chat demo not working on android

Open amankapur007 opened this issue 4 years ago • 8 comments

Video chat demo sample example does not work on android

To Reproduce Steps to reproduce the behavior:

  1. Go to VideoChatDemo sample scene
  2. Click on 'build and run (for android)
  3. See error

Expected behavior Local peer should show video via mobile webcam

Error messages seen after debugging apk in android studio D/Unity: CommandLine:
D/PhoneWindow: forceLight changed to true [] from com.android.internal.policy.PhoneWindow.updateForceLightNavigationBar:4268 com.android.internal.policy.DecorView.updateColorViews:1513 com.android.internal.policy.PhoneWindow.dispatchWindowAttributesChanged:3246 android.view.Window.setFlags:1148 com.android.internal.policy.PhoneWindow.generateLayout:2474 I/MultiWindowDecorSupport: updateCaptionType >> DecorView@8782d1[], isFloating: false, isApplication: true, hasWindowDecorCaption: false, hasWindowControllerCallback: true D/MultiWindowDecorSupport: setCaptionType = 0, DecorView = DecorView@8782d1[] I/Unity: onResume D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: setView = com.android.internal.policy.DecorView@8782d1 TM=true MM=false V/InputMethodManager: Not IME target window, ignoring D/SurfaceView: onWindowVisibilityChanged(0) true android.view.SurfaceView{3c6fec5 VFE...... .F....I. 0,0-0,0 #7f010000 app:id/unitySurfaceView} of ViewRootImpl@1fe60d3[UnityPlayerActivity] D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,2400,1080) new=(0,0,1800,810) req=(2400,1080)0 dur=15 res=0x7 s={true 501763891200} ch=true D/SurfaceView: surfaceCreated 1 #8 android.view.SurfaceView{3c6fec5 VFE...... .F....ID 0,0-1637,810 #7f010000 app:id/unitySurfaceView} surfaceChanged (1637,810) 1 #8 android.view.SurfaceView{3c6fec5 VFE...... .F....ID 0,0-1637,810 #7f010000 app:id/unitySurfaceView} D/Unity: SetWindow 0 0x74d3758010 SetWindow 0 0x74d3758010 W/Gralloc3: mapper 3.x is not supported D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,1800,810) new=(0,0,1800,810) req=(1800,810)0 dur=36 res=0x1 s={true 501763891200} ch=false MSG_RESIZED: frame=(0,0,1800,810) ci=(68,0,95,0) vi=(0,0,95,0) or=2 D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: MSG_WINDOW_FOCUS_CHANGED 1 1 D/InputMethodManager: prepareNavigationBarInfo() DecorView@8782d1[UnityPlayerActivity] getNavigationBarColor() -855310 I/Unity: windowFocusChanged: true D/InputMethodManager: prepareNavigationBarInfo() DecorView@8782d1[UnityPlayerActivity] getNavigationBarColor() -855310 V/InputMethodManager: Starting input: tba=com.DefaultCompany.NewUnityProject ic=null mNaviBarColor -855310 mIsGetNaviBarColorSuccess true , NavVisible : true , NavTrans : false D/InputMethodManager: startInputInner - Id : 0 I/InputMethodManager: startInputInner - mService.startInputOrWindowGainedFocus D/InputMethodManager: prepareNavigationBarInfo() DecorView@8782d1[UnityPlayerActivity] D/InputMethodManager: getNavigationBarColor() -855310 V/InputMethodManager: Starting input: tba=com.DefaultCompany.NewUnityProject ic=null mNaviBarColor -855310 mIsGetNaviBarColorSuccess true , NavVisible : true , NavTrans : false D/InputMethodManager: startInputInner - Id : 0 E/libprocessgroup: set_timerslack_ns write failed: Operation not permitted D/Unity: Enabling Unity systrace W/NewUnityProjec: Accessing hidden method Ljava/lang/invoke/MethodHandles$Lookup;->(Ljava/lang/Class;I)V (greylist, reflection, allowed) D/Unity: [VFS] Mount /data/app/com.DefaultCompany.NewUnityProject-7f5O_otc-92pIB_TneLuFQ==/base.apk D/Unity: Loading player data from /data/app/com.DefaultCompany.NewUnityProject-7f5O_otc-92pIB_TneLuFQ==/base.apk/assets/bin/Data/data.unity3d D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,1800,810) new=(0,0,1800,810) req=(1800,810)0 dur=8 res=0x1 s={true 501763891200} ch=false I/Unity: SystemInfo CPU = ARM64 FP ASIMD AES, Cores = 8, Memory = 7500mb SystemInfo ARM big.LITTLE configuration: 2 big (mask: 0xc0), 6 little (mask: 0x3f) I/Unity: ApplicationInfo com.DefaultCompany.NewUnityProject version 1.0 build 66377599-122b-4c64-9482-d4ab85d1b6ec Built from '2019.4/release' branch, Version '2019.4.14f1 (4037e52648cd)', Build type 'Development', Scripting Backend 'il2cpp', CPU 'arm64-v8a', Stripping 'Enabled' D/Unity: Script Patching: Patch files are not available, '/storage/emulated/0/Android/data/com.DefaultCompany.NewUnityProject/cache/ScriptOnly/2019.4.14f1/il2cpp/patch.config' is missing. D/Unity: Unity build is different than extracted il2cpp resources. Re-extracting. D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,1800,810) new=(0,0,1800,810) req=(1800,810)0 dur=15 res=0x1 s={true 501763891200} ch=false D/SurfaceView: surfaceChanged (1800,810) 1 #5 android.view.SurfaceView{3c6fec5 VFE...... .F....ID 0,0-1800,810 #7f010000 app:id/unitySurfaceView} D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: MSG_RESIZED: frame=(0,0,1800,810) ci=(68,0,95,0) vi=(0,0,0,0) or=2 D/Unity: PlayerConnection initialized from /data/app/com.DefaultCompany.NewUnityProject-7f5O_otc-92pIB_TneLuFQ==/base.apk/assets/bin/Data (debug = 0) D/Unity: PlayerConnection initialized network socket : 0.0.0.0 55223 PlayerConnection initialized unix socket : Unity-com.DefaultCompany.NewUnityProject D/Unity: Multi-casting "[IP] 192.168.1.17 [Port] 55223 [Flags] 19 [Guid] 4141033572 [EditorId] 1509987925 [Version] 1048832 [Id] AndroidPlayer([email protected]) [Debug] 1 [PackageName] AndroidPlayer [ProjectName] New Unity Project" to [225.0.0.222:54997]... Waiting for connection from host on [0.0.0.0:55223]... D/Unity: PlayerConnection accepted from [192.168.1.11] handle:0x49 D/Unity: Started listening to [0.0.0.0:55223] Starting managed debugger on port 56572 D/Unity: [EGL] Attaching window :0x74d3758010 InitializeScriptEngine OK (0x74d1425fc0) D/Unity: PlayerConnection already initialized - listening to [0.0.0.0:55223] E/libprocessgroup: set_timerslack_ns write failed: Operation not permitted I/chatty: uid=10260(com.DefaultCompany.NewUnityProject) UnityMain identical 14 lines E/libprocessgroup: set_timerslack_ns write failed: Operation not permitted D/Unity: Loading player data from assets/bin/Data/data.unity3d D/Unity: PlayerInitEngineNoGraphics OK AndroidGraphics::Startup window = 0x74d3758010 [EGL] Attaching window :0x74d3758010 D/Unity: [Subsystems] Discovering subsystems at path assets/bin/Data/UnitySubsystems I/AdrenoGLES: QUALCOMM build : eb230ec, I000594fe7d Build Date : 04/01/20 OpenGL ES Shader Compiler Version: EV031.27.05.03 Local Branch : Remote Branch : refs/tags/AU_LINUX_ANDROID_LA.UM.8.9.R1.10.00.00.558.065 Remote Branch : NONE Reconstruct Branch : NOTHING Build Config : S P 8.0.12 AArch64 I/AdrenoGLES: PFP: 0x016ee187, ME: 0x00000000 D/Unity: [EGL] Request: ES 3.2 RGB0 000 0/0 [EGL] Checking ES 3.2 support... D/Unity: [EGL] ES 3.2 support detected [EGL] Found: ID[1] ES 3.2 RGB16 565 0/0 GfxDevice: creating device client; threaded=1 [EGL] Request: ES 3.2 RGB0 000 0/0 [EGL] Found: ID[1] ES 3.2 RGB16 565 0/0 [EGL] Request: ES 3.0 RGBA32 8888 0/0 D/Unity: [EGL] Found: ID[9] ES 3.0 RGBA32 8888 0/0 D/Unity: ANativeWindow: (1800/810) RequestedResolution: (0/0) RenderingResolution: (0/0) EGLSurface: (1800/810) D/Unity: Renderer: Adreno (TM) 618 Vendor: Qualcomm Version: OpenGL ES 3.2 [email protected] (GIT@eb230ec, I000594fe7d, 1585743341) (Date:04/01/20) GLES: 3 GL_OES_EGL_image GL_OES_EGL_image_external GL_OES_EGL_sync GL_OES_vertex_half_float GL_OES_framebuffer_object GL_OES_rgb8_rgba8 GL_OES_compressed_ETC1_RGB8_texture GL_AMD_compressed_ATC_texture GL_KHR_texture_compression_astc_ldr GL_KHR_texture_compression_astc_hdr GL_OES_texture_compression_astc GL_OES_texture_npot GL_EXT_texture_filter_anisotropic GL_EXT_texture_format_BGRA8888 GL_EXT_read_format_bgra GL_OES_texture_3D GL_EXT_color_buffer_float GL_EXT_color_buffer_half_float GL_QCOM_alpha_test GL_OES_depth24 GL_OES_packed_depth_stencil GL_OES_depth_texture GL_OES_depth_texture_cube_map GL_EXT_sRGB GL_OES_texture_float GL_OES_texture_float_linear GL_OES_texture_half_float GL_OES_texture_half_float_linear GL_EXT_texture_type_2_10_10_10_REV GL_EXT_texture_sRGB_decode GL_EXT_texture_format_sRGB_override GL_OES_element_index_uint GL_EXT_copy_image GL_EXT_geometry_shader GL_EXT_tessellation_shader GL_OES_texture_stencil8 GL_EXT_shader_io_blocks GL_OES_shader_image_atomic GL_OES_sample_variables GL_EXT_texture_b order_clamp GL_EXT_EGL_image_external_wrap_modes GL_EXT_multisampled_render_to_texture GL_EXT_multisampled_render_to_texture2 GL_OES_shader_multisample_interpolation GL_EXT_texture_cube_map_array GL_EXT_draw_buffers_indexed GL_EXT_gpu_shader5 GL_EXT_robustness GL_EXT_texture_buffer GL_EXT_shader_framebuffer_fetch GL_ARM_shader_framebuffer_fetch_depth_stencil GL_OES_texture_storage_multisample_2d_array GL_OES_sample_shading GL_OES_get_program_binary GL_EXT_debug_label GL_KHR_blend_equation_advanced GL_KHR_blend_equation_advanced_coherent GL_QCOM_tiled_rendering GL_ANDROID_extension_pack_es31a GL_EXT_primitive_bounding_box GL_OES_standard_derivatives GL_OES_vertex_array_object GL_EXT_disjoint_timer_query GL_KHR_debug GL_EXT_YUV_target GL_EXT_sRGB_write_control GL_EXT_texture_norm16 GL_EXT_discard_framebuffer GL_OES_surfaceless_context GL_OVR_multiview GL_OVR_multiview2 GL_EXT_texture_sRGB_R8 GL_KHR_no_error GL_EXT_debug_marker GL_OES_EGL_image_external_essl3 GL_OVR_multiview_multisampled_render_to_texture GL_E XT_buffer_storage GL_EXT_external_buffer GL_EXT_blit_framebuffer_params GL_EXT_clip_cull_distance GL_EXT_protected_textures GL_EXT_shader_non_constant_global_initializers GL_QCOM_texture_foveated GL_QCOM_texture_foveated_subsampled_layout GL_QCOM_shader_framebuffer_fetch_noncoherent GL_QCOM_shader_framebuffer_fetch_rate GL_EXT_memory_object GL_EXT_memory_object_fd GL_EXT_EGL_image_array GL_NV_shader_noperspective_interpolation GL_KHR_robust_buffer_access_behavior GL_EXT_EGL_image_storage GL_EXT_blend_func_extended GL_EXT_clip_control GL_OES_texture_view GL_EXT_fragment_invocation_density GL_QCOM_validate_shader_binary GL_QCOM_YUV_texture_gather D/Unity: OPENGL LOG: Creating OpenGL ES 3.2 graphics device ; Context level <OpenGL ES 3.2> ; Context handle -745285248 [EGL] Attaching window :0x74d3758010 D/Unity: Requested framebuffer: resolution[1800x810], rgba[8/8/8/8], depth+stencil[on], samples[1] Created framebuffer: resolution[1800x810], rgba[8/8/8/8], depth+stencil[24/8], samples[0] [EGL] Attaching window :0x74d3758010 Initialize engine version: 2019.4.14f1 (4037e52648cd) D/: PlayerBase::PlayerBase() TrackPlayerBase::TrackPlayerBase() I/libOpenSLES: Emulating old channel mask behavior (ignoring positional mask 0x3, using default mask 0x3 based on channel count of 2) W/AudioTrack: set(): notificationFrames=-10 clamped to the range -1 to -8 W/AudioTrack: createTrack_l(0): AUDIO_OUTPUT_FLAG_FAST denied by server; frameCount 0 -> 1920 I/AudioTrack: Need throttle time for OpenSLES player I/Unity: XRGeneral Settings awakening... #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x74712fb948 (libil2cpp.so) ? 0x0 #8 0x74707498b0 (libil2cpp.so) ? 0x0 #9 0x747138ea40 (libil2cpp.so) ? 0x0 #10 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 #11 0x7479697828 (libunity.so) ScriptingInvocation::Invoke(ScriptingExceptionPtr*, bool) 0x98 #12 0x7479699260 (libunity.so) ScriptingInvocat D/Unity: PlayerInitEngineGraphics OK D/Unity: Found 37 native sensors D/Unity: Sensor : Accelerometer ( 1) ; 0.002393 / 0.00s ; lsm6dsm Accelerometer Non-wakeup / STMicro D/Unity: Sensor : Accelerometer ( 1) ; 0.002393 / 0.00s ; lsm6dsm Accelerometer Non-wakeup / STMicro D/Unity: SetWindow 0 0x74d3758010 D/Unity: [EGL] Attaching window :0x74d3758010 V/MediaRouter: Selecting route: RouteInfo{ name=Phone, description=null, status=null, category=RouteCategory{ name=System types=ROUTE_TYPE_LIVE_AUDIO ROUTE_TYPE_LIVE_VIDEO groupable=false }, supportedTypes=ROUTE_TYPE_LIVE_AUDIO ROUTE_TYPE_LIVE_VIDEO , presentationDisplay=null } D/Unity: UnloadTime: 1.304375 ms I/Unity: Found Unity Java activity. #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x747098c37c (libil2cpp.so) ? 0x0 #8 0x74709aec60 (libil2cpp.so) ? 0x0 #9 0x7470def6b8 (libil2cpp.so) ? 0x0 #10 0x74709ad470 (libil2cpp.so) ? 0x0 #11 0x74707498b0 (libil2cpp.so) ? 0x0 #12 0x747138ea40 (libil2cpp.so) ? 0x0 #13 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 #14 0x7479697828 (libunity.so) I/org.webrtc.Logging: NativeLibrary: Loading native library: mrwebrtc I/org.webrtc.Logging: NativeLibrary: Loading library: mrwebrtc I/org.webrtc.Logging: PeerConnectionFactory: PeerConnectionFactory was initialized without an injected Loggable. Any existing Loggable will be deleted. I/Unity: Initialized MixedReality-WebRTC Java binding for Android. #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x747098cc3c (libil2cpp.so) ? 0x0 #8 0x74709aec60 (libil2cpp.so) ? 0x0 #9 0x7470def6b8 (libil2cpp.so) ? 0x0 #10 0x74709ad470 (libil2cpp.so) ? 0x0 #11 0x74707498b0 (libil2cpp.so) ? 0x0 #12 0x747138ea40 (libil2cpp.so) ? 0x0 #13 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 I/Unity: Initializing WebRTC plugin... #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x74709c1990 (libil2cpp.so) ? 0x0 #8 0x74709bbfec (libil2cpp.so) ? 0x0 #9 0x74709bb82c (libil2cpp.so) ? 0x0 #10 0x74709bfe68 (libil2cpp.so) ? 0x0 #11 0x74707498b0 (libil2cpp.so) ? 0x0 #12 0x747138ea40 (libil2cpp.so) ? 0x0 #13 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 #14 0x7479697828 (libunity. D/Unity: Unable to load library '/data/app/com.DefaultCompany.NewUnityProject-7f5O_otc-92pIB_TneLuFQ==/lib/arm64/libmrwebrtc.so', native render plugin support disabled: java.lang.NullPointerException: Attempt to invoke virtual method 'java.lang.ClassLoader java.lang.Class.getClassLoader()' on a null object reference I/org.webrtc.Logging: WebRtcAudioManager: ctor@[name=Thread-19, id=9763] WebRtcAudioManager: Sample rate is set to 48000 Hz I/org.webrtc.Logging: WebRtcAudioEffects: canUseAcousticEchoCanceler: true I/org.webrtc.Logging: WebRtcAudioEffects: canUseNoiseSuppressor: true D/Unity: Sensor : Accelerometer ( 1) ; 0.002393 / 0.00s ; lsm6dsm Accelerometer Non-wakeup / STMicro W/org.webrtc.Logging: WebRtcAudioManager: AAudio support is currently disabled on all devices! I/org.webrtc.Logging: WebRtcAudioManager: Android SDK: 29, Release: 10, Brand: samsung, Device: m51, Id: QP1A.190711.020, Hardware: qcom, Manufacturer: samsung, Model: SM-M515F, Product: m51nsxx I/Unity: onPause I/org.webrtc.Logging: WebRtcAudioManager: Audio State: audio mode: MODE_NORMAL, has mic: true, mic muted: false, music active: true, speakerphone: false, BT SCO: false WebRtcAudioManager: Audio State: WebRtcAudioManager: fixed volume=false I/org.webrtc.Logging: WebRtcAudioManager: STREAM_VOICE_CALL: volume=7, max=7, muted=false I/org.webrtc.Logging: WebRtcAudioManager: STREAM_MUSIC: volume=0, max=15, muted=false I/org.webrtc.Logging: WebRtcAudioManager: STREAM_RING: volume=15, max=15, muted=false D/Unity: Choreographer available: Enabling VSYNC timing I/org.webrtc.Logging: WebRtcAudioManager: STREAM_ALARM: volume=11, max=15, muted=false I/org.webrtc.Logging: WebRtcAudioManager: STREAM_NOTIFICATION: volume=15, max=15, muted=false I/org.webrtc.Logging: WebRtcAudioManager: STREAM_SYSTEM: volume=15, max=15, muted=false WebRtcAudioManager: Audio Devices: WebRtcAudioManager: TYPE_BUILTIN_EARPIECE(out): channels=[1], encodings=[2], sample rates=[48000], id=2 WebRtcAudioManager: TYPE_BUILTIN_SPEAKER(out): channels=[2], encodings=[2], sample rates=[48000], id=3 WebRtcAudioManager: TYPE_TELEPHONY(out): channels=[1, 2], encodings=[2], sample rates=[8000, 16000], id=10 WebRtcAudioManager: TYPE_BUILTIN_MIC(in): channels=[1, 2], encodings=[2], sample rates=[8000, 11025, 12000, 16000, 22050, 24000, 32000, 44100, 48000], id=13 WebRtcAudioManager: TYPE_BUILTIN_MIC(in): channels=[1, 2], encodings=[2], sample rates=[8000, 11025, 12000, 16000, 22050, 24000, 32000, 44100, 48000], id=14 I/org.webrtc.Logging: WebRtcAudioManager: TYPE_TELEPHONY(in): channels=[1, 2], encodings=[2], sample rates=[8000, 11025, 12000, 16000, 22050, 24000, 32000, 44100, 48000], id=16 D/OpenSLESPlayer: ctor[tid=17416] D/OpenSLESRecorder: ctor[tid=17416] D/OpenSLESPlayer: AttachAudioBuffer SetPlayoutSampleRate(48000) SetPlayoutChannels(1) AllocateDataBuffers native buffer size: 192 native buffer size in ms: 4.00 D/OpenSLESRecorder: AttachAudioBuffer SetRecordingSampleRate(48000) SetRecordingChannels(1) AllocateDataBuffers frames per native buffer: 192 frames per 10ms buffer: 480 bytes per native buffer: 384 native sample rate: 48000 I/org.webrtc.Logging: WebRtcAudioManager: init@[name=Thread-19, id=9763] I/org.webrtc.Logging: WebRtcAudioManager: audio mode is: MODE_NORMAL D/OpenSLESPlayer: Init[tid=17416] D/OpenSLESRecorder: Init[tid=17416] EnableBuiltInAEC(1) E/OpenSLESRecorder: Not implemented D/OpenSLESRecorder: EnableBuiltInNS(1) E/OpenSLESRecorder: Not implemented D/: PlayerBase::stop() from IPlayer D/AudioTrack: stop(368): called with 95040 frames delivered D/Unity: Sensor : Accelerometer ( 1) ; 0.002393 / 0.00s ; lsm6dsm Accelerometer Non-wakeup / STMicro D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,1800,810) new=(0,0,1800,810) req=(1800,810)0 dur=6 res=0x1 s={true 501763891200} ch=false D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: MSG_WINDOW_FOCUS_CHANGED 0 1 D/InputMethodManager: prepareNavigationBarInfo() DecorView@8782d1[UnityPlayerActivity] getNavigationBarColor() -855310 I/Unity: windowFocusChanged: false I/Unity: android.permission.RECORD_AUDIO denied. D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: stopped(false) old=false I/Unity: onResume D/ViewRootImpl@1fe60d3[UnityPlayerActivity]: Relayout returned: old=(0,0,1800,810) new=(0,0,1800,810) req=(1800,810)0 dur=8 res=0x1 s={true 501763891200} ch=false MSG_WINDOW_FOCUS_CHANGED 1 1 D/InputMethodManager: prepareNavigationBarInfo() DecorView@8782d1[UnityPlayerActivity] getNavigationBarColor() -855310 I/Unity: windowFocusChanged: true D/Unity: Sensor : Accelerometer ( 1) ; 0.002393 / 0.00s ; lsm6dsm Accelerometer Non-wakeup / STMicro V/MediaRouter: Selecting route: RouteInfo{ name=Phone, description=null, status=null, category=RouteCategory{ name=System types=ROUTE_TYPE_LIVE_AUDIO ROUTE_TYPE_LIVE_VIDEO groupable=false }, supportedTypes=ROUTE_TYPE_LIVE_AUDIO ROUTE_TYPE_LIVE_VIDEO , presentationDisplay=null } D/Unity: Choreographer available: Enabling VSYNC timing I/Unity: NodeDSS local peer ID : PC #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x747133666c (libil2cpp.so) ? 0x0 #8 0x74707498b0 (libil2cpp.so) ? 0x0 #9 0x747138ea40 (libil2cpp.so) ? 0x0 #10 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 #11 0x7479697828 (libunity.so) ScriptingInvocation::Invoke(ScriptingExceptionPtr*, bool) 0x98 #12 0x74796a1cc4 (libunity.so) MonoBehaviour::Invoke I/Unity: NodeDSS remote peer ID : UNITY #0 0x7479be0668 (libunity.so) GetStacktrace(int) 0x3c #1 0x7479abdb8c (libunity.so) DebugStringToFile(DebugStringToFileData const&) 0x21c #2 0x74797508f0 (libunity.so) DebugLogHandler::Internal_Log(LogType, LogOption, core::basic_string<char, core::StringStorageDefault >, Object*) 0x90 #3 0x7479750820 (libunity.so) DebugLogHandler_CUSTOM_Internal_Log(LogType, LogOption, ScriptingBackendNativeStringPtrOpaque*, ScriptingBackendNativeObjectPtrOpaque*) 0xf8 #4 0x7470fc1e34 (libil2cpp.so) ? 0x0 #5 0x7470edb908 (libil2cpp.so) ? 0x0 #6 0x7470fbed90 (libil2cpp.so) ? 0x0 #7 0x7471336c9c (libil2cpp.so) ? 0x0 #8 0x74707498b0 (libil2cpp.so) ? 0x0 #9 0x747138ea40 (libil2cpp.so) ? 0x0 #10 0x7479688164 (libunity.so) scripting_method_invoke(ScriptingMethodPtr, ScriptingObjectPtr, ScriptingArguments&, ScriptingExceptionPtr*, bool) 0xa4 #11 0x7479697828 (libunity.so) ScriptingInvocation::Invoke(ScriptingExceptionPtr*, bool) 0x98 #12 0x74796a1cc4 (libunity.so) MonoBehaviour::In I/Unity: WebRTC plugin initialized successfully. Screenshots If applicable, add screenshots to help explain your problem.

image

Environment

  • MR-WebRTC version (package version, or specific commit if building from source) : 2.0.2
  • Platform: Unity Editor
  • Architecture: Unity Editor is x64 on Windows
  • Unity version (if applicable): 2019.4.14f1
  • Target device: Android Phone

amankapur007 avatar Nov 06 '20 18:11 amankapur007

@amankapur007 , Not sure about the error you are getting but have you added permissions in custom manifest and built for ARM64 ? Below thing is tested and works on Unity 2019.4.15 with 2.0 package of MR WebRTC

I was unable to make it work over local server so have hosted Node DSS over Azure App service as that is the end point for my app, you could use Heroku.

  1. Make sure player settings are as follows. playersettings

  2. Under publishing settings create a custom manifest and add below permissions : <uses-permission android:name="android.permission.RECORD_AUDIO" /> <uses-permission android:name="android.permission.CAMERA" /> Additionally you could check permissions at runtime.

  3. Also make sure to update the peer names under Node DSS Signaler component in unity. You can set up local peer name as ANDROID and remote peer as UNITY and make a build, when playing in editor reverse the order, so UNITY becomes your local and ANDROID becomes remote. You can do this at runtime as well but it is easier to test the demo scene with values already in place.

  4. Make sure you provide permissions to android and have Unity editor play settings at MAXIMIZE ON PLAY, if the game screen is not maximized it doesn't work for me.

Sometimes there is delay in starting video however you can create offer from android post sometime in case video does not show up in few seconds.

hazelwolf avatar Dec 07 '20 18:12 hazelwolf

Sometimes there is delay in starting video however you can create offer from android post sometime in case video does not show up in few seconds.

@hazelWolf How long does it takes for you to be able to trade video?

I was able to do it, but it takes about 10 minutes or so to finally get connected. And it was only one time (which could be a coincidence) after I push The "Offer Button" several times from android for every few seconds. I used Node-DSS hosted using Ngrok tunnel.

fermanda avatar Feb 01 '21 12:02 fermanda

@fermanda sometimes it might take up to 2 minutes but never more than that would suggest using Heroku or some other free service. As per my experience ngrok is fine for some minimal testing but the actual performance is far worse than a hosted server. You can check how much time the first SDP transmission takes there is a slight chance that SDP messages are dropping in but there is a delay in rendering video.

You might see infinity written over peer video component when SDP is not received.

hazelwolf avatar Feb 01 '21 15:02 hazelwolf

You might see infinity written over peer video component when SDP is not received.

@hazelWolf I have tried heroku and AWS EC2 instance but the remote / peer video component still showing infinity. I'm not sure what is wrong. Did you also change your Pool time?

fermanda avatar Feb 02 '21 10:02 fermanda

@fermanda No change to pool time, set to 500 ms. Is the video not at all coming up or transmission is slow? One thing you could try is to disable auto-negotiation under the PeerConnection component and do a manual create offer and check if that helps.

Additional Check: Make sure you have named local and remote peers differently and correctly if names are not configured correctly that would cause the same problem.

You can also check the issues section there are new issues raised related to networking.

hazelwolf avatar Feb 02 '21 11:02 hazelwolf

@hazelWolf Yeah. The video not coming at all. I have tried your suggestions as well. As I was saying. I was able to do it once for Android and Computer after waiting for a while. Last December, I used Unity Editor and Hololens in the company's network and it worked perfectly (with Ngrok). But this time I did some remote work and uses my home network but it shows nothing. It did change SDPs though.

This is the result. Even in this picture, I used 2 computers with Unity Editor running on each. I wanted to check if they are really changing SDPs (Offer and Answer each other) and yes they were. image

fermanda avatar Feb 05 '21 11:02 fermanda

@hazelWolf I think there are problems with the network. I tried once more today at company's network and it seem to work without any problem. I'm not sure if there are requirement for the network to be able to connect between devices.

fermanda avatar Mar 01 '21 08:03 fermanda

Did this get solved? I'm having a similar issue between node and Unity.

brennanzdas avatar Feb 18 '22 02:02 brennanzdas