rknn.Inference() interface error or stuck happened after multiple invoke

[Islam1Samir]

Hi there, I am currently trying to run darknet yolov3 from examples using rknn-toolkit 1.7.1. i modified test.py file to do many inference with the following code

for i in range(1000):
        # Inference
        print(i)
        print('--> Running model')
        outputs = rknn.inference(inputs=[img])
        print('done')

so it run as expected for a while and got accurate output

--> Init runtime environment
D target set by user is: None
D Host is RK3399PRO
D Starting ntp or adb, target is None, host is RK3399PRO
D Start ntp...
I npu_transfer_proxy pid: 48, status: sleeping
I NPUTransfer: Starting NPU Transfer Client, Transfer version 2.1.0 (b5861e7@2020-11-23T11:50:51)
D NPUTransfer: Transfer spec = local:transfer_proxy
D NPUTransfer: Transfer interface successfully opened, fd = 4
D RKNNAPI: ==============================================
D RKNNAPI: RKNN VERSION:
D RKNNAPI:   API: 1.7.1 (566a9b6 build: 2021-10-28 14:56:17)
D RKNNAPI:   DRV: 1.7.1 (0cfd4a1 build: 2021-11-24 09:05:48)
D RKNNAPI: ==============================================
done
0
--> Running model
done
1
--> Running model
done
2
--> Running model
done
3
--> Running model
done
4
--> Running model
done
5
--> Running model
done
6
--> Running model
done
7
--> Running model
done
8
--> Running model
done
9
--> Running model
done
10
--> Running model

but after 100 or 150 iterations connection close

D NPUTransfer: The connection has been closed, socket read fd = 4
D NPUTransfer: Transfer client closed, fd = 4
E RKNNAPI: __pthread_recv_msg,  recv(MsgHeader) fail, -9(ERROR_PIPE) < 108!
--> Running model
E NPUTransfer: Please open transfer first!
E RKNNAPI: rknn_input_set,  send(MsgInput 0) fail, -4(ERROR_NO_DEVICE) != 520311!
E Catch exception when setting inputs.
E Traceback (most recent call last):
E   File "rknn/api/rknn_base.py", line 985, in rknn.api.rknn_base.RKNNBase.inference
E   File "rknn/api/rknn_base.py", line 907, in rknn.api.rknn_base.RKNNBase.set_inputs
E   File "rknn/api/rknn_runtime.py", line 483, in rknn.api.rknn_runtime.RKNNRuntime.set_inputs
E Exception: Set inputs failed. error code: RKNN_ERR_DEVICE_UNAVAILABLE
E Please feedback the detailed log file <log_feedback_to_the_rknn_toolkit_dev_team.log> to the RKNN Toolkit development team.
E You can also check github issues: https://github.com/rockchip-linux/rknn-toolkit/issues
done

i run it on Rockchip RK3399pro

when run dmesg

[34538.365576] usb usb7-port1: disabled by hub (EMI?), re-enabling...
[34538.366666] usb 7-1: USB disconnect, device number 39
[34538.374546] usb 8-1: USB disconnect, device number 17
[34538.610680] usb 7-1: new high-speed USB device number 40 using xhci-hcd
[34538.738739] usb 7-1: New USB device found, idVendor=2207, idProduct=180a
[34538.738764] usb 7-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[34661.708587] gpio-4 (sysfs): gpiod_request: status -16
[34661.708626] export_store: status -16
[34661.774007] usb 7-1: USB disconnect, device number 40
[34662.045823] usb 7-1: new high-speed USB device number 41 using xhci-hcd
[34662.174409] usb 7-1: New USB device found, idVendor=2207, idProduct=180a
[34662.174446] usb 7-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[34663.526410] usb 7-1: reset high-speed USB device number 41 using xhci-hcd
[34663.646012] usb 7-1: device descriptor read/64, error -71
[34663.878898] usb 7-1: device firmware changed
[34663.879258] usb 7-1: USB disconnect, device number 41
[34663.993892] usb 7-1: new high-speed USB device number 42 using xhci-hcd
[34664.126591] usb 7-1: New USB device found, idVendor=2207, idProduct=180a
[34664.126636] usb 7-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[34664.126662] usb 7-1: Product: USB-MSC
[34664.126686] usb 7-1: Manufacturer: RockChip
[34664.126710] usb 7-1: SerialNumber: rockchip
[34672.038212] usb 8-1: new SuperSpeed USB device number 18 using xhci-hcd
[34672.059396] usb 8-1: New USB device found, idVendor=2207, idProduct=0019
[34672.059434] usb 8-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[34672.059460] usb 8-1: Product: rk3xxx
[34672.059485] usb 8-1: Manufacturer: rockchip
[34672.059509] usb 8-1: SerialNumber: 3ccf6585bee0d018

so anyone could help here please