camerad crash during ISP setup
Describe the bug
Went ignition-off, toggled OP long/experimental, and started up on a 2024 Honda Odyssey under active development. On startup, the UI camera display was all blue, and the speed wouldn't update, but the reverse gear display worked.
I tried two ignition-off and restart cycles and experienced the same. Reboot from the UI was needed to get back into working condition.
Provide a route where the issue occurs
f39cf149898833ff/0000005e--1dc4c8ceb3
openpilot version
03e9777c3ff29c9bdaca33facb9eb2bb58df25c6 plus a car port
Additional info
camerad crashed while setting up the ISP for the third camera. Tombstones were uploaded.
Trimmed grep "camerad" logs:
[0.474857] system/camerad/cameras/spectra.cc:994 - openSensor: opened sensor for 2
[0.474975] system/camerad/cameras/spectra.cc:996 - openSensor: -- Probing sensor 2
[0.531372] system/camerad/cameras/spectra.cc:458 - sensors_init: probing the sensor: 0
[0.531532] system/camerad/cameras/spectra.cc:1013 - openSensor: -- Probing sensor 2 success
[0.531629] system/camerad/cameras/spectra.cc:1018 - openSensor: get session: 0 0x1D020A
[0.531716] system/camerad/cameras/spectra.cc:1022 - openSensor: -- Accessing sensor
[0.534197] manager.py:193 - : loggerd encoderd logmessaged camerad logcatd proclogd micd timed modeld dmonitoringmodeld sensord ui soundd locationd calibrationd torqued controlsd selfdrived card deleter dmonitoringd qcomgpsd pandad paramsd lagd plannerd radard hardwared tombstoned uploader statsd feedbackd
[0.583884] system/camerad/cameras/spectra.cc:1026 - openSensor: acquire sensor dev
[0.586079] system/camerad/cameras/spectra.cc:1028 - openSensor: -- Configuring sensor
[0.627315] system/camerad/cameras/spectra.cc:40 - do_cam_control: VIDIOC_CAM_CONTROL error: op_code 258 - errno 22
[0.627398] system/camerad/cameras/spectra.cc:40 - do_cam_control: VIDIOC_CAM_CONTROL error: op_code 258 - errno 22
Trimmed grep "kernel - CAM" logs
(openpilot) jyoung@jy-workstation-ubuntu:~/openpilot$ selfdrive/debug/filter_log_message.py f39cf149898833ff/0000005e--1dc4c8ceb3 | grep "kernel - CAM"
[0.284046] MAIN 0 kernel - CAM_INFO: CAM-CRM: cam_req_mgr_open: 130 cam_req_mgr_open:130 disalbe lpm
[0.284283] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_pm_qos_update_request: 117 cam_pm_qos_update_request: update request 100
[0.285562] MAIN 0 kernel - CAM_INFO: CAM-ICP: cam_icp_mgr_hw_open: 2990 FW download done successfully
[0.285808] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 768 Probe success,slot:0,slave_addr:0x6c,sensor_id:0x5803
[0.286077] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 841 CAM_ACQUIRE_DEV Success, sensor_id:0x5803,sensor_slave_addr:0x6c
[0.538635] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 768 Probe success,slot:1,slave_addr:0x20,sensor_id:0x5803
[0.538702] MAIN 0 kernel - CAM_INFO: CAM: cam_res_mgr_shared_pinctrl_put: 273 Need hold put this pinctrl
[0.538989] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 841 CAM_ACQUIRE_DEV Success, sensor_id:0x5803,sensor_slave_addr:0x20
[0.792215] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 768 Probe success,slot:2,slave_addr:0x6c,sensor_id:0x5803
[0.792286] MAIN 0 kernel - CAM_INFO: CAM: cam_res_mgr_shared_pinctrl_put: 273 Need hold put this pinctrl
[0.792359] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_sensor_driver_cmd: 841 CAM_ACQUIRE_DEV Success, sensor_id:0x5803,sensor_slave_addr:0x6c
[0.792822] MAIN 0 kernel - CAM_ERR: CAM-ISP: cam_ife_csid_cid_reserve: 695 CSID:2 RDI:0 resource not available
[0.792880] MAIN 0 kernel - CAM_ERR: CAM-ISP: cam_ife_mgr_acquire_cid_res: 1082 Can not acquire ife cid resource for path 0
[0.792937] MAIN 0 kernel - CAM_ERR: CAM-ISP: cam_ife_hw_mgr_acquire_res_ife_csid_rdi: 1295 Acquire IFE CID resource Failed
[0.792992] MAIN 0 kernel - CAM_ERR: CAM-ISP: cam_ife_mgr_acquire_hw_for_ctx: 1449 Acquire IFE CSID RDI resource Failed
[0.793050] MAIN 0 kernel - CAM_ERR: CAM-ISP: cam_ife_mgr_acquire_hw: 1605 can not acquire resource
[0.793133] MAIN 0 kernel - CAM_ERR: CAM-ISP: __cam_isp_ctx_acquire_dev_in_available: 2254 Acquire device failed
[0.793195] MAIN 0 kernel - CAM_ERR: CAM-CORE: __cam_node_handle_acquire_dev: 117 Acquire device failed for node cam-isp
[0.793263] MAIN 0 kernel - CAM_ERR: CAM-CORE: cam_node_handle_ioctl: 567 acquire device failed(rc = -22)
[2.432803] MAIN 0 kernel - CAM_INFO: CAM: cam_res_mgr_shared_pinctrl_put: 273 Need hold put this pinctrl
[2.432915] MAIN 0 kernel - CAM_INFO: CAM: cam_res_mgr_shared_pinctrl_put: 273 Need hold put this pinctrl
[2.799046] MAIN 0 kernel - CAM-REQ-MGR_UTIL cam_get_device_priv:217 CAM_ERR: CAM-CRM: cam_get_device_priv: 217 Invalid state
[2.799110] MAIN 0 kernel - CAM_ERR: CAM-CORE: __cam_node_crm_link_setup: 374 Can not get context for handle 12321031
[2.799170] MAIN 0 kernel - CAM_ERR: CAM-CRM: __cam_req_mgr_destroy_link_info: 1288 Unlink failed dev name cam-isp hdl bc0107
[2.799251] MAIN 0 kernel - CAM-REQ-MGR_UTIL cam_get_device_priv:217 CAM_ERR: CAM-CRM: cam_get_device_priv: 217 Invalid state
[2.799310] MAIN 0 kernel - CAM_ERR: CAM-SENSOR: cam_sensor_establish_link: 1068 Device data is NULL
[2.799368] MAIN 0 kernel - CAM_ERR: CAM-CRM: __cam_req_mgr_destroy_link_info: 1288 Unlink failed dev name cam-sensor hdl 760106
[2.799585] MAIN 0 kernel - CAM_ERR: CAM-CORE: __cam_req_mgr_unlink: 2346 Unlink for all devices was not successful
[2.799645] MAIN 0 kernel - CAM-REQ-MGR_UTIL cam_get_device_priv:217 CAM_ERR: CAM-CRM: cam_get_device_priv: 217 Invalid state
[2.799703] MAIN 0 kernel - CAM_ERR: CAM-CORE: __cam_node_crm_link_setup: 374 Can not get context for handle 7799042
[2.799760] MAIN 0 kernel - CAM_ERR: CAM-CRM: __cam_req_mgr_destroy_link_info: 1288 Unlink failed dev name cam-isp hdl 770102
[2.799817] MAIN 0 kernel - CAM-REQ-MGR_UTIL cam_get_device_priv:217 CAM_ERR: CAM-CRM: cam_get_device_priv: 217 Invalid state
[2.799901] MAIN 0 kernel - CAM_ERR: CAM-SENSOR: cam_sensor_establish_link: 1068 Device data is NULL
[2.799961] MAIN 0 kernel - CAM_ERR: CAM-CRM: __cam_req_mgr_destroy_link_info: 1288 Unlink failed dev name cam-sensor hdl 9e0101
[2.800019] MAIN 0 kernel - CAM_ERR: CAM-CORE: __cam_req_mgr_unlink: 2346 Unlink for all devices was not successful
[2.800086] MAIN 0 kernel - CAM_INFO: CAM-CRM: cam_req_mgr_close: 228 cam_req_mgr_close:228 enable lpm
[2.800147] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_pm_qos_update_request: 117 cam_pm_qos_update_request: update request -1
[2.800207] MAIN 0 kernel - CAM_INFO: CAM-SENSOR: cam_pm_qos_remove_request: 112 cam_pm_qos_remove_request: remove request
I can help with this.
I found the bug and got it fixed, should be running smoothly now