openpilot
openpilot copied to clipboard
Exception: setup_quectel failed after retry
Describe the bug
This is running off https://github.com/commaai/opendbc/pull/1575, but I've been seeing these errors for a year now and can't seem to figure it out. Similar to https://github.com/commaai/openpilot/issues/30208, https://github.com/commaai/openpilot/issues/33996, https://github.com/commaai/openpilot/pull/28952
debugging with these changes https://github.com/commaai/openpilot/commit/f71b4282a47f163d290b5b3fc1866db1d51352f6
tmux logs with debugging (slightly shortened to fit)
waiting for weston
weston ready after 0s
ln: failed to create symbolic link '/home/comma/.cursor-server/vscode-server': File exists
/data/openpilot has been modified, skipping overlay update installation
Using Wayland-EGL
MESA: error: ZINK: vkCreateInstance failed (VK_ERROR_INCOMPATIBLE_DRIVER)
libEGL warning: egl: failed to create dri2 screen
qt.qpa.wayland: "wl-shell" is a deprecated shell extension, prefer using "xdg-shell-v6" or "xdg-shell" if supported by the compositor by setting the environment variable QT_WAYLAND_SHELL_INTEGRATION
Using the 'wl-shell' shell integration
scons: Reading SConscript files ...
scons: done reading SConscript files.
scons: Building targets ...
Retrieved `panda/board/jungle/main-panda_jungle.o' from cache
Retrieved `panda/board/jungle/main-panda_jungle_h7.o' from cache
Retrieved `panda/board/main-panda.o' from cache
Retrieved `panda/board/jungle/obj/panda_jungle_h7.elf' from cache
Retrieved `panda/board/main-panda_h7.o' from cache
Retrieved `panda/board/jungle/obj/panda_jungle_h7.bin' from cache
Retrieved `panda/board/jungle/obj/panda_jungle_h7.bin.signed' from cache
Retrieved `panda/board/obj/panda_h7.elf' from cache
Retrieved `panda/board/obj/panda_h7.bin' from cache
Retrieved `panda/board/obj/panda_h7.bin.signed' from cache
scons: done building targets.
system/loggerd/bootlog.cc: bootlog to /data/media/0/realdata/boot/000000e6--07dd0fb854.zst
gbm_create_device(156): Info: backend name is: msm_drm
updates are disabled by the DisableUpdates param
Panda 35003c000a51333038363231 connected, version: DEV-2c802449-DEBU, signature b7f6738fee2b4436, expected 620b36b3081a6d6c
flash: unlocking
INFO:panda:flash: unlocking
flash: erasing sectors 1 - 1
INFO:panda:flash: erasing sectors 1 - 1
configuring modem
Successfully set initial EPS bearer properties
selfdrive/ui/qt/network/wifi_manager.cc: Changing gsm.auto-config to true
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
: "wl-shell" is a deprecated shell extension, prefer using "xdg-shell-v6" or "xdg-shell" if supported by the compositor by setting the environment variable QT_WAYLAND_SHELL_INTEGRATION
flash: flashing
INFO:panda:flash: flashing
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
pid 321's current affinity list: 3
pid 321's new affinity list: 3
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
flash: resetting
INFO:panda:flash: resetting
logmessaged timed ui deleter pandad hardwared tombstoned updated uploader statsd
selfdrive/pandad/main.cc: starting pandad
selfdrive/pandad/pandad.cc: connecting to pandas: 35003c000a51333038363231
selfdrive/pandad/panda.cc: connected to 35003c000a51333038363231 over SPI
selfdrive/pandad/pandad.cc: connected to all pandas
system/camerad/cameras/spectra.cc: VIDIOC_CAM_CONTROL error: op_code 266 - errno 19
Waiting for CAN messages...
waiting for modem to come up
Getting VIN & FW versions
Getting VIN & FW versions
Setting OBD multiplexing to True
OBD multiplexing set successfully
system/camerad/cameras/spectra.cc: VIDIOC_CAM_CONTROL error: op_code 266 - errno 19
Unexpected opcode: 39, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 38, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 000000030000000000000004000000100900000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 000000030000000000000005000000200400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 000000030000000000000007000000ff0400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 00000003000000000000000a0000008a0300000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 00000003000000000000000b000000010200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 115, Payload: 00000003000000000000000d000000ff01000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
system/loggerd/loggerd.cc: logging to /data/media/0/realdata/00000197--5d9d371e2c--0
iso-tp query timeout while receiving response: (1975, None)
iso-tp query timeout while receiving response: (1975, None)
got vin with request=b'"\xf1\x90'
got vin with request=b'"\xf1\x90'
system/camerad/cameras/spectra.cc: VIDIOC_CAM_CONTROL error: op_code 266 - errno 19
Setting OBD multiplexing to False
OBD multiplexing set successfully
Starting listener for: camerad
Setting OBD multiplexing to True
system/loggerd/encoderd.cc: encoder road_cam_encoder init 1928x1208
system/loggerd/encoderd.cc: encoder driver_cam_encoder init 1928x1208
system/loggerd/encoderd.cc: encoder wide_road_cam_encoder init 1928x1208
OBD multiplexing set successfully
system/camerad/cameras/spectra.cc: camera 0 synced on frame_id_offset 6 timestamp 70353916321539
system/camerad/cameras/spectra.cc: camera 1 synced on frame_id_offset 6 timestamp 70353916312633
system/camerad/cameras/spectra.cc: camera 2 synced on frame_id_offset 6 timestamp 70353916284664
iso-tp query bad response: (1971, None) - 0x7f2231
iso-tp query bad response: (1971, None) - 0x7f2231
Setting OBD multiplexing to False
OBD multiplexing set successfully
iso-tp query bad response: (1971, None) - 0x7f2231
iso-tp query bad response: (1971, None) - 0x7f2231
iso-tp query bad response: (2000, None) - 0x7f2231
iso-tp query bad response: (2000, None) - 0x7f2231
iso-tp query bad response: (1988, None) - 0x7f2231
iso-tp query bad response: (1988, None) - 0x7f2231
iso-tp query bad response: (1975, None) - 0x7f2231
iso-tp query bad response: (1975, None) - 0x7f2231
modeld init
setting up CL context
CL context ready; loading model
iso-tp query bad response: (2000, None) - 0x7f2231
iso-tp query bad response: (2000, None) - 0x7f2231
VIN 10101010101010101
VIN 10101010101010101
models loaded, dmonitoringmodeld starting
connecting to driver stream
connected with buffer size: 4804608
models loaded, modeld starting
vision stream set up, main_wide_camera: False, use_extra_client: True
connected main cam with buffer size: 4804608 (1928 x 1208)
connected extra cam with buffer size: 4804608 (1928 x 1208)
{'event': 'fingerprinted', 'car_fingerprint': 'HYUNDAI_SONATA_HEV_2024', 'source': 1, 'fuzzy': False, 'cached': False, 'fw_count': 10, 'ecu_responses': [(1998, None, 0), (1979, None, 0), (1996, None, 1), (2008, None, 1), (1996, None, 0), (2008, None, 0),
(1979, None, 1), (1998, None, 1)], 'vin_rx_addr': 1998, 'vin_rx_bus': 0, 'fingerprints': '{0: {554: 32, 261: 32, 384: 8, 389: 8, 426: 16, 96: 32, 160: 24, 111: 8, 453: 32, 549: 16, 560: 32, 597: 32, 666: 8, 266: 32, 288: 32, 784: 32, 357: 24, 368: 16, 74:
32, 304: 16, 139: 8, 463: 8, 69: 24, 1096: 8, 101: 32, 373: 24, 352: 16, 282: 16, 298: 16, 354: 32, 346: 8, 234: 24, 293: 16, 309: 16, 186: 32, 224: 32, 250: 32, 1027: 8, 362: 32, 1392: 32, 592: 24, 144: 32, 325: 32, 416: 32, 432: 32, 442: 24, 485: 16, 6
88: 32, 725: 32, 330: 24, 874: 16, 501: 32, 896: 8, 602: 32, 898: 8, 899: 8, 900: 8, 908: 32, 945: 8, 946: 8, 1037: 8, 1063: 8, 1065: 8, 1066: 8, 480: 16, 565: 32, 762: 32, 769: 8, 648: 8, 353: 32, 512: 8, 933: 8, 496: 16, 534: 32, 1024: 8, 437: 32, 1280:
32, 385: 32, 522: 16, 506: 32, 1099: 8, 703: 8, 1151: 8, 879: 8, 721: 8, 722: 8, 724: 8, 723: 8, 817: 8, 818: 8, 819: 8, 820: 8, 1204: 8, 1245: 8, 1247: 8, 1239: 8, 1240: 8, 1259: 8, 1052: 8, 902: 8, 904: 8, 1018: 16, 934: 8, 895: 8, 613: 32, 571: 32, 83
2: 32, 517: 24, 767: 8, 789: 16, 906: 16, 1138: 8, 192: 32, 1029: 8, 1040: 8, 1041: 8, 1046: 8, 1042: 8, 1047: 8, 1043: 8, 1048: 8, 1044: 8, 1162: 16, 1109: 8, 210: 8, 928: 16, 914: 8, 255: 8, 915: 8, 916: 8, 963: 8, 997: 8, 977: 8, 994: 8, 992: 8, 998: 8
, 993: 8, 1032: 8, 1036: 8, 1050: 8, 1051: 8, 1058: 8, 1061: 8, 1072: 8, 1074: 8, 1077: 8, 1076: 8, 1088: 8, 1090: 8, 1092: 8, 1093: 8, 1097: 8, 1141: 8, 1174: 8, 1108: 8, 1160: 8, 1161: 8, 90: 32, 1187: 8, 654: 24, 670: 24, 732: 24, 936: 8, 937: 8, 940:
8, 941: 8, 1033: 8, 1142: 8, 1143: 8, 1055: 8, 1167: 8, 849: 8, 881: 8, 850: 8, 851: 8, 852: 8, 882: 8, 883: 8, 884: 8, 1015: 8, 1016: 8, 1264: 8, 1266: 8, 1267: 8, 1157: 8, 794: 32, 842: 32, 1008: 32, 970: 16, 1549: 8}, 1: {272: 32, 256: 24, 976: 32, 977
: 32, 978: 32, 979: 32, 980: 32, 917: 32, 933: 24, 934: 24, 935: 24, 936: 24, 937: 24, 938: 24, 939: 24, 940: 24, 941: 24, 942: 24, 943: 24, 944: 24, 945: 24, 946: 24, 947: 24, 948: 24, 949: 24, 950: 24, 951: 24, 952: 24, 953: 24, 954: 24, 955: 24, 956: 2
4, 957: 24, 958: 24, 959: 24, 960: 24, 961: 24, 962: 24, 963: 24, 964: 24, 928: 32}, 2: {554: 32, 261: 32, 384: 8, 389: 8, 426: 16, 96: 32, 160: 24, 111: 8, 453: 32, 549: 16, 560: 32, 597: 32, 666: 8, 266: 32, 288: 32, 784: 32, 357: 24, 368: 16, 74: 32, 3
04: 16, 139: 8, 463: 8, 69: 24, 1096: 8, 101: 32, 373: 24, 352: 16, 282: 16, 298: 16, 354: 32, 346: 8, 234: 24, 293: 16, 309: 16, 186: 32, 224: 32, 250: 32, 1027: 8, 362: 32, 1392: 32, 592: 24, 144: 32, 325: 32, 416: 32, 432: 32, 442: 24, 485: 16, 688: 32
, 725: 32, 330: 24, 874: 16, 501: 32, 896: 8, 602: 32, 898: 8, 899: 8, 900: 8, 908: 32, 945: 8, 946: 8, 1037: 8, 1063: 8, 1065: 8, 1066: 8, 480: 16, 565: 32, 762: 32, 769: 8, 648: 8, 353: 32, 512: 8, 933: 8, 496: 16, 534: 32, 1024: 8, 437: 32, 1280: 32, 3
85: 32, 522: 16, 506: 32, 1099: 8, 703: 8, 1151: 8, 879: 8, 721: 8, 722: 8, 724: 8, 723: 8, 817: 8, 818: 8, 819: 8, 820: 8, 1204: 8, 1245: 8, 1247: 8, 1239: 8, 1240: 8, 1259: 8, 1052: 8, 902: 8, 904: 8, 1018: 16, 934: 8, 895: 8, 613: 32, 571: 32, 832: 32,
517: 24, 767: 8, 789: 16, 906: 16, 1138: 8, 192: 32, 1029: 8, 1040: 8, 1041: 8, 1046: 8, 1042: 8, 1047: 8, 1043: 8, 1048: 8, 1044: 8, 1162: 16, 1109: 8, 210: 8, 928: 16, 914: 8, 255: 8, 915: 8, 916: 8, 963: 8, 997: 8, 977: 8, 994: 8, 992: 8, 998: 8, 993:
8, 1032: 8, 1036: 8, 1050: 8, 1051: 8, 1058: 8, 1061: 8, 1072: 8, 1074: 8, 1077: 8, 1076: 8, 1088: 8, 1090: 8, 1092: 8, 1093: 8, 1097: 8, 1141: 8, 1174: 8, 1108: 8, 1160: 8, 1161: 8, 90: 32, 1187: 8, 654: 24, 670: 24, 732: 24, 936: 8, 937: 8, 940: 8, 941
: 8, 1033: 8, 1142: 8, 1143: 8, 1055: 8, 1167: 8, 849: 8, 881: 8, 850: 8, 851: 8, 852: 8, 882: 8, 883: 8, 884: 8, 1015: 8, 1016: 8, 1264: 8, 1266: 8, 1267: 8, 1157: 8, 794: 32, 842: 32, 1008: 32, 970: 16, 1549: 8}, 3: {}, 4: {}, 5: {}, 6: {}, 7: {}}', 'fw
_query_time': 1.9623974319983972}
{'event': 'fingerprinted', 'car_fingerprint': 'HYUNDAI_SONATA_HEV_2024', 'source': 1, 'fuzzy': False, 'cached': False, 'fw_count': 10, 'ecu_responses': [(1998, None, 0), (1979, None, 0), (1996, None, 1), (2008, None, 1), (1996, None, 0), (2008, None, 0),
(1979, None, 1), (1998, None, 1)], 'vin_rx_addr': 1998, 'vin_rx_bus': 0, 'fingerprints': '{0: {554: 32, 261: 32, 384: 8, 389: 8, 426: 16, 96: 32, 160: 24, 111: 8, 453: 32, 549: 16, 560: 32, 597: 32, 666: 8, 266: 32, 288: 32, 784: 32, 357: 24, 368: 16, 74:
32, 304: 16, 139: 8, 463: 8, 69: 24, 1096: 8, 101: 32, 373: 24, 352: 16, 282: 16, 298: 16, 354: 32, 346: 8, 234: 24, 293: 16, 309: 16, 186: 32, 224: 32, 250: 32, 1027: 8, 362: 32, 1392: 32, 592: 24, 144: 32, 325: 32, 416: 32, 432: 32, 442: 24, 485: 16, 6
88: 32, 725: 32, 330: 24, 874: 16, 501: 32, 896: 8, 602: 32, 898: 8, 899: 8, 900: 8, 908: 32, 945: 8, 946: 8, 1037: 8, 1063: 8, 1065: 8, 1066: 8, 480: 16, 565: 32, 762: 32, 769: 8, 648: 8, 353: 32, 512: 8, 933: 8, 496: 16, 534: 32, 1024: 8, 437: 32, 1280:
32, 385: 32, 522: 16, 506: 32, 1099: 8, 703: 8, 1151: 8, 879: 8, 721: 8, 722: 8, 724: 8, 723: 8, 817: 8, 818: 8, 819: 8, 820: 8, 1204: 8, 1245: 8, 1247: 8, 1239: 8, 1240: 8, 1259: 8, 1052: 8, 902: 8, 904: 8, 1018: 16, 934: 8, 895: 8, 613: 32, 571: 32, 83
2: 32, 517: 24, 767: 8, 789: 16, 906: 16, 1138: 8, 192: 32, 1029: 8, 1040: 8, 1041: 8, 1046: 8, 1042: 8, 1047: 8, 1043: 8, 1048: 8, 1044: 8, 1162: 16, 1109: 8, 210: 8, 928: 16, 914: 8, 255: 8, 915: 8, 916: 8, 963: 8, 997: 8, 977: 8, 994: 8, 992: 8, 998: 8
, 993: 8, 1032: 8, 1036: 8, 1050: 8, 1051: 8, 1058: 8, 1061: 8, 1072: 8, 1074: 8, 1077: 8, 1076: 8, 1088: 8, 1090: 8, 1092: 8, 1093: 8, 1097: 8, 1141: 8, 1174: 8, 1108: 8, 1160: 8, 1161: 8, 90: 32, 1187: 8, 654: 24, 670: 24, 732: 24, 936: 8, 937: 8, 940:
8, 941: 8, 1033: 8, 1142: 8, 1143: 8, 1055: 8, 1167: 8, 849: 8, 881: 8, 850: 8, 851: 8, 852: 8, 882: 8, 883: 8, 884: 8, 1015: 8, 1016: 8, 1264: 8, 1266: 8, 1267: 8, 1157: 8, 794: 32, 842: 32, 1008: 32, 970: 16, 1549: 8}, 1: {272: 32, 256: 24, 976: 32, 977
: 32, 978: 32, 979: 32, 980: 32, 917: 32, 933: 24, 934: 24, 935: 24, 936: 24, 937: 24, 938: 24, 939: 24, 940: 24, 941: 24, 942: 24, 943: 24, 944: 24, 945: 24, 946: 24, 947: 24, 948: 24, 949: 24, 950: 24, 951: 24, 952: 24, 953: 24, 954: 24, 955: 24, 956: 2
4, 957: 24, 958: 24, 959: 24, 960: 24, 961: 24, 962: 24, 963: 24, 964: 24, 928: 32}, 2: {554: 32, 261: 32, 384: 8, 389: 8, 426: 16, 96: 32, 160: 24, 111: 8, 453: 32, 549: 16, 560: 32, 597: 32, 666: 8, 266: 32, 288: 32, 784: 32, 357: 24, 368: 16, 74: 32, 3
04: 16, 139: 8, 463: 8, 69: 24, 1096: 8, 101: 32, 373: 24, 352: 16, 282: 16, 298: 16, 354: 32, 346: 8, 234: 24, 293: 16, 309: 16, 186: 32, 224: 32, 250: 32, 1027: 8, 362: 32, 1392: 32, 592: 24, 144: 32, 325: 32, 416: 32, 432: 32, 442: 24, 485: 16, 688: 32
, 725: 32, 330: 24, 874: 16, 501: 32, 896: 8, 602: 32, 898: 8, 899: 8, 900: 8, 908: 32, 945: 8, 946: 8, 1037: 8, 1063: 8, 1065: 8, 1066: 8, 480: 16, 565: 32, 762: 32, 769: 8, 648: 8, 353: 32, 512: 8, 933: 8, 496: 16, 534: 32, 1024: 8, 437: 32, 1280: 32, 3
85: 32, 522: 16, 506: 32, 1099: 8, 703: 8, 1151: 8, 879: 8, 721: 8, 722: 8, 724: 8, 723: 8, 817: 8, 818: 8, 819: 8, 820: 8, 1204: 8, 1245: 8, 1247: 8, 1239: 8, 1240: 8, 1259: 8, 1052: 8, 902: 8, 904: 8, 1018: 16, 934: 8, 895: 8, 613: 32, 571: 32, 832: 32,
517: 24, 767: 8, 789: 16, 906: 16, 1138: 8, 192: 32, 1029: 8, 1040: 8, 1041: 8, 1046: 8, 1042: 8, 1047: 8, 1043: 8, 1048: 8, 1044: 8, 1162: 16, 1109: 8, 210: 8, 928: 16, 914: 8, 255: 8, 915: 8, 916: 8, 963: 8, 997: 8, 977: 8, 994: 8, 992: 8, 998: 8, 993:
8, 1032: 8, 1036: 8, 1050: 8, 1051: 8, 1058: 8, 1061: 8, 1072: 8, 1074: 8, 1077: 8, 1076: 8, 1088: 8, 1090: 8, 1092: 8, 1093: 8, 1097: 8, 1141: 8, 1174: 8, 1108: 8, 1160: 8, 1161: 8, 90: 32, 1187: 8, 654: 24, 670: 24, 732: 24, 936: 8, 937: 8, 940: 8, 941
: 8, 1033: 8, 1142: 8, 1143: 8, 1055: 8, 1167: 8, 849: 8, 881: 8, 850: 8, 851: 8, 852: 8, 882: 8, 883: 8, 884: 8, 1015: 8, 1016: 8, 1264: 8, 1266: 8, 1267: 8, 1157: 8, 794: 32, 842: 32, 1008: 32, 970: 16, 1549: 8}, 3: {}, 4: {}, 5: {}, 6: {}, 7: {}}', 'fw
_query_time': 1.9623974319983972}
selfdrive/pandad/panda_safety.cc: Finished FW query, Waiting for params to set safety model
skipping model eval. Dropped 40 frames
skipping model eval. Dropped 1 frames
Assertion Failed: Expected CRC: 2f29, Received CRC: c5f3, Payload: 1000c908c9087614d3286bb2cf6b09010a1ce1b6000800000000c100060000000004000000000034097015950308ab01a09a39040000000080573e1087aee63f4a2a519f74b1f4bf18db074233d2664031dbdb3f00000080000000800000
0000e1abdf3edb06df3e16e2253efbdde5c7370af442000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f621249000000000f6212490000000000000000a25
9a33c173bf240a181be411c36a73e7fa0a241e450fc4003461340e8dc0440b2257e3f94c78e3f0caa23402753f7664250ab11425d26104288bd56410303000033d2664031dbdb3f0000000000000000020c030a00000000000000010000000000000000000000000000000000000000000000000000010100008000d3bf4142
a96f573e6e18d2440f2d2741010800005c0069ac634135e97a3f8ed9d1440d02274100070000000000000000000000000000000000000000000d0000000000000000000000000000000000000000000e00000000000000000000000000000000000000000011000000000000000000000000000000000000000000160000000
000000000000000000000000000000000001b0000000000000000000000000000000000000000001e00000000000000000000000000000000000000000002000000000000000000000000000000000000000000090000000000000000000000000000000000000000000a000000000000000000000000000000000000000003
4e00f94f0063be4bc28ed0b1be71b4e84328314440034f00004f0007c332c2c22cbb3f64f2d744295c3041035800024f00696a7342a8df8dbd5466a44440350d4102510004000000000000000000000000000000000000024600fc000000000000000000000000000000000000025200fd00000000000000000000000000000
0000000024d00fe000000000000000000000000000000000000025000ff00000000000000000000000000000000000002450001000000000000000000000000000000000000025700030000000000000000000000000000000000000a8700000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000
setup_quectel failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 191, in setup_quectel
send_recv(diag, DIAG_SUBSYS_CMD_F, pack('<BHBBIIII',
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 70, in send_recv
opcode, payload = diag.recv()
^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 53, in recv
unframed_message = self.hdlc_decapsulate(raw_payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 40, in hdlc_decapsulate
assert received_crc == computed_crc
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
{"event": "selfdrived.initialized", "dt": 1.23, "timeout": false, "canValid": true, "invalid": ["alertDebug", "gpsLocation"], "not_alive": ["alertDebug", "gpsLocation"], "not_freq_ok": ["alertDebug", "gpsLocation"], "error": true}
selfdrive/pandad/panda_safety.cc: got 1344 bytes CarParams
selfdrive/pandad/panda_safety.cc: Panda 0: setting safety model: 28, param: 1034, alternative experience: 1
Assertion Failed: Expected CRC: 4e07, Received CRC: ae36, Payload: 10003b073b07de1469556acbcf6b090102000103032300015c00b7007c0000006d483104000000001200aa60bf3b2b05a6363409503295033fc5a1bd112c394408000000000000000000000000000000008e09a13ddcb89f410200000000
0000000000000000000000000000000006300000050000007575000200d6011b00000000000000800c000000005605a23e76490400d946a23b94b8abbf23526f425605a23e76490400da8a9d3b94b8abbf23526f42000000000001000000000000000000000000000000000000000000000000000000007fa2b600000001000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004b0d6400c
a000100000001000000040000000000000000000000
setup_quectel failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 147, in setup_quectel
send_recv(diag, DIAG_NV_WRITE_F, pack('<HI', NV_GNSS_OEM_FEATURE_MASK, 1))
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 70, in send_recv
opcode, payload = diag.recv()
^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 53, in recv
unframed_message = self.hdlc_decapsulate(raw_payload)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 40, in hdlc_decapsulate
assert received_crc == computed_crc
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 39, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 39, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 38, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Assertion Failed: Operation=0, Status=65536, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
setup_quectel failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 150, in setup_quectel
try_setup_logs(diag, LOG_TYPES)
File "/data/openpilot/openpilot/common/retry.py", line 21, in wrapper
raise Exception(f"{func.__name__} failed after retry")
Exception: try_setup_logs failed after retry
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 39, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 38, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Assertion Failed: Operation=0, Status=65536, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
setup_quectel failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 150, in setup_quectel
try_setup_logs(diag, LOG_TYPES)
File "/data/openpilot/openpilot/common/retry.py", line 21, in wrapper
raise Exception(f"{func.__name__} failed after retry")
Exception: try_setup_logs failed after retry
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Unexpected opcode: 39, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Unexpected opcode: 38, Payload: fd1b010000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000
Assertion Failed: Operation=0, Status=65536, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000030000000000000001000000020a00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000c0000100000000000000000000400200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
Assertion Failed: Operation=3, Status=0, Expected=1, 0
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 84, in setup_logs
assert operation == LOG_CONFIG_RETRIEVE_ID_RANGES_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
Unexpected opcode: 115, Payload: 000000010000000000000000000000020a00000000000000000000100900002004000000000000ff04000000000000000000008a0300000102000000000000ff0100000000000000000000
try_setup_logs failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 91, in try_setup_logs
return setup_logs(diag, logs)
^^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/system/qcomgpsd/modemdiag.py", line 102, in setup_logs
assert operation == LOG_CONFIG_SET_MASK_OP
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
setup_quectel failed, trying again
Traceback (most recent call last):
File "/data/openpilot/openpilot/common/retry.py", line 13, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 150, in setup_quectel
try_setup_logs(diag, LOG_TYPES)
File "/data/openpilot/openpilot/common/retry.py", line 21, in wrapper
raise Exception(f"{func.__name__} failed after retry")
Exception: try_setup_logs failed after retry
crash
Traceback (most recent call last):
File "/data/openpilot/openpilot/system/manager/process.py", line 41, in launcher
mod.main()
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 259, in main
r = setup_quectel(diag)
^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/common/retry.py", line 21, in wrapper
raise Exception(f"{func.__name__} failed after retry")
Exception: setup_quectel failed after retry
Process qcomgpsd:
Traceback (most recent call last):
File "/usr/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap
self.run()
File "/usr/lib/python3.12/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/data/openpilot/openpilot/system/manager/process.py", line 41, in launcher
mod.main()
File "/data/openpilot/system/qcomgpsd/qcomgpsd.py", line 259, in main
r = setup_quectel(diag)
^^^^^^^^^^^^^^^^^^^
File "/data/openpilot/openpilot/common/retry.py", line 21, in wrapper
raise Exception(f"{func.__name__} failed after retry")
Exception: setup_quectel failed after retry
{"event": "process_not_running", "not_running": "{'qcomgpsd'}", "error": true}
modem info
-----------------------------------
General | path: /org/freedesktop/ModemManager1/Modem/0
| device id: b781082e030d4f36e65682e2ad71af1bdfe2682e
-----------------------------------
Hardware | manufacturer: QUALCOMM INCORPORATED
| model: QUECTEL Mobile Broadband Module
| firmware revision: EG25GGBR07A08M2G
| carrier config: Commercial-TMO_VoLTE
| carrier config revision: 05010505
| h/w revision: 10000
| supported: gsm-umts, lte
| current: gsm-umts, lte
| equipment id: 101010101010101
-----------------------------------
System | device: /sys/devices/platform/soc/a800000.ssusb/a800000.dwc3/xhci-hcd.0.auto/usb1/1-1
| physdev: /sys/devices/platform/soc/a800000.ssusb/a800000.dwc3/xhci-hcd.0.auto/usb1/1-1
| drivers: option, qmi_wwan
| plugin: quectel
| primary port: cdc-wdm0
| ports: cdc-wdm0 (qmi), ttyUSB1 (gps), ttyUSB2 (at), ttyUSB3 (at),
| wwan0 (net)
-----------------------------------
Numbers | own: 10101010101
-----------------------------------
Status | lock: sim-pin2
| unlock retries: sim-pin (3), sim-puk (10), sim-pin2 (10), sim-puk2 (10)
| state: connected
| power state: on
| access tech: lte
| signal quality: 100% (recent)
-----------------------------------
Modes | supported: allowed: 2g; preferred: none
| allowed: 3g; preferred: none
| allowed: 4g; preferred: none
| allowed: 2g, 3g; preferred: 3g
| allowed: 2g, 3g; preferred: 2g
| allowed: 2g, 4g; preferred: 4g
| allowed: 2g, 4g; preferred: 2g
| allowed: 3g, 4g; preferred: 4g
| allowed: 3g, 4g; preferred: 3g
| allowed: 2g, 3g, 4g; preferred: 4g
| allowed: 2g, 3g, 4g; preferred: 3g
| allowed: 2g, 3g, 4g; preferred: 2g
| current: allowed: 4g; preferred: none
-----------------------------------
Bands | supported: egsm, dcs, pcs, g850, utran-1, utran-4, utran-6, utran-5,
| utran-8, utran-2, eutran-1, eutran-2, eutran-3, eutran-4, eutran-5,
| eutran-7, eutran-8, eutran-12, eutran-13, eutran-18, eutran-19,
| eutran-20, eutran-25, eutran-26, eutran-28, eutran-38, eutran-39,
| eutran-40, eutran-41, utran-19
| current: egsm, dcs, pcs, g850, utran-1, utran-4, utran-6, utran-5,
| utran-8, utran-2, eutran-1, eutran-2, eutran-3, eutran-4, eutran-5,
| eutran-7, eutran-8, eutran-12, eutran-13, eutran-18, eutran-19,
| eutran-20, eutran-25, eutran-26, eutran-28, eutran-38, eutran-39,
| eutran-40, eutran-41, utran-19
-----------------------------------
IP | supported: ipv4, ipv6, ipv4v6
-----------------------------------
3GPP | imei: 101010101010101
| enabled locks: fixed-dialing
| operator id: 310260
| operator name: T-Mobile
| registration: home
| packet service state: attached
-----------------------------------
3GPP EPS | ue mode of operation: csps-2
| initial bearer path: /org/freedesktop/ModemManager1/Bearer/0
| initial bearer ip type: ipv4
-----------------------------------
SIM | primary sim path: /org/freedesktop/ModemManager1/SIM/0
-----------------------------------
Bearer | paths: /org/freedesktop/ModemManager1/Bearer/1
Provide a route where the issue occurs
e6fd6ef0e9cc1171/00000197--5d9d371e2c
openpilot version
master
I don't see anyone hitting this in release. Are you using external storage or something?
I'm holding off on playing with external storage for now. Normally see it while making local port changes and using op start. Recently started fresh, I'll report back if I see it again.
Just happened again. Clear skys, no usb/joy/aux, using hotspot. Modified files through ssh, op start, and same error. A second op start usually does the trick, maybe in combination with car restart. (port behind master by 3 days, will update)
e6fd6ef0e9cc1171/0000008e--6b282424ad
Confirmed by another user, it sometimes happens when using op start and not rebooting the device. Maybe qcomgpsd doesn't like the way op is restarted.