RIOT icon indicating copy to clipboard operation
RIOT copied to clipboard

[Tracking] Fix failures of test-on-iotlab

Open mguetschow opened this issue 1 year ago • 1 comments

Description

Several tests have been failing for quite some time on specific boards in the test-on-iotlab action. They are not strictly part of the release-specs task02 as of now, but do indicate bugs in RIOT for specific boards. This issue collects constantly failing test-board combinations and should be used to coordinate fixing.

ERROR:dwm1001:Tests failed: 3
Failures during test:
- [tests/periph/timer_periodic](tests/periph/timer_periodic/test.failed)
- [tests/pkg/lz4](tests/pkg/lz4/test.failed)
- [tests/pkg/uzlib](tests/pkg/uzlib/test.failed)

ERROR:iotlab-m3:Tests failed: 3
Failures during test:
- [tests/drivers/mtd_flashpage](tests/drivers/mtd_flashpage/test.failed)
- [tests/net/gcoap_dns](tests/net/gcoap_dns/test.failed)
- [tests/pkg/libschc](tests/pkg/libschc/test.failed)

ERROR:nrf52dk:Tests failed: 5
Failures during test:
- [tests/pkg/lz4](tests/pkg/lz4/test.failed)
- [tests/pkg/uzlib](tests/pkg/uzlib/test.failed)
- [tests/sys/congure_abe](tests/sys/congure_abe/test.failed)
Failures during test.flash:
- [tests/sys/cb_mux_bench](tests/sys/cb_mux_bench/test.flash.failed)
- [tests/sys/xtimer_hang](tests/sys/xtimer_hang/test.flash.failed)

ERROR:samr34-xpro:Tests failed: 4
Failures during compilation:
- [tests/turo_txt](tests/turo_txt/compilation.failed)
Failures during test:
- [tests/drivers/mtd_raw](tests/drivers/mtd_raw/test.failed)
- [tests/periph/rtt](tests/periph/rtt/test.failed)
- [tests/sys/dbgpin](tests/sys/dbgpin/test.failed)

ERROR:b-l072z-lrwan1:Tests failed: 1
Failures during test:
- [tests/pkg/libschc](tests/pkg/libschc/test.failed)

The failure during compilation on the samr34-xpro was apparently due to insufficient space on the action runner. Not sure how to cope with this.

Useful links

The list was initially compiled from the Workflow Action on the 2024.07-RC1, and has been compared to several recent master and the 2024.04-RC2 workflow.

mguetschow avatar Jul 18 '24 10:07 mguetschow

I think tests/periph/timer_periodic and tests/pkg/libschc have always been flakey or failing with IoTLabs. I should look at tests/turo_txt. I thought the mtd ones were fixed but maybe not... I can take a closer look on Monday :)

MrKevinWeiss avatar Jul 18 '24 13:07 MrKevinWeiss