esp-adf
esp-adf copied to clipboard
espressif
WWE example with ENCODER trigger task watchdog after enter REC_START status. (AUD-5935)
Environment
- Audio development kit: [ESP32-S3-Korvo-2]
- Audio kit version (for ESP32-S3-Korvo-2): [v3]
- [Required] Module or chip used: [ESP32-S3-WROOM-1]
- [Required] IDF version : v5.3.1
- [Required] ADF version : v2.7-34-g8a3b56a9
- Build system: [idf.py]
- [Required] Running log:
Tips for collapsed Running log
/home/user/esp/esp-adf/examples/speech_recognition/wwe/build/example_wwe.elf'
--- esp-idf-monitor 1.5.0 on /dev/ttyACM1 115200
--- Quit: Ctrl+] | Menu: Ctrl+T | Help: Ctrl+T followed by Ctrl+H
ESP-ROM:esp32s3-20210327
Build:Mar 27 2021
rst:0x1 (POWERON),boot:0xa (SPI_FAST_FLASH_BOOT)
SPIWP:0xee
mode:DIO, clock div:1
load:0x3fce2820,len:0x1918
load:0x403c8700,len:0x4
load:0x403c8704,len:0xe5c
load:0x403cb700,len:0x303c
entry 0x403c893c
I (27) boot: ESP-IDF v5.3.1-dirty 2nd stage bootloader
I (27) boot: compile time Dec 22 2024 13:42:21
I (27) boot: Multicore bootloader
I (30) boot: chip revision: v0.2
I (34) qio_mode: Enabling default flash chip QIO
I (39) boot.esp32s3: Boot SPI Speed : 80MHz
I (44) boot.esp32s3: SPI Mode : QIO
I (49) boot.esp32s3: SPI Flash Size : 16MB
I (54) boot: Enabling RNG early entropy source...
I (59) boot: Partition Table:
I (63) boot: ## Label Usage Type ST Offset Length
I (70) boot: 0 nvs WiFi data 01 02 00009000 00004000
I (78) boot: 1 otadata OTA data 01 00 0000d000 00002000
I (85) boot: 2 phy_init RF data 01 01 0000f000 00001000
I (92) boot: 3 ota_0 OTA app 00 10 00010000 00290000
I (100) boot: 4 model Unknown data 01 82 002a0000 00500000
I (108) boot: 5 flash_tone Unknown data 01 27 007a0000 00032000
I (115) boot: End of partition table
I (119) esp_image: segment 0: paddr=00010020 vaddr=3c090020 size=33f40h (212800) map
I (160) esp_image: segment 1: paddr=00043f68 vaddr=3fc99e00 size=0551ch ( 21788) load
I (164) esp_image: segment 2: paddr=0004948c vaddr=40378000 size=06b8ch ( 27532) load
I (171) esp_image: segment 3: paddr=00050020 vaddr=42000020 size=8f1a8h (586152) map
I (263) esp_image: segment 4: paddr=000df1d0 vaddr=4037eb8c size=0b1bch ( 45500) load
I (280) boot: Loaded app from partition at offset 0x10000
I (280) boot: Disabling RNG early entropy source...
I (292) octal_psram: vendor id : 0x0d (AP)
I (292) octal_psram: dev id : 0x02 (generation 3)
I (292) octal_psram: density : 0x03 (64 Mbit)
I (297) octal_psram: good-die : 0x01 (Pass)
I (302) octal_psram: Latency : 0x01 (Fixed)
I (308) octal_psram: VCC : 0x01 (3V)
I (313) octal_psram: SRF : 0x01 (Fast Refresh)
I (319) octal_psram: BurstType : 0x01 (Hybrid Wrap)
I (324) octal_psram: BurstLen : 0x01 (32 Byte)
I (330) octal_psram: Readlatency : 0x02 (10 cycles@Fixed)
I (336) octal_psram: DriveStrength: 0x00 (1/1)
I (342) MSPI Timing: PSRAM timing tuning index: 4
I (346) esp_psram: Found 8MB PSRAM device
I (351) esp_psram: Speed: 80MHz
I (355) cpu_start: Multicore app
I (641) esp_psram: SPI SRAM memory test OK
I (649) cpu_start: Pro cpu start user code
I (650) cpu_start: cpu freq: 240000000 Hz
I (650) app_init: Application information:
I (652) app_init: Project name: example_wwe
I (658) app_init: App version: v2.7-34-g8a3b56a9-dirty
I (664) app_init: Compile time: Dec 22 2024 13:42:14
I (670) app_init: ELF file SHA256: 628c9ba85...
I (675) app_init: ESP-IDF: v5.3.1-dirty
I (681) efuse_init: Min chip rev: v0.0
I (685) efuse_init: Max chip rev: v0.99
I (690) efuse_init: Chip rev: v0.2
I (695) heap_init: Initializing. RAM available for dynamic allocation:
I (702) heap_init: At 3FCA04B8 len 00049258 (292 KiB): RAM
I (708) heap_init: At 3FCE9710 len 00005724 (21 KiB): RAM
I (714) heap_init: At 600FE100 len 00001EE8 (7 KiB): RTCRAM
I (721) esp_psram: Adding pool of 8192K of PSRAM memory to heap allocator
I (729) spi_flash: detected chip: gd
I (732) spi_flash: flash io: qio
W (737) ADC: legacy driver is deprecated, please migrate to `esp_adc/adc_oneshot.h`
I (745) sleep: Configure to isolate all GPIO pins in sleep state
I (752) sleep: Enable automatic switching of GPIO sleep configuration
I (759) main_task: Started on CPU0
I (779) esp_psram: Reserving pool of 32K of internal memory for DMA/internal allocations
I (779) main_task: Calling app_main()
W (779) i2c_bus_v2: I2C master handle is NULL, will create new one
I (789) gpio: GPIO[17]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0
I (799) gpio: GPIO[18]| InputEn: 1| OutputEn: 1| OpenDrain: 1| Pullup: 1| Pulldown: 0| Intr:0
I (809) DRV8311: ES8311 in Slave mode
I (819) gpio: GPIO[48]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0
I (829) ES7210: ES7210 in Slave mode
I (839) ES7210: Enable ES7210_INPUT_MIC1
I (839) ES7210: Enable ES7210_INPUT_MIC2
I (839) ES7210: Enable ES7210_INPUT_MIC3
W (849) ES7210: Enable TDM mode. ES7210_SDP_INTERFACE2_REG12: 2
I (849) ES7210: config fmt 60
W (849) AUDIO_BOARD: The board has already been initialized!
----------------------------- ESP Audio Platform -----------------------------
| |
| ESP_AUDIO-v1.8.0-10-g0cdd7ac-017893b-58c87be |
| Compile date: Sep 27 2024-03:07:25 |
------------------------------------------------------------------------------
I (899) wwe_example: Func:setup_player, Line:140, MEM Total:8634888 Bytes, Inter:296619 Bytes, Dram:296619 Bytes, Dram largest free:233472Bytes
I (909) wwe_example: esp_audio instance is:0x3c0d2d44
I (909) wwe_example: Recorder has been created
I (919) MODEL_LOADER: The storage free size is 23744 KB
I (919) MODEL_LOADER: The partition size is 5120 KB
I (929) MODEL_LOADER: Successfully load srmodels
I (929) RECORDER_SR: The first wakenet model: wn9_hilexin
I (939) AFE_SR: afe interface for speech recognition
I (949) AFE_SR: AFE version: SR_V220727
I (949) AFE_SR: Initial auido front-end, total channel: 3, mic num: 2, ref num: 1
I (959) AFE_SR: aec_init: 1, se_init: 1, vad_init: 1
I (959) AFE_SR: wakenet_init: 1
MC Quantized wakenet9: wakenet9_v1h24_嗨，乐鑫_3_0.608_0.615, tigger:v3, mode:2, p:0, (Sep 4 2024 11:49:31)
I (1229) AFE_SR: wake num: 3, mode: 0, (Sep 4 2024 11:49:31)
Build fst from commands.
Quantized MultiNet6:rnnt_ctc_1.0, name:mn6_cn, (Sep 4 2024 11:49:30)
Quantized MultiNet6 search method: 2, time out:5.8 s
I (2159) main_task: Returned from app_main()
I (4609) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_START
I (4609) wwe_example: wakeup: vol -42.704773, mod idx 1, word idx 1
I (4619) CODEC_ELEMENT_HELPER: The element is 0x3c0d41a8. The reserve data 2 is 0x0.
I (11089) RECORDER_SR: MN dect quit
I (14609) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_END
I (14609) wwe_example: Func:rec_engine_cb, Line:266, MEM Total:3236360 Bytes, Inter:238055 Bytes, Dram:238055 Bytes, Dram largest free:139264Bytes
I (17289) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_START
I (17289) wwe_example: wakeup: vol -33.481808, mod idx 1, word idx 1
I (17299) CODEC_ELEMENT_HELPER: The element is 0x3c0d41a8. The reserve data 2 is 0x0.
I (18899) wwe_example: rec_engine_cb - REC_EVENT_VAD_START
W (18909) wwe_example: voice read begin
I (18939) AMRNB_ENCODER: amrnb open
I (20419) wwe_example: rec_engine_cb - REC_EVENT_VAD_STOP
W (20429) wwe_example: voice read stopped
I (21319) wwe_example: rec_engine_cb - REC_EVENT_WAKEUP_END
I (21319) wwe_example: Func:rec_engine_cb, Line:266, MEM Total:3208848 Bytes, Inter:236159 Bytes, Dram:236159 Bytes, Dram largest free:139264Bytes
E (28899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (28899) task_wdt: - IDLE0 (CPU 0)
E (28899) task_wdt: Tasks currently running:
E (28899) task_wdt: CPU 0: afe_mase
E (28899) task_wdt: CPU 1: IDLE1
E (28899) task_wdt: Print CPU 0 (current core) backtrace
Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42083A69:0x3FCB7250 0x42038EC8:0x3FCB7270 0x42034D56:0x3FCB7290 0x4203296A:0x3FCB72E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
(inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42083a69: direct_radix2_bit_reverse at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/fft_s16.c:32
0x42038ec8: test_real_fft_hp at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/fft_s16.c:148
0x42034d56: esp_bss_hps16fft_process at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/microphone_array_speech_enhancement/esp_bss_hps16fft.c:161
0x4203296a: afe_se_task at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:704
E (38899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (38899) task_wdt: - IDLE0 (CPU 0)
E (38899) task_wdt: Tasks currently running:
E (38899) task_wdt: CPU 0: feed_task
E (38899) task_wdt: CPU 1: IDLE1
E (38899) task_wdt: Print CPU 0 (current core) backtrace
Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42083BAD:0x3C3BE120 0x420338AD:0x3C3BE130 0x42031E51:0x3C3BE180 0x420321CB:0x3C3BE1A0 0x42010F69:0x3C3BE1C0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
(inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42083bad: loop_end_shiftl_rv16_rs16_rv16_728_shift_pos_0 at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/asm_functions/shiftl_rv16_rs16_rv16_728.S:40
0x420338ad: esp_aec3_hps16fft_process at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_processor/acoustic_echo_cancellation/esp_aec3_hps16fft.c:185
0x42031e51: afe_feed_aec_init_true at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:491
0x420321cb: afe_feed at /home/sunxiangyu/workspace/esp_sr_lib/components/esp_audio_front_end/esp_afe_sr.c:638
0x42010f69: feed_task at /home/star/esp/esp-adf/components/audio_recorder/recorder_sr.c:254
I (48009) RECORDER_SR: MN dect quit
E (48899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (48899) task_wdt: - IDLE0 (CPU 0)
E (48899) task_wdt: Tasks currently running:
E (48899) task_wdt: CPU 0: resample
E (48899) task_wdt: CPU 1: IDLE1
E (48899) task_wdt: Print CPU 0 (current core) backtrace
Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42012568:0x3C5FB6E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
(inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42012568: audio_element_task at /home/star/esp/esp-adf/components/audio_pipeline/audio_element.c:477
E (58899) task_wdt: Task watchdog got triggered. The following tasks/users did not reset the watchdog in time:
E (58899) task_wdt: - IDLE0 (CPU 0)
E (58899) task_wdt: Tasks currently running:
E (58899) task_wdt: CPU 0: resample
E (58899) task_wdt: CPU 1: IDLE1
E (58899) task_wdt: Print CPU 0 (current core) backtrace
Backtrace: 0x42062BB2:0x3FC9D470 0x4037C171:0x3FC9D4A0 0x42012568:0x3C5FB6E0
--- 0x42062bb2: task_wdt_timeout_handling at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:434
(inlined by) task_wdt_isr at /home/star/esp/esp-idf/components/esp_system/task_wdt/task_wdt.c:507
0x4037c171: _xt_lowint1 at /home/star/esp/esp-idf/components/xtensa/xtensa_vectors.S:1240
0x42012568: audio_element_task at /home/star/esp/esp-adf/components/audio_pipeline/audio_element.c:477
- Compiler version : xtensa-esp-elf-gcc (crosstool-NG esp-13.2.0_20240530) 13.2.0
- Operating system: [Linux/Ubuntu24.04]
- Using an IDE?: Vscode
- Power supply: [USB]
Problem Description
WWE example with ENCODER trigger task watchdog after enter REC_START status.
Expected Behavior
Record voice without error after audio activation
Actual Behavior
Trigger the task watchdog and can not activate it again
Steps to Reproduce
- open the wwe example in the Vscode IDE with ESP32-IDF extension
- change the espressif device target to esp32s3
- change the macro definition from
#define RECORDER_ENC_ENABLE (NO_ENCODER)to#define RECORDER_ENC_ENABLE (ENC_2_AMRNB) - compiles the project and flash it to ESP32-S3-Korvo-2-v3 device
- open monitor (run the program)
- say the wake words (hi lexin) hearing 'ding' which means wake success, then keep quilent
- say the wake words again, you will find wake success again, then say something else trigger REC_START status, wait utill the wake ended
- now you can not wake it again, and the task watchdog error appear after seconds.
// If possible, attach a picture of your setup/wiring here.
Code to Reproduce This Issue
esp-adf/example/speech_recongnition/wwe
