pico-tflmicro icon indicating copy to clipboard operation
pico-tflmicro copied to clipboard

Please update this port of TensorFlow Lite Micro library changes from latest upstream LiteRT for Microcontrollers?

Open Hedda opened this issue 1 year ago • 6 comments

Please consider updating this pico-tflmicro port of TensorFlow Lite Micro library with all the latest changes from upstream TensorFlow Lite (LiteRT) to enable better suppport for RP2040 and RP2350 microcontrollers from Raspberry Pi, ok?

  • https://github.com/tensorflow/tflite-micro

  • https://ai.google.dev/edge/litert/microcontrollers/overview

RP2040 support for TensorFlow Lite Micro was announced on the blog in January of 2024 but then no updates since March:

  • https://www.raspberrypi.com/news/a-big-bang-update-for-tensorflow-lite-for-microcontrollers/

Would also really like to see native support for the new RP2350 SoC/MCU with both Cortex-M and/or RISC-V cores in it:

  • https://github.com/raspberrypi/pico-tflmicro/issues/18

PS: Would in addition be awesome to see a demo on microWakeWord running natively on both RP2350 or RP2040 platforms:

  • https://github.com/raspberrypi/pico-tflmicro/issues/21

Hedda avatar Oct 25 '24 06:10 Hedda

@aallan @petewarden Please update this port of TensorFlow Lite Micro library changes from latest upstream TensorFlow Lite (LiteRT) for Microcontrollers?

Just to manage expectations, I don't work for Raspberry Pi anymore, and @petewarden was supporting this port on a very much "best efforts" basis.

aallan avatar Oct 25 '24 09:10 aallan

Any chance @lurch @kilograham @peterharperuk @Wren6991 @will-v-pi could run it up the flagpole to the Raspberry Pi team?

Hedda avatar Oct 25 '24 09:10 Hedda

The team will already have seen this I believe. They are all very busy though and may not be able to spend much time on it.

JamesH65 avatar Oct 25 '24 09:10 JamesH65

FYI; @sean-lawless did submit a pull request a few weeks ago which @lurch made some comments on but it is not merged yet:

  • https://github.com/raspberrypi/pico-tflmicro/pull/19

Hedda avatar Oct 25 '24 09:10 Hedda

@Hedda Have you tested Sean's PR to see if it works and gets you want you need?

JamesH65 avatar Oct 25 '24 09:10 JamesH65

I've now updated this port to the latest TFLM upstream, and confirmed it works on the RP2350. See https://github.com/raspberrypi/pico-tflmicro/commit/dfea53b977f131dc50d7060568ad4fd355d4d71e

petewarden avatar Dec 27 '24 03:12 petewarden