AI-on-the-edge-device icon indicating copy to clipboard operation
AI-on-the-edge-device copied to clipboard

Published 20 hours ago • verified publisher icon jomjol

Moondream.ai as LLM

Open lazmo88 opened this issue 1 year ago • 2 comments

The Feature

Any chance we could consider using alternative LLM instead of Tensorflow? Moondream.ai claims to run "everywhere" so why not ESP32? Moondream removes a lot of complexity and is able to extract data from images without breaking sweat. Just an idea as you already have the hw/sw setup going, it could be easy to implement option for alternative LLM models.

lazmo88 avatar Sep 16 '24 17:09 lazmo88

https://moondream.ai/docs/faq -> Are there limitations? -> "Because images are sampled down to 378x378, it may not be able to answer questions about very small details in the image. This also limits its ability to perform OCR."

RaHehl avatar Sep 24 '24 14:09 RaHehl

This would we a huge change of the implementation, so I guess it is unlikely it will ever get done.

caco3 avatar Sep 29 '24 20:09 caco3