smooth-app
smooth-app copied to clipboard
Supercharge the app with artificial intelligence (Tracker)
What
### Tasks
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3279
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3986
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3985
- [ ] https://github.com/openfoodfacts/smooth-app/issues/4069
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3326
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3775
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3278
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3340
- [ ] https://github.com/openfoodfacts/smooth-app/issues/2457
- [ ] Add optional offline ingredient extraction using MLKIT (disabled on the F-Droid build)
- [ ] Add offline packaging extraction using MLKIT (disabled on the F-Droid build)
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5654
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5652
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5653
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5007
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5655
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5006
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5008
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5401
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5402
- [ ] Add an optional button on the product page to jump to Hunger Games crops and logos view for the product
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5656
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5387
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5322
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5010
- [ ] Use the DUMP API to make an offline Hunger Games ? https://openfoodfacts.github.io/robotoff/references/api/#tag/Insights/paths/~1insights~1dump/get
Part of
- #525
@raphael0202 I added the idea to do on-device language recognition here
What
Create a custom Tensorflow model for MLKit to classify Nutrition facts, Packaging instruction, Front and Ingredients photo on device Create a custom Tensorflow model for MLKit to classify food, pet food, cosmetics and other products on device
How
https://developers.google.com/ml-kit/vision/image-labeling?hl=fr https://developers.google.com/ml-kit/vision/face-detection?hl=fr
Explore using the on-device LLM for various tasks
- Food intake journaling
- Ingredient analysis
- FAQ/Support (chat?)
- other use-cases TBD
How
- https://ai.google/build/project-guides/llm-on-android-with-keras-and-tensorflow-lite
- https://android-developers.googleblog.com/2023/12/leverage-generative-ai-in-your-android-apps.html
- https://developer.android.com/studio/preview/gemini-template