smooth-app icon indicating copy to clipboard operation
smooth-app copied to clipboard

Supercharge the app with artificial intelligence (Tracker)

Open teolemon opened this issue 1 year ago • 3 comments

What

### Tasks
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3279
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3986
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3985
- [ ] https://github.com/openfoodfacts/smooth-app/issues/4069
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3326
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3775
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3278
- [ ] https://github.com/openfoodfacts/smooth-app/issues/3340
- [ ] https://github.com/openfoodfacts/smooth-app/issues/2457
- [ ] Add optional offline ingredient extraction using MLKIT (disabled on the F-Droid build)
- [ ] Add offline packaging extraction using MLKIT (disabled on the F-Droid build)
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5654
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5652
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5653
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5007
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5655
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5006
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5008
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5401
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5402
- [ ] Add an optional button on the product page to jump to Hunger Games crops and logos view for the product
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5656
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5387
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5322
- [ ] https://github.com/openfoodfacts/smooth-app/issues/5010
- [ ] Use the DUMP API to make an offline Hunger Games ? https://openfoodfacts.github.io/robotoff/references/api/#tag/Insights/paths/~1insights~1dump/get

Part of

  • #525

teolemon avatar May 26 '23 11:05 teolemon

@raphael0202 I added the idea to do on-device language recognition here

teolemon avatar Aug 24 '23 10:08 teolemon

What

Create a custom Tensorflow model for MLKit to classify Nutrition facts, Packaging instruction, Front and Ingredients photo on device Create a custom Tensorflow model for MLKit to classify food, pet food, cosmetics and other products on device

How

https://developers.google.com/ml-kit/vision/image-labeling?hl=fr https://developers.google.com/ml-kit/vision/face-detection?hl=fr

teolemon avatar Jan 24 '24 10:01 teolemon

Explore using the on-device LLM for various tasks

  • Food intake journaling
  • Ingredient analysis
  • FAQ/Support (chat?)
  • other use-cases TBD

How

  • https://ai.google/build/project-guides/llm-on-android-with-keras-and-tensorflow-lite
  • https://android-developers.googleblog.com/2023/12/leverage-generative-ai-in-your-android-apps.html
  • https://developer.android.com/studio/preview/gemini-template

teolemon avatar Jan 24 '24 10:01 teolemon