memories icon indicating copy to clipboard operation
memories copied to clipboard

[Tracker] Search

Open meichthys opened this issue 2 years ago • 7 comments

Tracker issue for implementation of search.

  • [x] Collaborative Tags
  • [x] Recognize
  • [x] Face Recognition
  • [x] Albums
  • [x] Places
  • [ ] Dates (e.g. 2017 January)
  • [ ] File Type (e.g. videos)
  • [ ] Multiple categories
  • [ ] FTS
  • [ ] EXIF data (e.g. title/description)
  • [ ] Search with synonyms (e.g. Drink => Beverage)
  • [ ] Search with word forms (e.g. Animals => Animal)
  • [ ] Localization

Original Post

Semantic search would be a very welcome feature

Describe the solution you'd like Semantic search allows searching using phrases rather than tags stored in a database.

A search may be something like: boy wearing red shirt

Describe alternatives you've considered Tags via Recognize are pretty good but searching multiple tags is cumbersome in Nextcloud

Additional context I realize this may be limited by the existing nextcloud search functionality, but i wanted to file it here anyway since this type of semantic search is becoming more common in photo libraries.

meichthys avatar Jun 01 '23 16:06 meichthys

A good semantic search is very complex, so much so that even Google Photos doesn't support this. Capturing context is fundamentally a very challenging task. For example, if we simply tokenize the input string, then boy wearing red shirt matches both of

  1. boy wearing red shirt
  2. boy wearing blue shirt in red boat

but not

  1. boy wearing red jersey
  2. boy in red shirt

A more realistic goal would be to support full text search on the existing tags (including faces), which can then be extended for simple queries, like X and Y.

pulsejet avatar Jun 01 '23 17:06 pulsejet

Full text search on tags sounds like a good compromise. Feel free to adjust the title of the issue if you want to track full text search here.

meichthys avatar Jun 01 '23 18:06 meichthys

Updated. Lots of tasks here, this one is tough.

pulsejet avatar Jun 01 '23 18:06 pulsejet

Wow. Nice. Looks like you've thought this through already. Great work!

meichthys avatar Jun 01 '23 18:06 meichthys