openlibrary icon indicating copy to clipboard operation
openlibrary copied to clipboard

Edition table filter doesn't correctly do diacritic folding

Open tfmorris opened this issue 6 months ago • 1 comments

Problem

As stated in title

Search "germenes" Image

Search "gérmenes" Image

Reproducing the bug

  1. Go to https://openlibrary.org/works/OL276558W
  2. Click "Afficher les 58 éditions"
  3. Type "armas" in the Search field
  4. Note the 15 editions and their titles
  5. Replace "armas" with "germenes" and note how the the list changes to just 6 editions
  6. Replace "germenes" with "gérmenes" and note that the list now consists of 8 different editions
  • Expected behavior: Both search terms match the same set of 14 diacritic folded titles
  • Actual behavior: Titles have to match exactly (probably including Unicode normalizatin form, I suspect)

Context

  • Browser (Chrome, Safari, Firefox, etc): Chrome
  • OS (Windows, Mac, etc): Mac
  • Logged in (Y/N): Y
  • Environment (prod, dev, local): prod

Breakdown

Requirements Checklist

  • [ ]

Related files

Stakeholders


Instructions for Contributors

  • Please run these commands to ensure your repository is up to date before creating a new branch to work on this issue and each time after pushing code to Github, because the pre-commit bot may add commits to your PRs upstream.

tfmorris avatar Jun 12 '25 17:06 tfmorris

Is there a Data Tables feature to support this?

mekarpeles avatar Jun 16 '25 19:06 mekarpeles

Is there a Data Tables feature to support this?

If that question is directed at me, I'd guess there is, but the implementing engineer will need to investigate.

tfmorris avatar Jun 25 '25 00:06 tfmorris

This is the datatables library we use for whoever has some time to investigate: https://datatables.net/ . Not we have version 1.13 which is rather old now, we might need to update it to get any new features we need.

cdrini avatar Jun 30 '25 18:06 cdrini