openlibrary icon indicating copy to clipboard operation
openlibrary copied to clipboard

Experiment with TOC in solr

Open cdrini opened this issue 1 year ago • 1 comments

Closes #

Technical

  • Add a new chapter field to solr and populate it on the edition level with the toc data in markdown format
  • On the work level, set it to the unsorted set of all its editions chapters.
  • RISK: This is a lot of new data in solr, and duplicated! Could cause bloat/perf issues
  • RISK: We use the work-level highlighting to display the toc in the search view, but we don't know which book the toc entry came from... Might need to include some edition data in there.
  • Add ability to see matching subjects to search page
  • Add ability to see matching chapters to search page
  • Special deploy: Need to add the new chapters field to solr. This can be done via the solr UI. Note this of course won't backfill the data, a full reindex is needed for that, but that will make it possible to merge/deploy this without needing the solr_next flag.

Testing

Screenshot

Stakeholders

cdrini avatar Sep 20 '24 17:09 cdrini

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 17.14%. Comparing base (2e231fa) to head (260bb72). Report is 488 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #9898      +/-   ##
==========================================
- Coverage   17.27%   17.14%   -0.14%     
==========================================
  Files          87       91       +4     
  Lines        4845     4982     +137     
  Branches      860      867       +7     
==========================================
+ Hits          837      854      +17     
- Misses       3477     3589     +112     
- Partials      531      539       +8     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov-commenter avatar Sep 23 '24 13:09 codecov-commenter

Closing in favour of #11366 and #11369

cdrini avatar Oct 20 '25 02:10 cdrini