[ENH] Handle one-off compaction message in compaction manager

[Sicheng-Pan]

Description of changes

Summarize the changes made by this PR.

• Improvements & Bug fixes
  • N/A
• New functionality
  • Following the previous PR, this PR implements the logic to handle one-off compaction message in the compaction manager. It also refactors the compact_batch method so that a mask can be applied to select the compaction jobs to run by collection ids.

Test plan

How are these changes tested?

• [ ] Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Documentation Changes

Are all docstrings for user-facing APIs updated if required? Do we need to make documentation changes in the docs repository?