datashare icon indicating copy to clipboard operation
datashare copied to clipboard

refactor: migrate batch search to AMQP

Open ClemDoum opened this issue 1 year ago • 4 comments

Depends on #1079, #1081 and #1283

At the end of this story, BatchSearchLoop and BatchDownloadLoop should be the same.

  • [x] do #1283 to make it easier for this story
  • [x] refactor Event -> Message
  • [x] remove BatchDownloadCleaner from BatchDownloadLoop and any specific batch download coupling then rename class
  • [x] use TaskView<T> for sending batch search to worker(s)
  • [x] use TaskManager.startTask(String id, String taskName, User user) like BatchDownload
  • [x] use TaskRunnerLoop for batch search
  • [x] adapt error handling with batch search (repost, dead letter queue) in TaskRunnerLoop
  • [x] remove method startTask(Callable<V> task, ...) to use same methods as BatchDownload and BatchSearch
  • [ ] implement AMQP for BatchSearch
  • [ ] use AMQP for working queues between SCAN, INDEX, NLP (full redis, full AMQP, full memory) if possible
  • [ ] manually test non regression with memory, Redis, AMQP

ClemDoum avatar Jun 05 '23 14:06 ClemDoum

This issue is stale because it has been open for 40 days with no activity.

github-actions[bot] avatar Jul 16 '23 00:07 github-actions[bot]

This issue is stale because it has been open for 40 days with no activity.

github-actions[bot] avatar Aug 27 '23 00:08 github-actions[bot]

This issue is stale because it has been open for 40 days with no activity.

github-actions[bot] avatar Oct 09 '23 00:10 github-actions[bot]

This issue is stale because it has been open for 40 days with no activity.

github-actions[bot] avatar Dec 20 '23 00:12 github-actions[bot]

Closed in favor of testing issues in Sprint 25:

  • Enhancement: AMQP for working queues between SCAN, INDEX, NLP (full redis, full AMQP, full memory) if possible #1374
  • batch search migration #1372
  • test of the installers #1373

caro3801 avatar Apr 09 '24 09:04 caro3801