Insufficient utilization of CPU
Bug Description:
When using mysqldump to export data,
Manticore Search Version:
9.3.2 428075261@25050208 (columnar 4.2.1 0fe99f4@25050206) (secondary 4.2.1 0fe99f4@25050206) (knn 4.2.1 0fe99f4@25050206)
Operating System Version:
centos 7.9 +docker
Have you tried the latest development version?
None
Internal Checklist:
To be completed by the assignee. Check off tasks that have been completed or are not applicable.
- [ ] Implementation completed
- [ ] Tests developed
- [ ] Documentation updated
- [ ] Documentation reviewed
It might make sense to develop a mysqldump alternative that works in a similar way (i.e., as a logical backup). However, since it would be made specifically for Manticore, it could follow its own specifics - for example, reading from Manticore in parallel to make better use of the CPU.
@KlimTodrik As discussed, let's check how much parallel selects are useful in this case.