scikit-learn-intelex icon indicating copy to clipboard operation
scikit-learn-intelex copied to clipboard

ENH: SPMD interface for IncrementalBasicStatistics

Open olegkkruglov opened this issue 7 months ago • 8 comments

Description

  • Added SPMD interface for IncrementalBasicStatistics
  • Changed policy saving workflow, now queue is saved to attributes instead of policy. It is necessary because finalize_fit requires spmd_policy, but partial_fit requires data_parallel_policy on oneDAL side
  • finalize_fit now uses provided queue for computations on onedal4py side.
  • Contains some content from https://github.com/intel/scikit-learn-intelex/pull/1777 for test implementation
  • [x] I have reviewed my changes thoroughly before submitting this pull request.
  • [x] I have commented my code, particularly in hard-to-understand areas.
  • [ ] I have updated the documentation to reflect the changes, if necessary.
  • [x] The unit tests pass successfully.
  • [x] I have run it locally and tested the changes extensively.
  • [x] I have resolved any merge conflicts that might occur with the base branch.
  • [x] Git commit message contains an appropriate signed-off-by string (see CONTRIBUTING.md for details)
  • [x] I have added a respective label(s) to PR if I have a permission for that.

olegkkruglov avatar Jul 25 '24 18:07 olegkkruglov