eds-scikit
eds-scikit copied to clipboard
pyarrow fix
Description
pyarrow patch in last release fails when it is run by spark executor.
This PR fix this issue by specifying the python path the executor must look for in spark config.
Checklist
- [ ] If this PR is a bug fix, the bug is documented in the test suite.
- [ ] Changes were documented in the changelog (pending section).
- [ ] If necessary, changes were made to the documentation (eg new pipeline).