joblib-spark icon indicating copy to clipboard operation
joblib-spark copied to clipboard

joblib-spark doesn't work with joblib 1.4.0

Open thinkall opened this issue 1 year ago • 1 comments

joblib 1.4.0 just released two days ago, it will break joblib-spark:

        if SafeFunction is None:
            # pylint: disable=protected-access,used-before-assignment
            return self._get_pool().apply_async(
>               PoolManagerMixin._wrap_func_call, (run_on_worker_and_fetch_result,),
                callback=callback, error_callback=callback
            )
E           AttributeError: type object 'PoolManagerMixin' has no attribute '_wrap_func_call'

/usr/lib/miniforge3/envs/pytest/lib/python3.10/site-packages/joblibspark/backend.py:214: AttributeError

thinkall avatar Apr 10 '24 08:04 thinkall

i faced similar issue

cometta avatar Apr 16 '24 05:04 cometta

I think this issue has been fixed by https://github.com/joblib/joblib-spark/pull/55.

wbo4958 avatar Aug 09 '24 07:08 wbo4958

I think this issue has been fixed by #55.

Right. We need a new release of joblib-spark. @WeichenXu123 , could you please help on this? Thanks.

thinkall avatar Aug 14 '24 08:08 thinkall

Published: https://pypi.org/project/joblibspark/0.5.3/

WeichenXu123 avatar Aug 14 '24 11:08 WeichenXu123