Thomas Moreau

ENH limit inode footprint Memory

2

I am running some big benchmark using `joblib.Memory` on large computer infrastructures where the number of inodes is limited and I have been running in some headaches due to the...

FIX warnings in pytest7

12

try to see if we can use `pytest7` by removing `warns(None)`.

ENH add validate_cache in Memory

5

Tentative to implement a way to validate the cache results with user define rules. - Add an argument `validate_cache` that takes a callable `validate_cache(metadata) -> bool`. - Add `time` in...

First of all, thanks a lot for this cool package! I am developping a tool where I need to install programmatically `julia` and `pyjulia` in a `conda` env. This process...

Unsafe screening with CDClassifier?

1

Setting `shrinking=True` in `CDClassifier` with loss `log` and penalty `l1` seems to not converge toward the optimal solution. Increasing the number of iteration does not change this. It looks like...

ENH add get_worker_rank with unique rank

1

Add `loky.get_worker_rank` function that returns a unique number between `0` and `executor.max_workers - 1` in the workers. This functionality could be used to better assign resources such as GPU in...

loky is broken on windows with max_workers>62

3

As reported in scikit-learn/scikit-learn#12263, `loky` hangs when using many workers on windows. The following traceback is given: ```python-traceback Exception in thread QueueManagerThread: File "\lib\site-packages\sklearn\externals\joblib\externals\loky\process_executor.py", line 617, in _queue_management_worker ready =...

ENH creating a memmaping_reusable_executor

1

Some people would like to benefit from joblib memmaping serialization while still retainning the flexibility of asynchronous computations offered by the `concurrent.futures` API. This issue intend to keep track of...

As originally discussed in joblib/joblib#1052, the signleton mechanism in `_ReusablePoolExecutor` is shared by all its sub classes. This can lead to the subclass returning an object with the incorrect type....

Worker exiting with C level EXIT or SIGSEGV -> (exited with code 3221226519)

3

There is a random failure on appveyor with [`test_call_item_gc_crash_or_exit`](https://ci.appveyor.com/project/tomMoral/loky/builds/19754845/job/velpnboo8onjqfrl) with `SIGSEGV` and `python3.4`: ``` tests/test_reusable_executor.py::TestTerminateExecutor:: test_call_item_gc_crash_or_exit[CrashAtGCInWorker-SIGSEGV] PASSED [ 83%] ERROR: InvocationError for command 'C:\\projects\\loky\\.tox\\py34\\Scripts\\py.test.EXE -vxl --timeout=50 --skip-high-memory' (exited with code...