girder_worker
girder_worker copied to clipboard
girder
Distributed task execution engine with Girder integration, developed by Kitware
I'm currently working on a GW task in which I download data from a Girder item, update that data, and then upload back to the item. Obviously, if more than...
I wrote a custom Transform class, but it was put inside a girder plugin so when serialized to girder_worker the dynamic python module name controlled by girder is probably not...
This operation can be very slow for large arrays. Mileage may vary.
See: https://github.com/jsonpickle/jsonpickle#numpy-support Sometimes we want to return relatively small numpy arrays (e.g. confusion matricides, etc). Returning large arrays has serious performance costs, but the naive implementation will cover immediately useful...
If I install from Pypi via `pip install girder_worker[girder_io]`, I am told that `girder-worker 0.5.0 does not provide the extra 'girder_io'`. Shouldn't it do so?
This probably means adopting girders style :smile_cat:
The check in [`task.py`](https://github.com/girder/girder_worker/blob/cf5a47ea109812877e18c928a94b147c4199d9b1/girder_worker/task.py#L135) incorrectly tries to use a DataFrame as a transform since it has a `transform` method. Resulting stack on calling a simple task function locally: ``` Traceback...
pypi reports that girder_worker only works with Python 2.
It should be possible to create a Docker-managed volume (not a bind-mount) and use it in the context of a girder_worker instance running inside Docker that launches Docker tasks.
With nvidia-docker2, the current method for running nvidia-docker images no longer works. As a workaround, docker_run can be given the argument `runtime=nvidia`, but this should be done automatically, and the...