ipyparallel

ipyparallel copied to clipboard

I'm using ipyparallel in a somewhat hackneyed scheme as a GPU cluster - upon job submission, each engine checks to see whether there are available GPU resources for running the...

rueberger

Feature request: pull and push with %%px cell magic

3

I propose allowing one to pull and push in a px cell. The feature allows better encapsulation of cells. example: ``` %%px push(a, b) pull(c) c = a + b...

rainwoodman

`dill` and `cloudpickle` don't work with `require`

1

```python from ipyparallel import Client, require client = Client() lview = client.load_balanced_view() dview = client[:] dview.use_cloudpickle() @require('types') def func(x): return types.SimpleNamespace(n=x) res = lview.map(func, range(10)) res.result() ``` gives ``` ---------------------------------------------------------------------------NameError...

basnijholt

Monitoring ipcluster, web interface planned?

1

I use ipcluster very often but missed a monitoring view of what's goining on in the ipcluster. Is there any planning for something like a web interface/Class with an overview...

SiggiGue

low-frequency error on module object with `use_dill`

9

Apparently there's a low-frequency issue (submitted by @jakirkham) that surfaces with code similar to this: ``` from ipyparallel import Client client = Client() client[:].use_dill().get() with client[:].sync_imports(): import nest from nest...

mmckerns

updates: - [github.com/asottile/pyupgrade: v2.37.3 → v2.38.0](https://github.com/asottile/pyupgrade/compare/v2.37.3...v2.38.0) - [github.com/psf/black: 22.6.0 → 22.8.0](https://github.com/psf/black/compare/22.6.0...22.8.0) - [github.com/pre-commit/mirrors-prettier: v2.7.1 → v3.0.0-alpha.0](https://github.com/pre-commit/mirrors-prettier/compare/v2.7.1...v3.0.0-alpha.0) - [github.com/pre-commit/mirrors-eslint: v8.22.0 → v8.23.1](https://github.com/pre-commit/mirrors-eslint/compare/v8.22.0...v8.23.1)

pre-commit-ci[bot]

list of lists not passed properly to chain closes #849

minrk

map_sync with pandas operation function does not finish.

1

Map_sync with pandas operation function does not finish. I have very long dataframe. So I split the dataframe into 40 sub-dataframes, and apply pandas operation to 40 sub-dataframes parallelly by...

yun881201

BroadcastView map Not Implemented

3

The documentation made it seem like BroadcastView.map had been implemented. Is this feature coming?

dalbabur

ipyparallel and pymoo doesn't work

2

Hello all, I am trying to use ipyparallel with a module for Genetic Algorithm (pymoo) and for that, I need to pass the class name 'MyProblem' to the clusters (don't...

patdub