pyDive

pyDive copied to clipboard

there are also [new bugs](https://travis-ci.org/ComputationalRadiationPhysics/pyDive/builds/125437353) when running the tests on the new functionality in [`test_ndarray.py`](https://travis-ci.org/ComputationalRadiationPhysics/pyDive/jobs/125437354#L421) on `dev` - [ ] `h5_ndarray.py`'s `open()` does expect to load a specific data set...

ax3l

Algorithm: Scan

8

Idea by @psychocoderHPC An algorithm similar to [MPI_Scan](http://www.mpich.org/static/docs/v3.1/www3/MPI_Scan.html) might be useful. Can this already be performed efficiently with the current `map`/`reduce`/`mapReduce` algorithms or do we have to add it?

ax3l

Adios Modules Does not Work

5

The Adios module does not work due to several problems. (adios 1.9.0 backend with python pip version 1.8.0.post2 and pyDive 1.2.2) Minor: - the documentation is outdated. Module name is...

ax3l

Shipping: Conda

1

We could also consider distributing a [(ana)conda](https://anaconda.org) package alongside our already used [pip](https://pypi.python.org/pypi/pyDive/1.2.2) package. Ressources: - pip vs. conda: [FAQ](http://conda.pydata.org/docs/_downloads/conda-pip-virtualenv-translator.html), [stackoverflow](https://stackoverflow.com/questions/20994716/what-is-the-difference-between-pip-and-conda) - [conda on GitHub](https://github.com/conda/conda) - [rtd conda](http://conda.pydata.org/) - [PyPi...

ax3l

Data Distribution: N-D or Patches

10

Right now we can distribute data along a 1D axis, but coupling to live simulations might need to "imitate" the spatial distribution of the RAM #4 accordingly. We should therefore...

ax3l

Releases: Tags, Milestones, dev/master, Changelog

3

Hi, - pls add a `dev` branch so new developments do _not break_ existing, working versions. - please upload the `1.0` release tag you did locally via `git push mainline...

ax3l

Future: Strategic Goals of the Project

5

Do we have common mission goals and can we create interoperability with the [yt project](http://yt-project.org/about.html)? [Paper](http://adsabs.harvard.edu/abs/2011ApJS..192....9T) ([ArXiV](http://arxiv.org/abs/1011.3514)) Section 5 is pretty close to what we do. Nevertheless, _pyDive_ should not...

ax3l

### Introduction The current module `picongpu` does provide (should provide) a _unified interface_ to read: - hdf5 and - adios files - with the in-file markup used by PIConGPU/libSplash. We...

ax3l

Comparison: Apache Flink

2

We should cross check if [Apache Flink](https://flink.apache.org/), _an open source platform for scalable batch and stream data processing_, has further operations that we missed in `pyDive`. [Here is a full...

ax3l

pyDive.is_initialized?

2

`pyDive.init()` can not be called twice without throwing an error. Is there a getter method that allows us to check if `pyDive` is already initialized? (E.g. `MPI` offers an [MPI_Initialized(...

ax3l