Manolis Papadakis

Results 17 comments of Manolis Papadakis

I have commented out the specs for those functions as part of a temporary fix that allows PropEr to spec-test itself. Those functions aren't suitable for use in a generator...

That's great, I will notify you once I have a more concrete plan. I will also take a look at your framework for ideas. Of course, if you have any...

Slight correction: PropEr actually does support recursive generators. This error is due to an issue with 'size' handling: Currently, when using 'resize' like this: resize(12,list(mytype())) only the size -- i.e.,...

This will definitely be changed, not just for compatibility with EQC, but also because the current behavior of 'resize' is not very intuitive. I am currently planning to write the...

This came up as I was making changes to `local_cudf_merge.py`, here is the diff that triggers the issue: ``` --- ./pkgs/dask-cuda-0.16.0a201013-py38_96/lib/python3.8/site-packages/dask_cuda/benchmarks/local_cudf_merge.py 2020-10-13 00:45:17.000000000 -0700 +++ ./envs/legate3/lib/python3.8/site-packages/dask_cuda/benchmarks/local_cudf_merge.py 2020-10-17 00:34:12.575661164 -0700 @@...

No, #416 is unrelated; this is not an issue with the benchmarks as they currently stand. The bottomline is that this snippet: https://gist.github.com/manopapad/aad22af7ec2206c7f078b71dc042ed56 causes this crash: ``` distributed.protocol.core - CRITICAL...

Doing `from cudf import Series`, or even just `import cudf` at the top of the script fixes the crash. Doing just `import cupy` at the top the crash remains.

> For instance are we running this script within cuDF or Distributed repos? That might cause us these kinds of import issues. I'm using a conda installation of rapids 0.16...

1. Supporting writes is pretty important, so I would vote against relying on Kerchunk for the long term. 2. I am favorable to this one, more comments after (3) 3....

> Instead, KvikIO will implement its own compression layer above the HDF5 file and store compression information as [HDF5 attributes](https://docs.hdfgroup.org/hdf5/v1_12/group___h5_a.html). Would this be a "custom" extension? I.e. a third-party app...