Isaiah Norton
Isaiah Norton
Auto-pickle was turned off in #30. Still need impl/test for classes other than DenseArray. x-ref how this was done for DenseArray: https://github.com/TileDB-Inc/TileDB-Py/blob/dev/tiledb/libtiledb.pyx#L4567-L4596 The `__reduce__` implementation is necessary because of https://groups.google.com/forum/#!topic/cython-users/6pk5cdoGhuw
> Is there a way to keep the python kernel from crashing, even when having invalid input to tiledb? > # kernel breaks with `realloc(): invalid pointer` Not sure what...
For these: ``` # empty result A.multi_index[:, 0] # empty result A.multi_index["chr2", 0] # empty result A.multi_index["chr2"] ``` It is a bug; I think we have a fix in progress...
Hi @hoeze, are you able to share any more details about how you are using RocksDB? I’m not very familiar with it yet, and we’d like to dig in to...
Hi @Hoeze, if I understand correctly, you want an object that can be indexed (eg `multi_index`) within only the specified range(s), or call other `tiledb.Array` methods like `unique_dim_values`? Would you...
> get existing coordinates inside a range and load the data in this range on-demand with dask. If I am understanding correctly, you can do the first part (get only...
I'll have to look closer later, it fails even with `tile=120`. I think the error message for what's happening here has regressed.
> Is there some memory leak? If the `{Sparse,Dense}Array` object is left open, then there is some state associated with the array in memory. Depending on the size of the...
> Is the following also creating a new context in every loop? No, it creates one `Ctx` instance on line 6 and reuses it here: `with tiledb.DenseArray(path, mode="w", ctx=ctx) as...
Hi @Hoeze, From [this comment](https://github.com/TileDB-Inc/TileDB-Py/issues/150#issuecomment-742599645): > This is far below the 8GB of memory usage I observe on my dask workers after reading from the array the first time. It...