ghcollin

Sorry for the late response. tftables is backed by multitables, which has some benchmark comparisons for a few different storage configurations. The best performance increase is seen when reading from...

This definitely seems like a bug. Thanks for the report!

What is the full output? (stack trace and any HDF5 errors)

Thanks for the error log. I think I may have found that the problem lies in multitables. It seems older versions of python don't support pickling static methods of classes....

It seems you're running on Windows. In theory, multitables should run on Windows, but I've never set up a VM to try it out. Windows and Linux/OSX have different threading/processing...

Sorry I haven't had a lot of time to look into this lately. It's a definite possibility that the way windows handles shared memory or condition variables is causing the...

I store my data pre-shuffled. In principe, I don't think anything would prevent such functionality in multitables. But it does require some modifications, at which point it might be better...

It seems to be stuck waiting to write to the internal queue, maybe there is an issue with ordered access? Can you try setting `ordered = False`, and see if...

If you run the multitables unit tests, `https://github.com/ghcollin/multitables/blob/master/multitables_test.py` do they complete properly? Also what size/how many rows is your dataset(s)?

I've run into the same error # Description ``` (jax) -bash-4.2$ JAX_COMPILER_DETAILED_LOGGING_MIN_OPS=0 XLA_FLAGS=--xla_dump_to=/tmp/xladump PYTHONPATH="./" python tests/tests.py .F1127 20:16:06.642083 26806 gpu_performance_model.cc:358] Check failed: common_utilization