John Kerl

@Veraxus I feel your pain. I had given deep thought to starting 0-up but after much consideration and reflection I realized that Miller had to be a 1-up system: see...

Hi @holmescharles !! One option is to use `ulimit` to increase the number of open files: https://github.com/johnkerl/miller/issues/299 What Miller really needs is a process-internal LRU cache of some sort so...

@janxkoci yes indeed, we are talking about the same thing! :) > What Miller really needs is a process-internal LRU cache of some sort so it wouldn't need to keep...

> even if explicitly quoted There are two different things. _For JSON_ -- `"123"` means string and `123` means int. Double quotes serve as type-indicators. _For CSV_ -- double-quotes are...

Meanwhile please also check out `mlr -S` (maybe overkill, but, it does avoid type-inference ...

Hi @BinDong314 -- there are indeed default compressors AKA filters -- here are a couple starting links (just saw @eddelbuettel 's post seconds ago): * https://docs.tiledb.com/main/background/key-concepts-and-data-format#data-layout * https://docs.tiledb.com/main/background/key-concepts-and-data-format#tile-filtering

1. I can get you an example 2. Ditto 3. Validity involves nullable attributes -- the data buffer is numeric/string/whatever for each cell, and the validity buffers are booleans indicating...

@BinDong314 re 1 & 2: Startingi from https://github.com/TileDB-Inc/TileDB/blob/dev/examples/cpp_api/filters.cc, edit to leave all filter lists empty -- comment out the lines that add filters -- this way you are explicitly setting...

Can we get this stanza into a dev section in `README.md`? ``` pip install -r requirements_dev.txt python setup.py develop --tiledb= python -m pytest tiledb ```

See also https://github.com/johnkerl/miller/issues/1572#issuecomment-2185309016 for complicating issues ...