Alex Owens

Profiling our performance on the billion row challenge showed deallocating segments to be the major bottleneck. Code to generate the data and profile the grouping available on this branch: https://github.com/man-group/ArcticDB/tree/brc-speedup...

- [ ] https://github.com/man-group/ArcticDB/issues/673 - [ ] https://github.com/man-group/ArcticDB/issues/1048 - [ ] https://github.com/man-group/ArcticDB/issues/1270 - [ ] https://github.com/man-group/ArcticDB/issues/1546

Currently segments are read from storage in a specific order based on the first clause in the pipeline, and subsequent clauses will only work if the output format from the...

⚠️ API change ⚠️ Fixes #1641 Also changes `write_pickle_batch` to return `DataError` objects instead of throwing exceptions, and updated the return type and docstring accordingly.

Flaky ASV benchmark

1

https://github.com/man-group/ArcticDB/actions/runs/9300495907/job/25596708636 https://github.com/man-group/ArcticDB/actions/runs/9288017741/job/25558505873?pr=1584 ``` Traceback (most recent call last): File "/opt/python/cp36-cp36m/lib/python3.6/site-packages/asv/benchmark.py", line 1293, in main_run_server main_run(run_args) File "/opt/python/cp36-cp36m/lib/python3.6/site-packages/asv/benchmark.py", line 1167, in main_run result = benchmark.do_run() File "/opt/python/cp36-cp36m/lib/python3.6/site-packages/asv/benchmark.py", line 573, in do_run...

#### Reference Issues/PRs CLoses #1666 Only affects V2 API, V1 API will behave as it always has ⚠️ API change, do not merge until 5.0.0 ⚠️

#### Reference Issues/PRs Fixes #1552 The `row_count` field of the `get_description` return value (and equivalent on V1 API, and the return value of `get_num_rows`) was misleadingly set if the symbol...