Alex Owens
Alex Owens
The behaviour should probably be the same in the following cases: - Straight read requesting a column that does not exist, or date range outside that covered by the symbol's...
https://github.com/man-group/ArcticDB/blob/master/cpp/arcticdb/storage/s3/s3_storage-inl.hpp#L359-L360 Underlying cause is that the index type (which comes before the symbol name in the S3 path) is hard-coded based on whether the keytype is ref or atom. This...
https://github.com/man-group/ArcticDB/actions/runs/7398766075/job/20129034406 In case logs expire: ``` _________ test_symbol_list_parallel_stress_with_delete[False-2-3-10-2] _________ lmdb_version_store_v1 = NativeVersionStore: Library: test_symbol_list_parallel_stre.224_2024-01-03T15_15_46_634705, Primary Storage: lmdb_storage. list_freq = 2, delete_freq = 10, update_freq = 3, compaction_size = 2 same_symbols...
v1 API, behaviour almost certainly the same with `finalize_staged_data` in the v2 API. Minimal repro: ``` lib.write(sym, pd.DataFrame({"col": ["hello"]}, index=[pd.Timestamp("2000-01-01")]), parallel=True) lib.write(sym, pd.DataFrame({"col": [None]}, index=[pd.Timestamp("2000-01-02")]), parallel=True) lib.compact_incomplete(sym, False, False) ```...
Currently, `compact_incomplete` always writes a symbol list key. This should only be written if `finalize_staged_data/compact_incomplete` specify that it was a parallel write, if it was a parallel append, but with...
https://github.com/man-group/ArcticDB/pull/1399 adds the ability to filter and project on sparse columns, tested in C++, and earlier merges allow grouping and aggregating on sparse columns too. However, `copy_frame_data_to_buffer` (the final stage...
**THIS IS AN API CHANGE, AND SHOULD NOT BE MERGED UNTIL WE WANT TO BUMP THE MAJOR VERSION NUMBER FOR A MORE IMPORTANT FEATURE** Fixes #1460 Previously the `date_range` returned...
Known locations: - [x] `copy_frame_data_to_buffer` - [ ] `LocalVersionedEngine::get_descriptor` x2 - [ ] `read_frame.cpp` multiple locations - [ ] `aggregator_set_data` - [x] `AggregationClause::process` x2 closed by #1450 - [x] `aggregation.cpp`...