ArcticDB
ArcticDB copied to clipboard
man-group
ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
- Fix compilation errors with clang-18 due to Werror - Run include-what-you-use to reduce includes and add forward declarations Same as: #1474 in the original PR ASV fails to perform...
`NativeVersionStore.version_store` has two ways to scan the sizes of a library: - `scan_object_sizes` - `scan_object_sizes_by_stream` The former returns a dict from key types to `KeySizesInfo` objects, which has fields `count`,...
The behaviour should probably be the same in the following cases: - Straight read requesting a column that does not exist, or date range outside that covered by the symbol's...
### Describe the bug When a pickled symbol is written, `lib._nvs.get_num_rows` returns incorrect row count. Please view the repro code. ### Steps/Code to Reproduce ```python lib.write_pickle("sym_pickled", pd.date_range("2024-03-01", "2024-03-31", freq="B")) lib._nvs.get_num_rows("sym_pickled")...
The post-processing for get_description_batch does a lot of individual IO operations, which kind of defeats the point of doing batch operations at all. We should ensure that we return the...
**Is your feature request related to a problem? Please describe.** Some methods in `library.py` do not respect the `prune_previous_versions` library option. This makes the API inconsistent. Discovered in #705 **Describe...
#### Reference Issues/PRs Fixes #1384 #### What does this implement or fix? The #1384 bug also applies to `as_of=` it is just not seen in the repro because it is...
https://github.com/man-group/ArcticDB/blob/c0a350e3ba8149f4ec08d3297b983dfd65b2d560/python/tests/util/storage_test.py#L172 It assumes all libraries created by the S3 real storage tests have name starts with "test_", which is wrong in some cases, e.g.: https://github.com/man-group/ArcticDB/blob/c0a350e3ba8149f4ec08d3297b983dfd65b2d560/python/tests/integration/arcticdb/test_arctic_library_management.py#L400
https://github.com/man-group/ArcticDB/blob/c0a350e3ba8149f4ec08d3297b983dfd65b2d560/python/tests/integration/arcticdb/test_arctic_library_management.py#L364 It assumes option `path_prefix` only exists at the end of the string, which is wrong.
From @jamesmunro Implementation question. I think this could be a common use case. I've got a process that appends new rows to a symbol whenever new bars/ticks arrive. ``` while...