Phoebus Mak

Study and add tests for SSL verification for S3 on Windows and MacOS

2

Currently we don't test SSL verification for S3 on Windows and MacOS, both on pipeline and manually. For Windows, the blocker is making WinHTTP, which is the backend of S3...

In `arcticdb` Azure backed storage, `read_blob` made `GetProperties` API call to retrieve the size of the blob. This is an extra network call compared to the adapter in S3. It...

Sample code: ``` lib.write(symbol="a", data=np.array(0))` Error: File "version_store/_store.py", line 647, in write symbol, data, metadata, pickle_on_failure, dynamic_strings, coerce_columns File "version_store/_store.py", line 417, in _try_normalize raise ArcticNativeException(str(ex)) arcticc.exceptions.ArcticNativeException: 'numpy.float64' object cannot...

https://github.com/aws/aws-sdk-cpp/blob/64f29bce3a497111c2ab272bcb50ac5d568d5573/src/aws-cpp-sdk-core/source/http/crt/CRTHttpClient.cpp#L468 https://github.com/Azure/azure-sdk-for-cpp/blob/17c3cb50f158005497860525a07e23718e7d8878/sdk/core/azure-core/inc/azure/core/context.hpp#L240 Currently, 200000ms is the universal setting of `request_timeout` for both S3 ans Azure storage. However, the setting on S3 monitors at a more finer level - at each...

`openssl` v1.1.1 has reached [EOL](https://www.openssl.org/blog/blog/2023/03/28/1.1.1-EOL). It needs to be upgraded to v3.

#### Reference Issues/PRs #### What does this implement or fix? #### Any other comments? #### Checklist Checklist for code changes... - [ ] Have you updated the relevant docstrings, documentation...

#### Reference Issues/PRs Part of https://github.com/man-group/arcticdb-ursus/issues/18 #### What does this implement or fix? No added features. It's mostly adaptation so collector can be ported in another repo depends on this...

Currently `write` will call `storage_reload` twice (Two IO operatios): [One](https://github.com/man-group/ArcticDB/blob/0fc441cf64d46994cdb5b766e68c3d81b60e0086/cpp/arcticdb/version/version_functions.hpp#L33) for getting the latest version id and the other [one](https://github.com/man-group/ArcticDB/blob/0fc441cf64d46994cdb5b766e68c3d81b60e0086/cpp/arcticdb/version/version_map.hpp#L239) is for establising the version chain. Even putting the version...

The target of this ticket is to make data still readable even bad metadata has been written 1. Make `strict_mode` useful [again ](https://github.com/man-group/ArcticDB/blob/b9c75db258672a9fbc09db3f433f733f97c4acca/python/arcticdb/version_store/_normalization.py#L925) to avoid msgpack data being pickled silenetly...

Currently `list_versions` iterates version of each symbol one by one. Although each iteration could only take ms, it could take a long time if target symbols are more than 100k.