vector-db-benchmark
vector-db-benchmark copied to clipboard
Published
20 hours ago •
qdrant
qdrant
Benchmark error on aarch64
Hi, I am performing benchmark on aarch64 instance,
Instance: AWS EC2 Graviton(aarch64) OS: Amazon Linux 2023 Python: 3.11 Benchmark command：
python3 -m run --engines qdrant-sq-rps-m-64-ef-512 --datasets dbpedia-openai-1M-1536-angular
and got the errors, can you help check and guide me how to fix it ? BTW, same benchmark command performed perfect on Intel instance.
/root/vector-db-benchmark/engine/clients/qdrant/configure.py:72: DeprecationWarning: `recreate_collection` method is deprecated and will be removed in the future. Use `collection_exists` to check collection existence and `create_collection` instead.
self.client.recreate_collection(
Running experiment: qdrant-sq-rps-m-64-ef-512 - dbpedia-openai-1M-1536-angular
/root/vector-db-benchmark/datasets/dbpedia-openai-1M-1536-angular/dbpedia_openai_1M already exists
Experiment stage: Configure
Experiment stage: Upload
975000it [05:37, 2891.19it/s]
Traceback (most recent call last):
File "/root/vector-db-benchmark/run.py", line 59, in run
client.run_experiment(
File "/root/vector-db-benchmark/engine/base_client/client.py", line 108, in run_experiment
upload_stats = self.uploader.upload(
^^^^^^^^^^^^^^^^^^^^^
File "/root/vector-db-benchmark/engine/base_client/upload.py", line 67, in upload
post_upload_stats = self.post_upload(distance)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/vector-db-benchmark/engine/clients/qdrant/upload.py", line 61, in post_upload
cls.client.update_collection(
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/qdrant_client/qdrant_client.py", line 1982, in update_collection
return self._client.update_collection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/qdrant_client/qdrant_remote.py", line 2480, in update_collection
return self.grpc_collections.Update(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 277, in __call__
response, ignored_call = self._with_call(
^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 332, in _with_call
return call.result(), call
^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 440, in result
raise self
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 315, in continuation
response, call = self._thunk(new_method).with_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 1198, in with_call
return _end_unary_response_blocking(state, call, True, None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 1006, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer {created_time:"2024-08-27T10:22:00.737299799+00:00", grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/root/vector-db-benchmark/run.py", line 91, in <module>
app()
File "/root/vector-db-benchmark/run.py", line 86, in run
raise e
File "/root/vector-db-benchmark/run.py", line 59, in run
client.run_experiment(
File "/root/vector-db-benchmark/engine/base_client/client.py", line 108, in run_experiment
upload_stats = self.uploader.upload(
^^^^^^^^^^^^^^^^^^^^^
File "/root/vector-db-benchmark/engine/base_client/upload.py", line 67, in upload
post_upload_stats = self.post_upload(distance)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/vector-db-benchmark/engine/clients/qdrant/upload.py", line 61, in post_upload
cls.client.update_collection(
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/qdrant_client/qdrant_client.py", line 1982, in update_collection
return self._client.update_collection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/qdrant_client/qdrant_remote.py", line 2480, in update_collection
return self.grpc_collections.Update(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 277, in __call__
response, ignored_call = self._with_call(
^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 332, in _with_call
return call.result(), call
^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 440, in result
raise self
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_interceptor.py", line 315, in continuation
response, call = self._thunk(new_method).with_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 1198, in with_call
return _end_unary_response_blocking(state, call, True, None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/qdrant/lib/python3.11/site-packages/grpc/_channel.py", line 1006, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer {created_time:"2024-08-27T10:22:00.737299799+00:00", grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
Upload time: 342.881655387
Experiment qdrant-sq-rps-m-64-ef-512 - dbpedia-openai-1M-1536-angular interrupted
