BGE-M3 Inference 多卡报错

[xcvil]

  File "/conda/envs/llm/lib/python3.12/site-packages/FlagEmbedding/inference/embedder/encoder_only/m3.py", line 295, in encode
    return super().encode(
           ^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/site-packages/FlagEmbedding/abc/inference/AbsEmbedder.py", line 275, in encode
    embeddings = self.encode_multi_process(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/site-packages/FlagEmbedding/abc/inference/AbsEmbedder.py", line 416, in encode_multi_process
    [output_queue.get() for _ in trange(last_chunk_id, desc="Chunks")],
     ^^^^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/multiprocessing/queues.py", line 103, in get
    res = self._recv_bytes()
          ^^^^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/multiprocessing/connection.py", line 216, in recv_bytes
    buf = self._recv_bytes(maxlength)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/multiprocessing/connection.py", line 437, in _recv_bytes
    return self._recv(size)
           ^^^^^^^^^^^^^^^^
  File "/conda/envs/llm/lib/python3.12/multiprocessing/connection.py", line 402, in _recv
    buf.write(chunk)
KeyboardInterrupt

[hanhainebula]

你好，@xcvil。看起来是多线程下获取结果时出现的问题，可能是机器不支持多线程导致的问题，可以运行下其他的多线程代码看是否会报类似的错误以确认是机器的问题。