ImportError when RAG = RAGPretrainedModel.from_pretrained("colbert-ir/colbertv2.0")

[happy15]

Hi, I got following error when "RAG = RAGPretrainedModel.from_pretrained("colbert-ir/colbertv2.0")" according to the example in readme:

ImportError: dlopen(/Users/sheng/Library/Caches/torch_extensions/py311_cpu/segmented_maxsim_cpp/segmented_maxsim_cpp.so, 0x0002): tried: '/Users/sheng/Library/Caches/torch_extensions/py311_cpu/segmented_maxsim_cpp/segmented_maxsim_cpp.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')), '/System/Volumes/Preboot/Cryptexes/OS/Users/sheng/Library/Caches/torch_extensions/py311_cpu/segmented_maxsim_cpp/segmented_maxsim_cpp.so' (no such file), '/Users/sheng/Library/Caches/torch_extensions/py311_cpu/segmented_maxsim_cpp/segmented_maxsim_cpp.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64'))

My env:

• macOS Sonoma 14.2.1, Apple M1 Pro, 16GB

The pip env:

Package                   Version
------------------------- ---------------
aiohttp                   3.9.1
aiosignal                 1.3.1
annotated-types           0.6.0
anyio                     4.2.0
appnope                   0.1.3
argon2-cffi               23.1.0
argon2-cffi-bindings      21.2.0
arrow                     1.3.0
asttokens                 2.4.1
async-lru                 2.0.4
attrs                     23.2.0
Babel                     2.14.0
beautifulsoup4            4.12.3
bitarray                  2.9.2
bleach                    6.1.0
blinker                   1.7.0
blis                      0.7.11
catalogue                 2.0.10
certifi                   2023.11.17
cffi                      1.16.0
charset-normalizer        3.3.2
click                     8.1.7
cloudpathlib              0.16.0
colbert-ai                0.2.18
comm                      0.2.1
confection                0.1.4
cymem                     2.0.8
dataclasses-json          0.6.3
datasets                  2.16.1
debugpy                   1.8.0
decorator                 5.1.1
defusedxml                0.7.1
Deprecated                1.2.14
dill                      0.3.7
dirtyjson                 1.0.8
distro                    1.9.0
executing                 2.0.1
faiss-cpu                 1.7.4
fastjsonschema            2.19.1
filelock                  3.13.1
Flask                     3.0.1
fqdn                      1.5.1
frozenlist                1.4.1
fsspec                    2023.10.0
git-python                1.0.3
gitdb                     4.0.11
GitPython                 3.1.41
greenlet                  3.0.3
h11                       0.14.0
httpcore                  1.0.2
httpx                     0.26.0
huggingface-hub           0.20.3
idna                      3.6
ipykernel                 6.29.0
ipython                   8.20.0
isoduration               20.11.0
itsdangerous              2.1.2
jedi                      0.19.1
Jinja2                    3.1.3
joblib                    1.3.2
json5                     0.9.14
jsonpatch                 1.33
jsonpointer               2.4
jsonschema                4.21.1
jsonschema-specifications 2023.12.1
jupyter_client            8.6.0
jupyter_core              5.7.1
jupyter-events            0.9.0
jupyter-lsp               2.2.2
jupyter_server            2.12.5
jupyter_server_terminals  0.5.2
jupyterlab                4.0.12
jupyterlab_pygments       0.3.0
jupyterlab_server         2.25.2
langchain                 0.1.4
langchain-community       0.0.16
langchain-core            0.1.17
langcodes                 3.3.0
langsmith                 0.0.85
llama-index               0.9.40
MarkupSafe                2.1.4
marshmallow               3.20.2
matplotlib-inline         0.1.6
mistune                   3.0.2
mpmath                    1.3.0
multidict                 6.0.4
multiprocess              0.70.15
murmurhash                1.0.10
mypy-extensions           1.0.0
nbclient                  0.9.0
nbconvert                 7.14.2
nbformat                  5.9.2
nest-asyncio              1.6.0
networkx                  3.2.1
ninja                     1.11.1.1
nltk                      3.8.1
notebook_shim             0.2.3
numpy                     1.26.3
onnx                      1.15.0
openai                    1.10.0
overrides                 7.7.0
packaging                 23.2
pandas                    2.2.0
pandocfilters             1.5.1
parso                     0.8.3
pexpect                   4.9.0
pillow                    10.2.0
pip                       23.3.2
platformdirs              4.2.0
preshed                   3.0.9
prometheus-client         0.19.0
prompt-toolkit            3.0.43
protobuf                  4.25.2
psutil                    5.9.8
ptyprocess                0.7.0
pure-eval                 0.2.2
pyarrow                   15.0.0
pyarrow-hotfix            0.6
pycparser                 2.21
pydantic                  2.6.0
pydantic_core             2.16.1
Pygments                  2.17.2
python-dateutil           2.8.2
python-dotenv             1.0.1
python-json-logger        2.0.7
pytz                      2023.4
PyYAML                    6.0.1
pyzmq                     25.1.2
RAGatouille               0.0.6b2
referencing               0.33.0
regex                     2023.12.25
requests                  2.31.0
rfc3339-validator         0.1.4
rfc3986-validator         0.1.1
rpds-py                   0.17.1
ruff                      0.1.15
safetensors               0.4.2
scikit-learn              1.4.0
scipy                     1.12.0
Send2Trash                1.8.2
sentence-transformers     2.3.1
sentencepiece             0.1.99
setuptools                68.1.2
six                       1.16.0
smart-open                6.4.0
smmap                     5.0.1
sniffio                   1.3.0
soupsieve                 2.5
spacy                     3.7.2
spacy-legacy              3.0.12
spacy-loggers             1.0.5
SQLAlchemy                2.0.25
srsly                     2.4.8
stack-data                0.6.3
sympy                     1.12
tenacity                  8.2.3
terminado                 0.18.0
thinc                     8.2.2
threadpoolctl             3.2.0
tiktoken                  0.5.2
tinycss2                  1.2.1
tokenizers                0.15.1
torch                     2.2.0
tornado                   6.4
tqdm                      4.66.1
traitlets                 5.14.1
transformers              4.37.2
typer                     0.9.0
types-python-dateutil     2.8.19.20240106
typing_extensions         4.9.0
typing-inspect            0.9.0
tzdata                    2023.4
ujson                     5.9.0
uri-template              1.3.0
urllib3                   2.2.0
voyager                   2.0.2
wasabi                    1.1.2
wcwidth                   0.2.13
weasel                    0.3.4
webcolors                 1.13
webencodings              0.5.1
websocket-client          1.7.0
Werkzeug                  3.0.1
wrapt                     1.16.0
xxhash                    3.4.1
yarl                      1.9.4