exo
exo copied to clipboard
Published
14 hours ago
•
exo-explore
exo-explore
A module that was compiled using NumPy 1.x cannot be run in NumPy 2.0.0
I can install the app using a fresh install of python 3.12.4 and the latest pip (using asdf on an m1 Mac).
When I run it, I get the following error. If I try to force install numpy 1.x, I get other dependency version errors requiring 2.0.0.
python main.py
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.
Traceback (most recent call last): File "/Users/me/code/exo/main.py", line 10, in <module>
from exo.api import ChatGPTAPI
File "/Users/me/code/exo/exo/api/__init__.py", line 1, in <module>
from exo.api.chatgpt_api import ChatGPTAPI as ChatGPTAPI
File "/Users/me/code/exo/exo/api/chatgpt_api.py", line 6, in <module>
from transformers import AutoTokenizer, AutoProcessor
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1577, in __getattr__
value = getattr(module, name)
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1576, in __getattr__
module = self._get_module(self._class_to_module[name])
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/utils/import_utils.py", line 1586, in _get_module
return importlib.import_module("." + module_name, self.__name__)
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/importlib/__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/models/auto/processing_auto.py", line 28, in <module>
from ...image_processing_utils import ImageProcessingMixin
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/image_processing_utils.py", line 21, in <module>
from .image_transforms import center_crop, normalize, rescale
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/transformers/image_transforms.py", line 49, in <module>
import tensorflow as tf
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/__init__.py", line 47, in <module>
from tensorflow._api.v2 import __internal__
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/_api/v2/__internal__/__init__.py", line 8, in <module>
from tensorflow._api.v2.__internal__ import autograph
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/_api/v2/__internal__/autograph/__init__.py", line 8, in <module>
from tensorflow.python.autograph.core.ag_ctx import control_status_ctx # line: 34
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/python/autograph/core/ag_ctx.py", line 21, in <module>
from tensorflow.python.autograph.utils import ag_logging
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/python/autograph/utils/__init__.py", line 17, in <module>
from tensorflow.python.autograph.utils.context_managers import control_dependency_on_returns
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/python/autograph/utils/context_managers.py", line 19, in <module>
from tensorflow.python.framework import ops
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/python/framework/ops.py", line 46, in <module>
from tensorflow.python import pywrap_tfe
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/tensorflow/python/pywrap_tfe.py", line 25, in <module>
from tensorflow.python._pywrap_tfe import *
Traceback (most recent call last):
File "/Users/me/.asdf/installs/python/3.12.3/lib/python3.12/site-packages/numpy/core/_multiarray_umath.py", line 44, in __getattr__
raise ImportError(msg)
It might be something about asdf. I'm using source install.sh to install from fresh (which uses venv) and works fine. Here are my installed packages:
(.venv) alex@Alexs-MBP exo % pip3 list
Package Version
---------------------------- ---------
aiohttp 3.9.5
aiohttp-cors 0.7.0
aiosignal 1.3.1
attrs 23.2.0
blobfile 2.1.1
certifi 2024.7.4
charset-normalizer 3.3.2
exo 0.0.1
filelock 3.15.4
frozenlist 1.4.1
fsspec 2024.6.1
grpcio 1.64.1
grpcio-tools 1.64.1
hf_transfer 0.1.8
huggingface-hub 0.24.5
idna 3.7
Jinja2 3.1.4
lxml 4.9.4
markdown-it-py 3.0.0
MarkupSafe 2.1.5
mdurl 0.1.2
mlx 0.16.0
mlx-lm 0.16.1
multidict 6.0.5
numpy 2.0.0
packaging 24.1
pillow 10.4.0
pip 24.0
prometheus_client 0.20.0
protobuf 5.27.1
psutil 6.0.0
pycryptodomex 3.20.0
Pygments 2.18.0
pynvml 11.5.3
pyobjc-core 10.3.1
pyobjc-framework-Cocoa 10.3.1
pyobjc-framework-libdispatch 10.3.1
pyobjc-framework-Metal 10.3.1
PyYAML 6.0.1
regex 2024.7.24
requests 2.32.3
rich 13.7.1
safetensors 0.4.3
sentencepiece 0.2.0
setuptools 72.1.0
tiktoken 0.7.0
tinygrad 0.9.1
tokenizers 0.19.1
tqdm 4.66.4
transformers 4.43.3
typing_extensions 4.12.2
urllib3 2.2.2
uuid 1.30
yarl 1.9.4
I ran into similar issue when installing the tensorflow package for exo's venv. Apparently in my case, exo needs numpy 2. to work. But tensorflow cannot work with some numpy>=1.x.x and they conflict. For me I installed pytorch instead and it worked. I see in the error message of @bricolage that he is also using tensorflow so that might be the case.
To my knowledge, currently tensorflow does not work with exo due to the above reason. @AlexCheema
P.S. I am using a linux with CUDA gpu.
Yeah this is a thing, putting this here for reference.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
accelerate 0.33.0 requires numpy<2.0.0,>=1.17, but you have numpy 2.0.0 which is incompatible.
I overcome a similar issue with uninstalling numpy and reinstalling latest 1.x.
pip uninstall numpy
pip install "numpy<2.0"
Im use mac os . I also encountered the same problem when executing pip3 install exo --e:
Installing collected packages: numpy
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gensim 4.3.3 requires numpy<2.0,>=1.18.5, but you have numpy 2.0.0 which is incompatible.
contourpy 1.2.0 requires numpy<2.0,>=1.20, but you have numpy 2.0.0 which is incompatible.
I tried to downgrade numpy to 1.26.4. I was told the following problem:
pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
exo 0.0.1 requires numpy==2.0.0, but you have numpy 1.26.4 which is incompatible.
