deep_training icon indicating copy to clipboard operation
deep_training copied to clipboard

Cannot install deep_training package

Open dyzdyz010 opened this issue 2 years ago • 4 comments

python: 3.10

command used: pip install deep_training

console output:

Collecting deep_training
  Using cached deep_training-0.1.12-py3-none-any.whl (483 kB)
Collecting lightning>=2 (from deep_training)
  Using cached lightning-2.0.6-py3-none-any.whl (1.9 MB)
Collecting numpy-io<0.1.0,>=0.0.7 (from deep_training)
  Using cached numpy_io-0.0.7-py3-none-any.whl (27 kB)
Requirement already satisfied: sentencepiece in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (0.1.98)
Requirement already satisfied: numpy in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.24.0)
Requirement already satisfied: transformers>=4.22 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (4.31.0)
Collecting seqmetric (from deep_training)
  Using cached seqmetric-0.1.2-py3-none-any.whl (17 kB)
Requirement already satisfied: scipy in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.11.1)
Collecting scikit-learn (from deep_training)
  Using cached scikit_learn-1.3.0-cp310-cp310-macosx_12_0_arm64.whl (9.5 MB)
Collecting tensorboard (from deep_training)
  Using cached tensorboard-2.13.0-py3-none-any.whl (5.6 MB)
Requirement already satisfied: tqdm in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (4.65.0)
Requirement already satisfied: six in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.16.0)
Requirement already satisfied: Jinja2<5.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (3.1.2)
Requirement already satisfied: PyYAML<8.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages/PyYAML-6.0-py3.10-macosx-11.1-arm64.egg (from lightning>=2->deep_training) (6.0)
Collecting arrow<3.0,>=1.2.0 (from lightning>=2->deep_training)
  Using cached arrow-1.2.3-py3-none-any.whl (66 kB)
Collecting backoff<4.0,>=2.2.1 (from lightning>=2->deep_training)
  Using cached backoff-2.2.1-py3-none-any.whl (15 kB)
Requirement already satisfied: beautifulsoup4<6.0,>=4.8.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (4.12.2)
Requirement already satisfied: click<10.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (8.1.6)
Collecting croniter<1.5.0,>=1.3.0 (from lightning>=2->deep_training)
  Using cached croniter-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting dateutils<2.0 (from lightning>=2->deep_training)
  Using cached dateutils-0.6.12-py2.py3-none-any.whl (5.7 kB)
Collecting deepdiff<8.0,>=5.7.0 (from lightning>=2->deep_training)
  Using cached deepdiff-6.3.1-py3-none-any.whl (70 kB)
Requirement already satisfied: fastapi<2.0,>=0.92.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.100.0)
Requirement already satisfied: fsspec<2025.0,>=2022.5.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2023.6.0)
Collecting inquirer<5.0,>=2.10.0 (from lightning>=2->deep_training)
  Using cached inquirer-3.1.3-py3-none-any.whl (18 kB)
Collecting lightning-cloud>=0.5.37 (from lightning>=2->deep_training)
  Using cached lightning_cloud-0.5.37-py3-none-any.whl (596 kB)
Collecting lightning-utilities<2.0,>=0.7.0 (from lightning>=2->deep_training)
  Using cached lightning_utilities-0.9.0-py3-none-any.whl (23 kB)
Requirement already satisfied: packaging in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (23.1)
Requirement already satisfied: psutil<7.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (5.9.5)
Requirement already satisfied: pydantic<2.1.0,>=1.7.4 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.10.11)
Collecting python-multipart<2.0,>=0.0.5 (from lightning>=2->deep_training)
  Using cached python_multipart-0.0.6-py3-none-any.whl (45 kB)
Requirement already satisfied: requests<4.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2.31.0)
Requirement already satisfied: rich<15.0,>=12.3.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (13.4.2)
Requirement already satisfied: starlette in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.27.0)
Collecting starsessions<2.0,>=1.2.1 (from lightning>=2->deep_training)
  Using cached starsessions-1.3.0-py3-none-any.whl (10 kB)
Requirement already satisfied: torch<4.0,>=1.11.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2.1.0.dev20230722)
Collecting torchmetrics<2.0,>=0.7.0 (from lightning>=2->deep_training)
  Using cached torchmetrics-1.0.1-py3-none-any.whl (729 kB)
Collecting traitlets<7.0,>=5.3.0 (from lightning>=2->deep_training)
  Using cached traitlets-5.9.0-py3-none-any.whl (117 kB)
Requirement already satisfied: typing-extensions<6.0,>=4.0.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (4.7.1)
Requirement already satisfied: urllib3<4.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.26.16)
Requirement already satisfied: uvicorn<2.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.23.1)
Requirement already satisfied: websocket-client<3.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.6.1)
Collecting websockets<13.0 (from lightning>=2->deep_training)
  Using cached websockets-11.0.3-cp310-cp310-macosx_11_0_arm64.whl (121 kB)
Collecting pytorch-lightning (from lightning>=2->deep_training)
  Using cached pytorch_lightning-2.0.6-py3-none-any.whl (722 kB)
Collecting fastdatasets<=0.9.20,>=0.9.14 (from numpy-io<0.1.0,>=0.0.7->deep_training)
  Using cached fastdatasets-0.9.15-py3-none-any.whl (60 kB)
Requirement already satisfied: filelock in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (3.12.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.16.4)
Requirement already satisfied: regex!=2019.12.17 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (2023.6.3)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.3.1)
Requirement already satisfied: joblib>=1.1.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from scikit-learn->deep_training) (1.3.1)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->deep_training)
  Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Collecting absl-py>=0.4 (from tensorboard->deep_training)
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting grpcio>=1.48.2 (from tensorboard->deep_training)
  Using cached grpcio-1.56.2-cp310-cp310-macosx_12_0_universal2.whl (8.8 MB)
Requirement already satisfied: google-auth<3,>=1.6.3 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (2.22.0)
Collecting google-auth-oauthlib<1.1,>=0.5 (from tensorboard->deep_training)
  Using cached google_auth_oauthlib-1.0.0-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: markdown>=2.6.8 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (3.3.7)
Requirement already satisfied: protobuf>=3.19.6 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (4.23.4)
Requirement already satisfied: setuptools>=41.0.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (65.6.3)
Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->deep_training)
  Using cached tensorboard_data_server-0.7.1-py3-none-any.whl (2.4 kB)
Collecting werkzeug>=1.0.1 (from tensorboard->deep_training)
  Using cached Werkzeug-2.3.6-py3-none-any.whl (242 kB)
Requirement already satisfied: wheel>=0.26 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (0.38.4)
Requirement already satisfied: python-dateutil>=2.7.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from arrow<3.0,>=1.2.0->lightning>=2->deep_training) (2.8.2)
Requirement already satisfied: soupsieve>1.2 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from beautifulsoup4<6.0,>=4.8.0->lightning>=2->deep_training) (2.4.1)
Requirement already satisfied: pytz in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from dateutils<2.0->lightning>=2->deep_training) (2023.3)
Collecting ordered-set<4.2.0,>=4.0.2 (from deepdiff<8.0,>=5.7.0->lightning>=2->deep_training)
  Using cached ordered_set-4.1.0-py3-none-any.whl (7.6 kB)
INFO: pip is looking at multiple versions of fastdatasets to determine which version is compatible with other requirements. This could take a while.
Collecting fastdatasets<=0.9.20,>=0.9.14 (from numpy-io<0.1.0,>=0.0.7->deep_training)
  Using cached fastdatasets-0.9.14-py3-none-any.whl (59 kB)
ERROR: Cannot install numpy-io because these package versions have conflicting dependencies.

The conflict is caused by:
    fastdatasets 0.9.15 depends on tfrecords<0.3 and >=0.2.12
    fastdatasets 0.9.14 depends on tfrecords<0.3 and >=0.2.12

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

dyzdyz010 avatar Jul 26 '23 02:07 dyzdyz010

try: pip install -i https://pypi.org/simple deep_training

ssbuild avatar Jul 26 '23 02:07 ssbuild

No luck, still the same error.

dyzdyz010 avatar Jul 26 '23 02:07 dyzdyz010

tfrecords support only linux or windows , if macos , may instal failed.

ssbuild avatar Jul 26 '23 02:07 ssbuild

any plans to support macOS?

dyzdyz010 avatar Jul 26 '23 03:07 dyzdyz010