tokenizers
tokenizers copied to clipboard
huggingface
Failed to build installable wheels
Output
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml): started
Building wheel for tokenizers (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [561 lines of output]
...
error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
--> tokenizers-lib/src/models/bpe/trainer.rs:517:47
|
513 | let w = &words[*i] as *const _ as *mut _;
| -------------------------------- casting happened here
...
517 | let word: &mut Word = &mut (*w);
| ^^^^^^^^^
|
= note: for more information, visit <https://doc.rust-lang.org/book/ch15-05-interior-mutability.html>
= note: `#[deny(invalid_reference_casting)]` on by default
...
warning: `tokenizers` (lib) generated 8 warnings
error: could not compile `tokenizers` (lib) due to 1 previous error; 8 warnings emitted
Caused by:
process didn't exit successfully: `/home/runner/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/bin/rustc --crate-name tokenizers --edition=2018 tokenizers-lib/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="indicatif"' --cfg 'feature="progressbar"' --check-cfg 'cfg(docsrs,test)' --check-cfg 'cfg(feature, values("default", "indicatif", "progressbar"))' -C metadata=51d9c7d9db92ae43 -C extra-filename=-bb93a95a888a37c5 --out-dir /tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps -C strip=debuginfo -L dependency=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps --extern clap=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee082384bfa9f47385386d88bf6/target/release/deps/libclap-9e49d0a21e9c384a.rmeta --extern derive_builder=/tmp/pip-install-70_zsnm3/tokenizers_5feb3ee08
warning: build failed, waiting for other jobs to finish...
error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --` failed with code 101
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
error: failed-wheel-build-for-install
× Failed to build installable wheels for some pyproject.toml based projects
╰─> tokenizers
First identified at Nov 2, 9:38 AM GMT+8 Last operational time: Oct 26, 9:36 AM GMT+8
System: Ubuntu (GitHub Actions)
Command: python -m pip install huggingface_hub[cli] transformers
Python version: 3.12
It seems to be a dependency problem. The failed attempt tries to install tokenizer 0.10.3. It is highly possible to be related to huggingface_hub package
For comparison, the successful installation log:
Collecting transformers
Downloading transformers-4.57.1-py3-none-any.whl.metadata (43 kB)
Collecting huggingface_hub[cli]
Downloading huggingface_hub-0.36.0-py3-none-any.whl.metadata (14 kB)
Collecting filelock (from huggingface_hub[cli])
Downloading filelock-3.20.0-py3-none-any.whl.metadata (2.1 kB)
Collecting fsspec>=2023.5.0 (from huggingface_hub[cli])
Downloading fsspec-2025.9.0-py3-none-any.whl.metadata (10 kB)
Collecting packaging>=20.9 (from huggingface_hub[cli])
Downloading packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
Collecting pyyaml>=5.1 (from huggingface_hub[cli])
Downloading pyyaml-6.0.3-cp3[12](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:13)-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB)
Collecting requests (from huggingface_hub[cli])
Downloading requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)
Collecting tqdm>=4.42.1 (from huggingface_hub[cli])
Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting typing-extensions>=3.7.4.3 (from huggingface_hub[cli])
Downloading typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB)
Collecting hf-xet<2.0.0,>=1.1.3 (from huggingface_hub[cli])
Downloading hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)
Collecting InquirerPy==0.3.4 (from huggingface_hub[cli])
Downloading InquirerPy-0.3.4-py3-none-any.whl.metadata (8.1 kB)
Collecting pfzy<0.4.0,>=0.3.1 (from InquirerPy==0.3.4->huggingface_hub[cli])
Downloading pfzy-0.3.4-py3-none-any.whl.metadata (4.9 kB)
Collecting prompt-toolkit<4.0.0,>=3.0.1 (from InquirerPy==0.3.4->huggingface_hub[cli])
Downloading prompt_toolkit-3.0.52-py3-none-any.whl.metadata (6.4 kB)
Collecting wcwidth (from prompt-toolkit<4.0.0,>=3.0.1->InquirerPy==0.3.4->huggingface_hub[cli])
Downloading wcwidth-0.2.14-py2.py3-none-any.whl.metadata (15 kB)
Collecting numpy>=1.17 (from transformers)
Downloading numpy-2.3.4-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
Collecting regex!=2019.12.17 (from transformers)
Downloading regex-2025.10.23-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB)
Collecting tokenizers<=0.23.0,>=0.22.0 (from transformers)
Downloading tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB)
Collecting safetensors>=0.4.3 (from transformers)
Downloading safetensors-0.6.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Collecting charset_normalizer<4,>=2 (from requests->huggingface_hub[cli])
Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB)
Collecting idna<4,>=2.5 (from requests->huggingface_hub[cli])
Downloading idna-3.11-py3-none-any.whl.metadata (8.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests->huggingface_hub[cli])
Downloading urllib3-2.5.0-py3-none-any.whl.metadata (6.5 kB)
Collecting certifi>=2017.4.17 (from requests->huggingface_hub[cli])
Downloading certifi-2025.10.5-py3-none-any.whl.metadata (2.5 kB)
Downloading huggingface_hub-0.36.0-py3-none-any.whl (566 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 566.1/566.1 kB 72.6 MB/s 0:00:00
Downloading InquirerPy-0.3.4-py3-none-any.whl (67 kB)
Downloading hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 231.0 MB/s 0:00:00
Downloading pfzy-0.3.4-py3-none-any.whl (8.5 kB)
Downloading prompt_toolkit-3.0.52-py3-none-any.whl (391 kB)
Downloading transformers-4.57.1-py3-none-any.whl (12.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 271.2 MB/s 0:00:00
Downloading tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 187.8 MB/s 0:00:00
Downloading fsspec-2025.9.0-py3-none-any.whl (199 kB)
Downloading numpy-2.3.4-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (16.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.6/16.6 MB 288.4 MB/s 0:00:00
Downloading packaging-25.0-py3-none-any.whl (66 kB)
Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (807 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.9/807.9 kB 123.4 MB/s 0:00:00
Downloading regex-2025.10.23-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (803 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 803.4/803.4 kB [13](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:14)3.3 MB/s 0:00:00
Downloading safetensors-0.6.2-cp38-abi3-manylinux_2_17_x86_64.manylinux20[14](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:15)_x86_64.whl (485 kB)
Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
Downloading typing_extensions-4.[15](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:16).0-py3-none-any.whl (44 kB)
Downloading filelock-3.20.0-py3-none-any.whl ([16](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:17) kB)
Downloading requests-2.32.5-py3-none-any.whl (64 kB)
Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_[17](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:18)_x86_64.manylinux_2_28_x86_64.whl (153 kB)
Downloading idna-3.11-py3-none-any.whl (71 kB)
Downloading urllib3-2.5.0-py3-none-any.whl (129 kB)
Downloading certifi-2025.10.5-py3-none-any.whl (163 kB)
Downloading wcwidth-0.2.14-py2.py3-none-any.whl (37 kB)
Installing collected packages: wcwidth, urllib3, typing-extensions, tqdm, safetensors, regex, pyyaml, pfzy, packaging, numpy, idna, hf-xet, fsspec, filelock, charset_normalizer, certifi, requests, prompt-toolkit, InquirerPy, huggingface_hub, tokenizers, transformers
Successfully installed InquirerPy-0.3.4 certifi-[20](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:21)25.10.5 charset_normalizer-3.4.4 filelock-3.20.0 fsspec-2025.9.0 hf-xet-1.2.0 huggingface_hub-0.36.0 idna-3.11 numpy-2.3.4 packaging-25.0 pfzy-0.3.4 prompt-toolkit-3.0.52 pyyaml-6.0.3 regex-2025.10.23 requests-2.32.5 safetensors-0.6.2 tokenizers-0.[22](https://github.com/BrandonStudio-CITest/HuggingFaceMirror-Workers/actions/runs/18811186814/job/53672581522#step:4:23).1 tqdm-4.67.1 transformers-4.57.1 typing-extensions-4.15.0 urllib3-2.5.0 wcwidth-0.2.14
The failed one:
Collecting transformers
Downloading transformers-4.57.1-py3-none-any.whl.metadata (43 kB)
Collecting huggingface_hub[cli]
Downloading huggingface_hub-1.1.4-py3-none-any.whl.metadata (13 kB)
WARNING: huggingface-hub 1.1.4 does not provide the extra 'cli'
Collecting filelock (from huggingface_hub[cli])
Downloading filelock-3.20.0-py3-none-any.whl.metadata (2.1 kB)
Collecting fsspec>=2023.5.0 (from huggingface_hub[cli])
Downloading fsspec-2025.10.0-py3-none-any.whl.metadata (10 kB)
Collecting hf-xet<2.0.0,>=1.2.0 (from huggingface_hub[cli])
Downloading hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)
Collecting httpx<1,>=0.23.0 (from huggingface_hub[cli])
Downloading httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB)
Collecting packaging>=20.9 (from huggingface_hub[cli])
Downloading packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
Collecting pyyaml>=5.1 (from huggingface_hub[cli])
Downloading pyyaml-6.0.3-cp3[12](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:13)-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB)
Collecting shellingham (from huggingface_hub[cli])
Downloading shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting tqdm>=4.42.1 (from huggingface_hub[cli])
Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting typer-slim (from huggingface_hub[cli])
Downloading typer_slim-0.20.0-py3-none-any.whl.metadata (16 kB)
Collecting typing-extensions>=3.7.4.3 (from huggingface_hub[cli])
Downloading typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB)
Collecting anyio (from httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading anyio-4.11.0-py3-none-any.whl.metadata (4.1 kB)
Collecting certifi (from httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading certifi-2025.11.12-py3-none-any.whl.metadata (2.5 kB)
Collecting httpcore==1.* (from httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading httpcore-1.0.9-py3-none-any.whl.metadata (21 kB)
Collecting idna (from httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading idna-3.11-py3-none-any.whl.metadata (8.4 kB)
Collecting h11>=0.16 (from httpcore==1.*->httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading h11-0.16.0-py3-none-any.whl.metadata (8.3 kB)
INFO: pip is looking at multiple versions of transformers to determine which version is compatible with other requirements. This could take a while.
Collecting transformers
Downloading transformers-4.56.2-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.56.1-py3-none-any.whl.metadata (42 kB)
Downloading transformers-4.56.0-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.55.4-py3-none-any.whl.metadata (41 kB)
Downloading transformers-4.55.3-py3-none-any.whl.metadata (41 kB)
Downloading transformers-4.55.2-py3-none-any.whl.metadata (41 kB)
Downloading transformers-4.55.1-py3-none-any.whl.metadata (41 kB)
INFO: pip is still looking at multiple versions of transformers to determine which version is compatible with other requirements. This could take a while.
Downloading transformers-4.55.0-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.54.1-py3-none-any.whl.metadata (41 kB)
Downloading transformers-4.54.0-py3-none-any.whl.metadata (41 kB)
Downloading transformers-4.53.3-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.53.2-py3-none-any.whl.metadata (40 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Downloading transformers-4.53.1-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.53.0-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.52.4-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.52.3-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.52.2-py3-none-any.whl.metadata (40 kB)
Downloading transformers-4.52.1-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.51.3-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.51.2-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.51.1-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.51.0-py3-none-any.whl.metadata (38 kB)
Downloading transformers-4.50.3-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.50.2-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.50.1-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.50.0-py3-none-any.whl.metadata (39 kB)
Downloading transformers-4.49.0-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.48.3-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.48.2-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.48.1-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.48.0-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.47.1-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.47.0-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.46.3-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.46.2-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.46.1-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.45.2-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.45.1-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.45.0-py3-none-any.whl.metadata (44 kB)
Downloading transformers-4.44.2-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.44.1-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.44.0-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.43.4-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.43.3-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.43.2-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.43.1-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.43.0-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.42.4-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.42.3-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.42.2-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.42.1-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.42.0-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.41.2-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.41.1-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.41.0-py3-none-any.whl.metadata (43 kB)
Downloading transformers-4.40.2-py3-none-any.whl.metadata ([13](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:14)7 kB)
Downloading transformers-4.40.1-py3-none-any.whl.metadata (137 kB)
Downloading transformers-4.40.0-py3-none-any.whl.metadata (137 kB)
Downloading transformers-4.39.3-py3-none-any.whl.metadata (134 kB)
Downloading transformers-4.39.2-py3-none-any.whl.metadata (134 kB)
Downloading transformers-4.39.1-py3-none-any.whl.metadata (134 kB)
Downloading transformers-4.39.0-py3-none-any.whl.metadata (134 kB)
Downloading transformers-4.38.2-py3-none-any.whl.metadata (130 kB)
Downloading transformers-4.38.1-py3-none-any.whl.metadata (131 kB)
Downloading transformers-4.38.0-py3-none-any.whl.metadata (131 kB)
Downloading transformers-4.37.2-py3-none-any.whl.metadata (129 kB)
Downloading transformers-4.37.1-py3-none-any.whl.metadata (129 kB)
Downloading transformers-4.37.0-py3-none-any.whl.metadata (129 kB)
Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB)
Downloading transformers-4.36.1-py3-none-any.whl.metadata (126 kB)
Downloading transformers-4.36.0-py3-none-any.whl.metadata (126 kB)
Downloading transformers-4.35.2-py3-none-any.whl.metadata (123 kB)
Downloading transformers-4.35.1-py3-none-any.whl.metadata (123 kB)
Downloading transformers-4.35.0-py3-none-any.whl.metadata (123 kB)
Downloading transformers-4.34.1-py3-none-any.whl.metadata (121 kB)
Downloading transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
Downloading transformers-4.33.3-py3-none-any.whl.metadata (119 kB)
Downloading transformers-4.33.2-py3-none-any.whl.metadata (119 kB)
Downloading transformers-4.33.1-py3-none-any.whl.metadata (119 kB)
Downloading transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
Downloading transformers-4.32.1-py3-none-any.whl.metadata (118 kB)
Downloading transformers-4.32.0-py3-none-any.whl.metadata (118 kB)
Downloading transformers-4.31.0-py3-none-any.whl.metadata (116 kB)
Downloading transformers-4.30.2-py3-none-any.whl.metadata (113 kB)
Downloading transformers-4.30.1-py3-none-any.whl.metadata (113 kB)
Downloading transformers-4.30.0-py3-none-any.whl.metadata (113 kB)
Downloading transformers-4.29.2-py3-none-any.whl.metadata (112 kB)
Downloading transformers-4.29.1-py3-none-any.whl.metadata (112 kB)
Downloading transformers-4.29.0-py3-none-any.whl.metadata (111 kB)
Downloading transformers-4.28.1-py3-none-any.whl.metadata (109 kB)
Downloading transformers-4.28.0-py3-none-any.whl.metadata (109 kB)
Downloading transformers-4.27.4-py3-none-any.whl.metadata (106 kB)
Downloading transformers-4.27.3-py3-none-any.whl.metadata (106 kB)
Downloading transformers-4.27.2-py3-none-any.whl.metadata (106 kB)
Downloading transformers-4.27.1-py3-none-any.whl.metadata (106 kB)
Downloading transformers-4.27.0-py3-none-any.whl.metadata (106 kB)
Downloading transformers-4.26.1-py3-none-any.whl.metadata (100 kB)
Downloading transformers-4.26.0-py3-none-any.whl.metadata (100 kB)
Downloading transformers-4.25.1-py3-none-any.whl.metadata (93 kB)
Downloading transformers-4.24.0-py3-none-any.whl.metadata (90 kB)
Downloading transformers-4.23.1-py3-none-any.whl.metadata (88 kB)
Downloading transformers-4.23.0-py3-none-any.whl.metadata (88 kB)
Downloading transformers-4.22.2-py3-none-any.whl.metadata (84 kB)
Downloading transformers-4.22.1-py3-none-any.whl.metadata (84 kB)
Downloading transformers-4.22.0-py3-none-any.whl.metadata (84 kB)
Downloading transformers-4.21.3-py3-none-any.whl.metadata (81 kB)
Downloading transformers-4.21.2-py3-none-any.whl.metadata (81 kB)
Downloading transformers-4.21.1-py3-none-any.whl.metadata (81 kB)
Downloading transformers-4.21.0-py3-none-any.whl.metadata (81 kB)
Downloading transformers-4.20.1-py3-none-any.whl.metadata (77 kB)
Downloading transformers-4.20.0-py3-none-any.whl.metadata (77 kB)
Downloading transformers-4.19.4-py3-none-any.whl.metadata (73 kB)
Downloading transformers-4.19.3-py3-none-any.whl.metadata (73 kB)
Downloading transformers-4.19.2-py3-none-any.whl.metadata (73 kB)
Downloading transformers-4.19.1-py3-none-any.whl.metadata (73 kB)
Downloading transformers-4.19.0-py3-none-any.whl.metadata (73 kB)
Downloading transformers-4.18.0-py3-none-any.whl.metadata (70 kB)
Downloading transformers-4.17.0-py3-none-any.whl.metadata (67 kB)
Downloading transformers-4.16.2-py3-none-any.whl.metadata (61 kB)
Downloading transformers-4.16.1-py3-none-any.whl.metadata (61 kB)
Downloading transformers-4.16.0-py3-none-any.whl.metadata (61 kB)
Downloading transformers-4.15.0-py3-none-any.whl.metadata (59 kB)
Downloading transformers-4.[14](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:15).1-py3-none-any.whl.metadata (59 kB)
Downloading transformers-4.13.0-py3-none-any.whl.metadata (59 kB)
Downloading transformers-4.12.5-py3-none-any.whl.metadata (56 kB)
Downloading transformers-4.12.4-py3-none-any.whl.metadata (56 kB)
Downloading transformers-4.12.3-py3-none-any.whl.metadata (56 kB)
Downloading transformers-4.12.2-py3-none-any.whl.metadata (56 kB)
Collecting numpy>=1.17 (from transformers)
Downloading numpy-2.3.4-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
Collecting regex!=2019.12.17 (from transformers)
Downloading regex-2025.11.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB)
Collecting requests (from transformers)
Downloading requests-2.32.5-py3-none-any.whl.metadata (4.9 kB)
Collecting sacremoses (from transformers)
Downloading sacremoses-0.1.1-py3-none-any.whl.metadata (8.3 kB)
Collecting tokenizers<0.11,>=0.10.1 (from transformers)
Downloading tokenizers-0.10.3.tar.gz (212 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting sniffio>=1.1 (from anyio->httpx<1,>=0.23.0->huggingface_hub[cli])
Downloading sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting charset_normalizer<4,>=2 (from requests->transformers)
Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB)
Collecting urllib3<3,>=1.21.1 (from requests->transformers)
Downloading urllib3-2.5.0-py3-none-any.whl.metadata (6.5 kB)
Collecting click (from sacremoses->transformers)
Downloading click-8.3.1-py3-none-any.whl.metadata (2.6 kB)
Collecting joblib (from sacremoses->transformers)
Downloading joblib-1.5.2-py3-none-any.whl.metadata (5.6 kB)
Downloading huggingface_hub-1.1.4-py3-none-any.whl (5[15](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:16) kB)
Downloading hf_xet-1.2.0-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 159.1 MB/s 0:00:00
Downloading httpx-0.28.1-py3-none-any.whl (73 kB)
Downloading httpcore-1.0.9-py3-none-any.whl (78 kB)
Downloading transformers-4.12.2-py3-none-any.whl (3.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 149.0 MB/s 0:00:00
Downloading fsspec-2025.10.0-py3-none-any.whl (200 kB)
Downloading h11-0.[16](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:17).0-py3-none-any.whl (37 kB)
Downloading numpy-2.3.4-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (16.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.6/16.6 MB 184.9 MB/s 0:00:00
Downloading packaging-25.0-py3-none-any.whl (66 kB)
Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_[17](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:18)_x86_64.manylinux_2_28_x86_64.whl (807 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.9/807.9 kB 97.0 MB/s 0:00:00
Downloading regex-2025.11.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (803 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 803.5/803.5 kB 110.3 MB/s 0:00:00
Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
Downloading typing_extensions-4.15.0-py3-none-any.whl (44 kB)
Downloading anyio-4.11.0-py3-none-any.whl (109 kB)
Downloading idna-3.11-py3-none-any.whl (71 kB)
Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
Downloading certifi-[20](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:21)25.11.12-py3-none-any.whl (159 kB)
Downloading filelock-3.20.0-py3-none-any.whl (16 kB)
Downloading requests-2.32.5-py3-none-any.whl (64 kB)
Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB)
Downloading urllib3-2.5.0-py3-none-any.whl (129 kB)
Downloading sacremoses-0.1.1-py3-none-any.whl (897 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 897.5/897.5 kB 1[22](https://github.com/BrandonStudio/HuggingFaceMirror-Workers/actions/runs/19397915096/job/55500653363#step:4:23).5 MB/s 0:00:00
Downloading click-8.3.1-py3-none-any.whl (108 kB)
Downloading joblib-1.5.2-py3-none-any.whl (308 kB)
Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Downloading typer_slim-0.20.0-py3-none-any.whl (47 kB)
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml): started
Building wheel for tokenizers (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
Find the problem: https://github.com/huggingface/transformers/blob/8cb5963cc22174954e7dca2c0a3320b7dc2f4edc/setup.py#L118
