Building wheels for collected packages: tokenizers

[wangwendong1024]

Building wheels for collected packages: tokenizers Building wheel for tokenizers (pyproject.toml) ... error error: subprocess-exited-with-error

× Building wheel for tokenizers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [51 lines of output] running bdist_wheel running build running build_py creating build creating build\lib.win-amd64-cpython-312 creating build\lib.win-amd64-cpython-312\tokenizers copying py_src\tokenizers_init_.py -> build\lib.win-amd64-cpython-312\tokenizers creating build\lib.win-amd64-cpython-312\tokenizers\models copying py_src\tokenizers\models_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\models creating build\lib.win-amd64-cpython-312\tokenizers\decoders copying py_src\tokenizers\decoders_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\decoders creating build\lib.win-amd64-cpython-312\tokenizers\normalizers copying py_src\tokenizers\normalizers_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\normalizers creating build\lib.win-amd64-cpython-312\tokenizers\pre_tokenizers copying py_src\tokenizers\pre_tokenizers_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\pre_tokenizers creating build\lib.win-amd64-cpython-312\tokenizers\processors copying py_src\tokenizers\processors_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\processors creating build\lib.win-amd64-cpython-312\tokenizers\trainers copying py_src\tokenizers\trainers_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\trainers creating build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\base_tokenizer.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\bert_wordpiece.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\byte_level_bpe.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\char_level_bpe.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\sentencepiece_bpe.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations\sentencepiece_unigram.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations copying py_src\tokenizers\implementations_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\implementations creating build\lib.win-amd64-cpython-312\tokenizers\tools copying py_src\tokenizers\tools\visualizer.py -> build\lib.win-amd64-cpython-312\tokenizers\tools copying py_src\tokenizers\tools_init_.py -> build\lib.win-amd64-cpython-312\tokenizers\tools copying py_src\tokenizers_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers copying py_src\tokenizers\models_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\models copying py_src\tokenizers\decoders_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\decoders copying py_src\tokenizers\normalizers_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\normalizers copying py_src\tokenizers\pre_tokenizers_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\pre_tokenizers copying py_src\tokenizers\processors_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\processors copying py_src\tokenizers\trainers_init_.pyi -> build\lib.win-amd64-cpython-312\tokenizers\trainers copying py_src\tokenizers\tools\visualizer-styles.css -> build\lib.win-amd64-cpython-312\tokenizers\tools running build_ext running build_rust error: can't find Rust compiler

  If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.

  To update pip, run:

      pip install --upgrade pip

  and then retry package installation.

  If you did intend to build this package from source, try installing a Rust compiler from your system package manager and ensure it is on the PATH during installation. Alternatively, rustup (available at https://rustup.rs) is the recommended way to download and update the Rust compiler toolchain.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for tokenizers Failed to build tokenizers ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects