projecthorizon993
projecthorizon993
I solved it it a bug when setup enviroment
nope still 3.10.12 still have that bug idk what todo still tokenizer issue
> same problem on ArchLinux fixed the tokenizer this one mental abuse me for over a week Commit hash: 82a973c04367123ae98bd9abdf80d9eda9b910e2 Launching Web UI with arguments: --listen --theme dark --skip-torch-cuda-test --no-half...
> This could be caused by incorrect rustc version? > > I have issue with toenizers as well on my Arch Linux, in my error log it hints I should...
> This could be caused by incorrect rustc version? > > I have issue with toenizers as well on my Arch Linux, in my error log it hints I should...
> Getting the same problem on my M1 Mac. Tried downgrading to rust 1.65 and python 3.10.12 > > ``` > error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v...
> It looks original sources are already fixed (with `unsafe` keyword) > > https://github.com/huggingface/tokenizers/blob/6ea758872d74a0f1c4cd5b6a56e0fdd4f3a10418/tokenizers/src/models/bpe/trainer.rs#L540-L547 > > So... is there a update of python libs? (I can't find what library uses...