rust-bert
rust-bert copied to clipboard
guillaume-be
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
I think this is separate to #85 so I have created a new issue. The little chatbot I am writing always gives empty blank responses after about 7-12 rounds of...
1. Add support for loading local model in SequenceClassificationConfig: Somtimes, the https://huggingface.co/models doesn't contains a rust model (eg. rust_model.ot) of some bert. Hence, it's necessary to load local model easily...
- [x] Implement NLLB tokenizer: https://github.com/guillaume-be/rust-tokenizers/pull/76 (waiting for review). - [x] Extend language enum: ISO [tables](https://iso639-3.sil.org/) was used. - [ ] Add resources links (block: model is not converted). -...
maybe there it is https://huggingface.co/bigscience/bloom
Hello! Facebook No Language Left Behind description page: https://github.com/facebookresearch/fairseq/tree/nllb ## Huggingface It's already hosted in Huggingface. https://huggingface.co/facebook/nllb-200-1.3B https://huggingface.co/facebook/nllb-200-3.3B https://huggingface.co/facebook/nllb-200-distilled-600M ## Plan [ ] Merge NLLB support into `rust-tokenizers`: https://github.com/guillaume-be/rust-tokenizers/pull/76 [...
error when i use a private resource `Endpoint not available error: HTTP status client error (401 Unauthorized) for url (https://huggingface.co/jeanvydes/jane/resolve/main/vocab.json)`
I run a sentence-transformer in a http service to serve requests. And I've ran into OOM a few times during `encode` and noticed that it returns an error instead of...
Hi @jondot @guillaume-be I work on a [llm-fraud-detection](https://github.com/Philipp-Sc/llm-fraud-detection) library using **rust-bert** and llama.cpp. In the process of updating the repo, I like to test **DeBERTaV2** for my zero shot classification...
Please merge this after following PR on HuggingFace successfully merged. **ref:** https://huggingface.co/bert-large-uncased/tree/refs%2Fpr%2F2 **discussion:** https://huggingface.co/bert-large-uncased/discussions/2
Metadata
Owner
Metadata
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)