rust-bert

rust-bert copied to clipboard

trying to run examples on Mac M1

1

Trying to build some examples on a Mac M1. However, I get errors like this: ` Running /rust-bert/target/debug/convert-tensor sentiment_analysis.rs dyld[21044]: symbol not found in flat namespace (__ZN2at4_ops5zeros4callEN3c108ArrayRefIxEENS2_8optionalINS2_10ScalarTypeEEENS5_INS2_6LayoutEEENS5_INS2_6DeviceEEENS5_IbEE) [1] 21044 abort`...

raoulg

How to load the quantized sentence transformer model?

2

Hi, Thanks for your wonderful effort in keeping this crate live and updated. I just tested the updated version for the sentence embedding pipeline. it works awesome with the standard...

vimal-quilt

Failed to run custom build command for torch-sys v0.7.2

6

Hi, unfortunately I got this error Rustc 1.61.0 nightly Libtorch instalation: manual Libtorch version: v1.11.0 cxx11 abi + cu113 -> Using v.1.12.0+cpu from docs link I'm getting `error: failed to...

Raduc4

cargo run doesn`t work as expected!

11

hello when i want to execute the project the following errors accures : **The following warnings were emitted during compilation: warning: libtch/torch_api.cpp:4:10: fatal error: torch/csrc/jit/passes/normalize_ops.h: No such file or directory...

SorooshMortazavi

"Extract" Keywords from text

1

👋 How can I "extract" keywords from some text using this crate? I was following [this article](https://towardsdatascience.com/keyword-extraction-python-tf-idf-textrank-topicrank-yake-bert-7405d51cd839) for python and was wondering if I could do something similar using rust-bert....

felippemr

Question STT?

1

Hey! can this be used for speech to text processing? I daut it, I just want to be sure :) thank you

The-Mr-L

How to add suppor for the CodeBERT model?

10

I wonder how to support CodeBERT: https://huggingface.co/microsoft/codebert-base. It is popular in deep code learning and is based on RoBERTa. The python code base is here: https://github.com/microsoft/CodeBERT. If you don't have...

yijunyu

Question:Help: EncoderDecoderModel support?

1

Is it EncoderDecoderModel supported? I have a simple working example in Python: ---------------------------------------- from transformers import EncoderDecoderModel from transformers import BertTokenizerFast model = EncoderDecoderModel.from_pretrained("remotejob/bert2bertv4_v0") tokenizer = BertTokenizerFast.from_pretrained("remotejob/bert2bertv4_v0") ask = "Kuka...

remotejob

Chunking and sentence detection?

2

Hi there, I work on a project that currently uses opennlp, but we're considering switching our code over to rust, and rust-bert seems like a natural fit. We use opennlp...

SFosterQRA

WASM support

9

I'm creating this issue because I couldn't figure it out on my own. 1. **Can rust-bert support WASM**? The issue I had trying to refactor this crate on my own...

genderev