AnglE

AnglE copied to clipboard

2D Matryoshka Sentence Embeddings

2

Thanks for your great work. Could you please provide the code for 2D Matryoshka Sentence Embeddings or any checkpoints?

vasilisvyth

AngIE motivation?

1

Hi author, I have a question: the so-called cosine similarity is actually a vector dot product, and there is no real cosine at all. When the gradient is calculated, there...

xiewen354

multi gpu use?

18

I am running out of memory on Tesla T4. I have 4 of them though and I usually use accelerator for multigpu setup. How can I use them for angle...

ganeshkrishnan1

Angle with bert-multilingual-base

1

I wanna ask whether it is possible and How to combine Angle and bert-multilingual-base to obtain a model similar to angle-bert-multilingual-base-uncased-nli-en-v1?

GCTTTTTT

ValueError: operands could not be broadcast together with shapes (38,384) (37,384)

6

Got this error while using this library to train an embedding model: ``` File "/usr/local/lib/python3.8/dist-packages/angle_emb/angle.py", line 986, in on_epoch_end corrcoef, accuracy = self.evaluate_fn(self.valid_ds) File "/usr/local/lib/python3.8/dist-packages/angle_emb/angle.py", line 1470, in evaluate pred...

williambarberjr

Difference in output when running via Trasformers.js and when hosting on Huggingface

1

I created an application that uses the UAE-large-V1 model inside Transformers.js and was able to embed sentences in a browser without issues. The model would return a single vector for...

jtmuller5

Thank you for your awesome project!! Can you provide the SimCSE-LLaMA2 code?

ChangeNext

Hi, To use the generated embeddings from [WhereIsAI/UAE-Large-V1](https://github.com/SeanLee97/AnglE) in an LLM model , do I first need to fine tune a pre-trained LLM model with [AnglE](https://github.com/SeanLee97/AnglE?tab=readme-ov-file#angle-llama) so that WhereIsAI/UAE-Large-V1 embeddings...

sergiosolorzano

When I install angle-emb and then try to load the Llama model, I get an error because `sentencepiece` is not installed. Maybe `sentencepiece` needs to be added as a requirement...

zachares

andersonbcdefg