Vaibhav Adlakha

I installed EvalAI locally following the instructions in the [documentation](https://evalai.readthedocs.io/en/latest/installation.html). However, CLI commands are not working with local host Steps to reproduce: 1. Run EvalAI on localhost ``` $ cd...

Thank you for the great work and releasing the datasets and models. I downloaded the MEDI dataset few months ago and the length of the dataset in that file is...

Hello, Thank you for this very interesting work. Do you plan to release pre-trained checkpoints?

Refactor prompt template formation

1

Currently prompt template design is implemented [here](https://github.com/McGill-NLP/llm2vec/blob/c5cb6d7d07d65d4fd1cd2d508896ea0ab4604822/llm2vec/llm2vec.py#L140), which means the package needs to be edited for any new model or a different template. It should be shifted to training script

Conversation Retrieval Task and TopiOCQA dataset

4

## Checklist for adding MMTEB dataset Reason for dataset addition: - [ ] I have tested that the dataset runs with the `mteb` package. - [ ] I have run...

Hi, Thanks for sharing this very interesting work. I had a question about how the bidirectional attention mask is implemented [here](https://github.com/WhereIsAI/BiLLM/blob/main/src/billm/modeling_mistral.py#L141) Based on this implementation, it seems like even the...