Kalyan Chakravarthy Thadaka

What is the value of model_path in the above code?

Hi @Jeff-ZYX We acknowledge and appreciate the information you brought to our attention. Currently, we do not have a built-in rate restriction capability in our architecture for API instances. We...

Hi @JustHeroo, We have finished benchmarking the paul_graham dataset and now I am working on creating curated datasets for retrieval evaluation to do the benchmarking embedding models. I plan to...

Hi @Cabir40, Still, it is in progress, I am currently working alone on the **langtest** project and implementing a high priority feature similar to [**Open LLM Leaderboard**](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) by Hugging Face([Eleuther](https://github.com/EleutherAI/lm-evaluation-harness))....

Please be assured that we are working hard to make this feature available to you as soon as possible. We greatly appreciate your patience and understanding.

### De-Identification examples Category | Test Type | Original | Test Case | Expected | Actual | Pass -- | -- | -- | -- | -- | -- |...

I think you need to have access to GPU configuration from hugging face to handle it. and it's not a problem in nlptest but it is in the hugging face...