ArshaanNazir comments

Results 6 comments of


                                            ArshaanNazir

Preparing Embeddings Benchmarks (LangTest)

@Cabir40 Kalyan is working on it. He will be enhancing embedding benchmarks for other retrieval tasks. He is working on FinBERT-QA right now.

Preparing LLM Benchmark Table ( LangTest)

We are working on it. Here is the link to the tracking sheet: https://johnsnowlabs-my.sharepoint.com/:x:/p/rakshit/ETX1Z44PipFOqm8Ue8Av3_UBycHH_9oK-oJJUpQfc_n54w?e=exe0Ja

Preparing LLM Benchmark Table ( LangTest)

We have created the streamlit apps for both of the benchmark tables. We are finalising their design and will be update on website by end of this week.

Preparing LLM Benchmark Table ( LangTest)

I am not sure if we are going ahead with the streamlit apps now. @dcecchini can you confirm ?

Add tests for RAG

Implement in library but give reference.

Curate datataset for bias from CNN/Daily Mail

This dataset has news articles/reports. So it is generally referring to popular people. So the replace tests we have in bias may not make sense.