stark

stark copied to clipboard

What do the ids mean after each query?

1

Initially I thought it is "qualified product ids", then I realize the query id is also in the list. e.g. 334460,What are some Tercel women's cycling gloves made in China...

HuangLED

Problems with Python 3.8

1

Hi, you mentioned that Python 3.8 is required. I tried this on my mac + conda I got an error ` ERROR: Ignored the following versions that require a different...

tobiasoberrauch

STaRK-Prime answers wrong?

4

During my exploration of the STaRK-Prime dataset, I looked into a few questions (human-generated ones specifically). I've discovered a couple of answers that I find strange, where the answer to...

LacombeLouis

could you provide the topic entity in each sentence?

5

ToneLi

the ansewer ID of amazon is not in the provided amazon KG

2

Hi , Could you help us to check why the answer id in Amazon is not the the provided amazon KG file? for example, answer id 16.  thanks!

ToneLi

API issues

1

I am trying to implement the avatar paper, but i run into the following error during the same: ImportError: cannot import name 'get_openai_embedding' from 'stark_qa.tools' The documentation mentions of stark_qa.tools.api....

Sanchit-404

It appears that `bm25s` is used in requirements.txt. However, in the readme, it recommends to use `pip install bm25` instead of `pip install bm25s`, so I updated the readme to...

xhluca

Problem about the recall@20

2

What a great benchmark! I have a problem about the recall@20 metric. In the article, you said that recall@k = 20 is used, and the VSS + LLM Reranker baseline...

srymaker