Jimmy Lin

Results 264 comments of Jimmy Lin

Yes, I think so - this should be lower priority atm.

Adding @gauravbaruah @tuzhucheng @HTAustin to this thread - we need some sort of integration testing framework...

@daemon not's not store a not-so-good model :) Let's store once we get up to replication numbers at least?

Let's try reranking only the top 100 docs, instead of top 1000. NDCG is the right metric here; AP will likely be bad.

Hi @Impavidity I just saw commit 34a71f29192ed57f83d8576002f2b540de7d722f Wouldn't it make more sense just to assume that BuboQA is already checked out? i.e., ``` . |--- BuboQA |--- BuboQA-data ``` And...

Hrmm... it seems like we still don't have an end-to-end demo?

@binjiaqm @nlpjoe Unfortunately, the e2e server is broken... @aliceranzhou is graduating and @Impavidity is away at an internship for the summer, so it is unclear when we're going to have...

We want to look at wikiQA, [InsuranceQA](https://github.com/shuzi/insuranceQA), and SQuAD assigning to @rosequ

We have WikiQA merged in https://github.com/castorini/Castor/pull/64

This is actually a much harder problem then it seems... and dates back more than ~20 years, at the dawn of web search. The problem back then was how to...