Wrong calculation in table_qa

[tiwari93]

Hi,

For below table I search "total profit for delhi?" in table qa pipeline.

Delhi is not in the table but it's calculating sum of profit for all the rows.

It seems to be happen for each table if the search keyword is not in the table. Please suggest how to proceed?

[bglearning]

Hi @tiwari93 This is a bit tricky. The models that can handle aggregation don't return no-answer and the confidence scores are also not reliable (else could have filtered based on it).

Maybe some filtering could be done before running the reader (on retriever scores). But not sure how much that would help.

@bogdankostic any thoughts on this?

[tiwari93]

@bglearning Agreed its bit tricky. Trying to build one small application for table query that can handle some thousands of row. Lets see how far I go.

Thank you.

[ZanSara]

Hey @tiwari93 I'll close this issue for now. Please open a new one if you have more questions :slightly_smiling_face: