glue-factory icon indicating copy to clipboard operation
glue-factory copied to clipboard

Published 20 hours ago • verified publisher icon cvg

Eval on WxBS

Open ducha-aiki opened this issue 1 year ago • 3 comments

Hi,

Would you be interested in PR, adding the evaluation on WxBS?

https://github.com/ducha-aiki/wxbs-benchmark F9cZN2qX0AAj_LA

And if yes - do you need it to be self-contained, or I just add wxbs-benchmark into requirements.txt?

ducha-aiki avatar Oct 31 '23 11:10 ducha-aiki

Hi @ducha-aiki

It would be great to have WxBS in glue-factory! I would prefer a self-contained port. I suggest adding the WxBS datasets to gluefactory/datasets, and then create a new eval pipeline. I am happy to help on the integration.

Phil26AT avatar Nov 28 '23 15:11 Phil26AT

Sounds good, I'll proceed with it

ducha-aiki avatar Dec 04 '23 13:12 ducha-aiki

@Phil26AT PR is ready :) https://github.com/cvg/glue-factory/pull/52

ducha-aiki avatar Jan 04 '24 14:01 ducha-aiki