VisualAgentBench icon indicating copy to clipboard operation
VisualAgentBench copied to clipboard

When will the training datasets be released?

Open zzjchen opened this issue 1 year ago • 9 comments

Thanks for this great work! When will the datasets be released, especially the training trajectory? Could you release the datasets in very near future?

zzjchen avatar Aug 16 '24 09:08 zzjchen

@zzjchen Hi, thanks for your interest in VAB. Our repo is still under construction, and we expect to first accomplish the quick start for evaluation. The training set is expected to be ready and released in about 1 month.

Xiao9905 avatar Aug 23 '24 02:08 Xiao9905

Thanks. I'm looking forward to it!

zzjchen avatar Aug 23 '24 03:08 zzjchen

Thanks for this great work! Is there any plan to release the training data recently? We plan to use the VAB testing results as evaluation content.

githubzuoyi avatar Sep 12 '24 08:09 githubzuoyi

Seconding this issue, as the paper presents the curated training trajectories as one of the 3 main contributions. It would be great for the community to have these publicly available.

davidkaczer avatar Sep 17 '24 14:09 davidkaczer

Hi @Xiao9905 !

Is there any update on the timeline of releasing the training datasets ?

korbinian-hoermann avatar Dec 13 '24 08:12 korbinian-hoermann

Would like to know about the training sets too!

rutgercap avatar Dec 19 '24 16:12 rutgercap

Thank you guys for your interest in the training datasets! We will release our dataset once our submission receives its decision :)

Xiao9905 avatar Dec 26 '24 12:12 Xiao9905

Hi @Xiao9905 ! Thank you for releasing the benchmark! Could you please confirm if the training dataset is now available for public release? We would greatly appreciate the opportunity to use it for further exploration. Your work is invaluable and thank you for your contributions!

hyfu20 avatar Feb 02 '25 15:02 hyfu20

still wait for releasing training set.

liu-zhy avatar Mar 10 '25 14:03 liu-zhy