MultiMedEval icon indicating copy to clipboard operation
MultiMedEval copied to clipboard

Procedure to add Additional Datasets into the Report comparision/Generation or any other section

Open satheeshkola-532 opened this issue 11 months ago • 0 comments

Thank you so much @corentin-ryr for such a great work, Could you please guide me to add more datasets for each task to evaluate VLMs on latest test datasets also?, I found an example in the folder MultiMedEvalAdditionalDatasets but couldn't able to proceed furtherly to add it into the existing code. Actually i would like to add more datasets for the task: "ReportComparison", but unfortunately the "ReportComparison task family not implemented yet" in the dynamic_datasets.py,. @corentin-ryr could you please update the code base to implement the ReportComparision task family using dynamic dataset?

satheeshkola-532 avatar Jan 27 '25 07:01 satheeshkola-532