Assaf Toledo issues

Repositories
Issues
Comments

Results 5 issues of


                                            Assaf Toledo

Support for a tokenizer parameter in metrics

Some metrics, such as Rouge, accept a tokenizer parameter for better support for foreign languages. It will be helpful to expose this option. https://discuss.huggingface.co/t/which-tokenizer-does-rouge-metric-uses-under-the-hood/19903 https://github.com/google-research/google-research/blob/e3d00617cb28064b6e96ab4e2485079f0ca5a763/rouge/rouge_scorer.py#L60 cc: @perlitz @yoavkatz @gitMichal

Add end-to-end RAG example

I created a branch: and PR in draft state - https://github.com/IBM/unitxt/pull/953 * The task is there, but it fails to run because rouge is missing. I believe the metric is...

enhancement

Assaf Toledo

Support for a tokenizer parameter in metrics

Add end-to-end RAG example

adding the end2end rag task

use mps / cuda gpu in encoder metrics

Cards for the Real MM RAG datasets