COMET
COMET copied to clipboard
A Neural Framework for MT Evaluation
## 🚀 Feature It would ease the model usage if the weights of large (>1B) models were available in ```.safetensors```. ### Motivation As for now, it takes ~1 hour to...
Kindly provide the training scripts as well as data preparation scripts for the XCOMET metric.
The point lies here: https://github.com/Unbabel/COMET/blob/master/comet/__init__.py#L22 When we import anything like "from comet import load_from_checkpoint" it will create a global variable "logger" and there are consequences if in the main code...
For translation quality estimation of COMET, I think there is no limitation of the text length. However, from my personal perspective, I do not think the estimation will be accurate...
## ❓ Questions and Help ### Before asking: 1. Search for similar [issues](https://github.com/Unbabel/COMET/issues). 3. Search the [docs](https://unbabel.github.io/COMET/html/index.html). #### What is your question? When I tried to predict some data multiple...
## ❓ Questions and Help ### Before asking: 1. Search for similar [issues](https://github.com/Unbabel/COMET/issues). 3. Search the [docs](https://unbabel.github.io/COMET/html/index.html). #### What is your question? #### Code #### What have you tried? ####...
## 🚀 Feature Add missing py.typed marker ### Motivation This proposal aims to make the project adhere to the [PEP 561 standard for stub packages](https://mypy.readthedocs.io/en/stable/installed_packages.html#installed-packages), thereby enabling type checking. Given...
Hi Team, Can you share the training data and training scripts used for wmt22-cometkiwi-da. We want it reference for training with our own sample reference data.
## 🐛 Bug ### To Reproduce My Python environment is 3.12.4 and sentencepiece dependency require python < 3.12 and there is a new sentencepiece 0.2.0 released when can we expect...
https://github.com/Unbabel/COMET/blob/332dfb0dd16d30eb68a0a61e16d3da2b19a0b06f/README.md?plain=1#L13 Is docCOMET really available? the original repo hasn't been updated for a while (https://github.com/amazon-science/doc-mt-metrics/tree/main) regards